Skip to main content

AI models library optimized for on device.

Qwen models from Alibaba

Qwen3.8 27B

2 available checkpoints

MediumQuantization129 tok/sSpeed15.7 GBSize
LargeQuantization77 tok/sSpeed28.9 GBSize

LFM models from LiquidAI

LFM2.5 2.6B

2 available checkpoints

MediumQuantization267 tok/sSpeed1.5 GBSize
LargeQuantization175 tok/sSpeed2.8 GBSize

Muse Glimmer models from Meta

Muse-Glimmer 30B

2 available checkpoints

MediumQuantization90 tok/sSpeed16.6 GBSize
LargeQuantization65 tok/sSpeed30.3 GBSize

d3 flash models from vLLM Semantic Router

d3-flash 9B

1 available checkpoint

MediumQuantization4.3 GBSize