Skip to main content
Product
Inference engine
Model conversion
macOS app
CLI tool
Inference for Android • Soon
Models
Metrics
Research
Docs
Careers
Company
About us
Contact us
Product
Models
Metrics
Research
Docs
Careers
Company
uzu on GitHub,
2164
stars
Talk to us
uzu on GitHub,
2164
stars
AI models library
optimized for on device.
Qwen models
from Alibaba
Qwen 3.8
27B
Qwen 3.6
27B
Qwen 3.5
9B
Qwen 3.5
4B
Qwen 3.5
2B
Qwen 3.5
0.8B
Qwen 3.8 27B
2 available checkpoints
Medium
Quantization
103
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
15.6
GB
Size
Large
Quantization
65
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
28.8
GB
Size
Qwen 3.6 27B
2 available checkpoints
Medium
Quantization
112
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
15.6
GB
Size
Large
Quantization
71
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
28.8
GB
Size
Qwen 3.5 9B
2 available checkpoints
Medium
Quantization
203
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
6.0
GB
Size
Large
Quantization
158
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
10.0
GB
Size
Qwen 3.5 4B
2 available checkpoints
Medium
Quantization
166
tok/s
Speed
Measured on Apple M5 Max 128GB
2.5
GB
Size
Large
Quantization
102
tok/s
Speed
Measured on Apple M5 Max 128GB
4.5
GB
Size
Qwen 3.5 2B
2 available checkpoints
Medium
Quantization
312
tok/s
Speed
Measured on Apple M5 Max 128GB
1.1
GB
Size
Large
Quantization
220
tok/s
Speed
Measured on Apple M5 Max 128GB
2.0
GB
Size
Qwen 3.5 0.8B
2 available checkpoints
Medium
Quantization
525
tok/s
Speed
Measured on Apple M5 Max 128GB
460
MB
Size
Large
Quantization
404
tok/s
Speed
Measured on Apple M5 Max 128GB
824
MB
Size
LFM models
from LiquidAI
LFM 2.5
2.6B
LFM 2.5
1.2B Thinking
LFM 2.5
1.2B Instruct
LFM 2.5
350M
LFM 2.5
230M
LFM 2.5 2.6B
2 available checkpoints
Medium
Quantization
276
tok/s
Speed
Measured on Apple M5 Max 128GB
1.5
GB
Size
Large
Quantization
174
tok/s
Speed
Measured on Apple M5 Max 128GB
2.8
GB
Size
LFM 2.5 1.2B Thinking
2 available checkpoints
Medium
Quantization
569
tok/s
Speed
Measured on Apple M5 Max 128GB
639
MB
Size
Large
Quantization
381
tok/s
Speed
Measured on Apple M5 Max 128GB
1.2
GB
Size
LFM 2.5 1.2B Instruct
2 available checkpoints
Medium
Quantization
564
tok/s
Speed
Measured on Apple M5 Max 128GB
639
MB
Size
Large
Quantization
379
tok/s
Speed
Measured on Apple M5 Max 128GB
1.2
GB
Size
LFM 2.5 350M
2 available checkpoints
Medium
Quantization
1096
tok/s
Speed
Measured on Apple M5 Max 128GB
198
MB
Size
Large
Quantization
847
tok/s
Speed
Measured on Apple M5 Max 128GB
372
MB
Size
LFM 2.5 230M
2 available checkpoints
Medium
Quantization
1342
tok/s
Speed
Measured on Apple M5 Max 128GB
130
MB
Size
Large
Quantization
1125
tok/s
Speed
Measured on Apple M5 Max 128GB
243
MB
Size
Muse Glimmer models
from Meta
Muse-Glimmer 30B
2 available checkpoints
Medium
Quantization
82
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
16.6
GB
Size
Large
Quantization
53
tok/s
Speed
Measured on Apple M5 Max 128GB with speculative decoding
30.3
GB
Size