Product
Inference engine
Model conversion
MacOS app
CLI tool
Cloud inference
Inference for Android • Soon
Models library
Research
Docs
Careers
Company
About us
Contact us
Product
Models library
Research
Docs
Careers
Company
1654
Talk to us
1654
Research & Blog
Company updates, educational articles and researches
Trees from Marginals: Autoregressive drafting with factorized priors
Jul 7, 2026
Sparse Buffers for KV Cache
Jun 7, 2026
Introducing Mirai Quantization: Redefining the speed-quality frontier for local LLMs on Apple silicon.
Jun 3, 2026
