Inference Engine
The fastest inference runtime for iPhone, iPad and Mac.
Inference Engine
Optimize and run your model on every Apple device.
Up to 38% faster prompt processing vs MLX.
Optimize and run your model on every Apple device. Up to 38% faster prompt processing vs MLX.
Run your model on 2 billion Apple devices. Perfect for:
Model companies.
You train and ship models. Mirai optimizes them for Apple Silicon, benchmarks on real hardware, and distributes.
AI researchers & labs.
Mirai converts your model and puts it in front of real users on Apple devices, not just leaderboards.
Independent makers.
You're fine-tuning or training from scratch. Mirai gives your model the same device reach as OpenAI and DeepSeek.
Model companies.
You train and ship models. Mirai optimizes them for Apple Silicon, benchmarks on real hardware, and distributes.
AI researchers & labs.
Mirai converts your model and puts it in front of real users on Apple devices, not just leaderboards.
Independent makers.
You're fine-tuning or training from scratch. Mirai gives your model the same device reach as OpenAI and DeepSeek.
What Apple Silicon delivers today with Mirai.
Convert. Integrate. Run.
One inference engine. Integrate from any language.
Language
Distribution
Language
Distribution
Rust
Cargo
Rust
Cargo
![](data:image/svg+xml,<svg display="block" role="presentation" viewBox="0 0 16 16" xmlns="http://www.w3.org/2000/svg"><defs ><linearGradient id="GmOjotX3S-1597364044-linear-gradient" x1="0.5223986368453727" x2="0.4776013631546273" y1="5.551115123125783e-17" y2="1"><stop offset="0" stop-color="rgb(248, 133, 53)"/><stop offset="1" stop-color="rgb(253, 34, 33)"/></linearGradient></defs><path d="M 9.955 0.001 C 9.955 0.001 13.508 1.927 14.437 4.986 C 15.275 7.75 14.604 9.069 14.604 9.069 C 15.032 9.512 15.37 10.027 15.599 10.587 C 16.067 11.317 16.129 12.218 15.765 13 C 15.765 13 15.708 11.873 13.937 11.639 C 12.313 11.422 11.723 12.921 8.623 12.849 C 5.135 12.786 1.906 11.089 0 8.318 C 1.515 9.101 3.499 10.318 5.971 10.131 C 8.442 9.944 8.958 9.224 8.958 9.224 C 6.18 7.139 3.721 4.698 1.652 1.971 C 3.595 3.513 8.407 6.581 8.295 6.503 C 6.535 4.872 4.924 3.101 3.481 1.211 C 3.481 1.211 10.701 6.841 11.282 6.805 C 11.521 6.339 12.756 3.923 9.955 0 Z" fill="url(%23GmOjotX3S-1597364044-linear-gradient)" height="13px" id="GmOjotX3S" transform="translate(0 1)" width="16px"/></svg>)
Swift
Swift Package Manager
Swift
Swift Package Manager
![](data:image/svg+xml,<svg display="block" role="presentation" viewBox="0 0 16 16" xmlns="http://www.w3.org/2000/svg"><g d="M 0.857 0.857 L 16 0.857 L 16 16 L 0.857 16 Z M 13.061 1.157 L 4.096 1.157 C 2.484 1.157 1.177 2.446 1.177 4.037 L 1.177 12.881 C 1.177 14.471 2.484 15.76 4.096 15.76 L 13.061 15.76 C 14.673 15.76 15.98 14.471 15.98 12.881 L 15.98 4.037 C 15.98 2.446 14.673 1.157 13.061 1.157 Z M 0 7.991 L 0 15.982 L 15.982 15.982 L 15.982 0 L 0 0 Z M 12.879 7.354 C 13.285 7.456 13.595 7.636 13.879 7.93 C 14.026 8.087 14.244 8.374 14.262 8.442 C 14.267 8.463 13.572 8.929 13.151 9.191 C 13.135 9.201 13.075 9.135 13.006 9.033 C 12.801 8.734 12.585 8.605 12.255 8.582 C 11.771 8.549 11.459 8.803 11.461 9.226 C 11.461 9.351 11.479 9.424 11.53 9.526 C 11.636 9.746 11.834 9.878 12.456 10.147 C 13.6 10.639 14.089 10.964 14.394 11.426 C 14.734 11.941 14.81 12.762 14.579 13.374 C 14.325 14.038 13.696 14.49 12.811 14.64 C 12.537 14.688 11.887 14.68 11.593 14.627 C 10.951 14.513 10.342 14.196 9.967 13.78 C 9.82 13.617 9.533 13.194 9.551 13.163 C 9.559 13.153 9.625 13.113 9.698 13.069 C 9.896 12.956 10.094 12.842 10.292 12.727 L 10.751 12.461 L 10.847 12.603 C 10.982 12.808 11.276 13.09 11.454 13.184 C 11.963 13.453 12.664 13.414 13.009 13.105 C 13.156 12.971 13.217 12.831 13.217 12.626 C 13.217 12.44 13.194 12.359 13.097 12.22 C 12.973 12.042 12.719 11.892 11.999 11.58 C 11.174 11.225 10.819 11.005 10.495 10.654 C 10.307 10.452 10.129 10.127 10.056 9.855 C 9.995 9.63 9.98 9.064 10.028 8.836 C 10.198 8.039 10.799 7.483 11.667 7.319 C 11.948 7.265 12.603 7.286 12.879 7.354 Z M 9.127 8.021 L 9.132 8.676 L 7.052 8.676 L 7.052 14.586 L 5.581 14.586 L 5.581 8.676 L 3.501 8.676 L 3.501 8.034 C 3.501 7.679 3.508 7.382 3.519 7.374 C 3.526 7.364 4.792 7.359 6.327 7.362 L 9.12 7.369 Z" fill="transparent" height="16px" id="oKpnXWSla" width="16.00007992721069px"><path d="M 0 0 L 15.143 0 L 15.143 15.143 L 0 15.143 Z" fill="transparent" height="15.142623839144562px" id="osd0YL7ia" transform="translate(0.857 0.857)" width="15.14262383914459px"/><path d="M 11.884 0 L 2.919 0 C 1.307 0 0 1.289 0 2.88 L 0 11.724 C 0 13.314 1.307 14.603 2.919 14.603 L 11.884 14.603 C 13.496 14.603 14.803 13.314 14.803 11.724 L 14.803 2.88 C 14.803 1.289 13.496 0 11.884 0 Z" fill="rgb(255, 255, 255)" height="14.60324277891118px" id="FdKfNOQ8D" transform="translate(1.177 1.157)" width="14.80301354196061px"/><g d="M 0 7.991 L 0 15.982 L 15.982 15.982 L 15.982 0 L 0 0 Z M 12.879 7.354 C 13.285 7.456 13.595 7.636 13.879 7.93 C 14.026 8.087 14.244 8.374 14.262 8.442 C 14.267 8.463 13.572 8.929 13.151 9.191 C 13.135 9.201 13.075 9.135 13.006 9.033 C 12.801 8.734 12.585 8.605 12.255 8.582 C 11.771 8.549 11.459 8.803 11.461 9.226 C 11.461 9.351 11.479 9.424 11.53 9.526 C 11.636 9.746 11.834 9.878 12.456 10.147 C 13.6 10.639 14.089 10.964 14.394 11.426 C 14.734 11.941 14.81 12.762 14.579 13.374 C 14.325 14.038 13.696 14.49 12.811 14.64 C 12.537 14.688 11.887 14.68 11.593 14.627 C 10.951 14.513 10.342 14.196 9.967 13.78 C 9.82 13.617 9.533 13.194 9.551 13.163 C 9.559 13.153 9.625 13.113 9.698 13.069 C 9.896 12.956 10.094 12.842 10.292 12.727 L 10.751 12.461 L 10.847 12.603 C 10.982 12.808 11.276 13.09 11.454 13.184 C 11.963 13.453 12.664 13.414 13.009 13.105 C 13.156 12.971 13.217 12.831 13.217 12.626 C 13.217 12.44 13.194 12.359 13.097 12.22 C 12.973 12.042 12.719 11.892 11.999 11.58 C 11.174 11.225 10.819 11.005 10.495 10.654 C 10.307 10.452 10.129 10.127 10.056 9.855 C 9.995 9.63 9.98 9.064 10.028 8.836 C 10.198 8.039 10.799 7.483 11.667 7.319 C 11.948 7.265 12.603 7.286 12.879 7.354 Z M 9.127 8.021 L 9.132 8.676 L 7.052 8.676 L 7.052 14.586 L 5.581 14.586 L 5.581 8.676 L 3.501 8.676 L 3.501 8.034 C 3.501 7.679 3.508 7.382 3.519 7.374 C 3.526 7.364 4.792 7.359 6.327 7.362 L 9.12 7.369 Z" fill="transparent" height="15.981661043952045px" id="nImBeu2wy" width="15.981661043952073px"><path d="M 0 7.991 L 0 15.982 L 15.982 15.982 L 15.982 0 L 0 0 Z M 12.879 7.354 C 13.285 7.456 13.595 7.636 13.879 7.93 C 14.026 8.087 14.244 8.374 14.262 8.442 C 14.267 8.463 13.572 8.929 13.151 9.191 C 13.135 9.201 13.075 9.135 13.006 9.033 C 12.801 8.734 12.585 8.605 12.255 8.582 C 11.771 8.549 11.459 8.803 11.461 9.226 C 11.461 9.351 11.479 9.424 11.53 9.526 C 11.636 9.746 11.834 9.878 12.456 10.147 C 13.6 10.639 14.089 10.964 14.394 11.426 C 14.734 11.941 14.81 12.762 14.579 13.374 C 14.325 14.038 13.696 14.49 12.811 14.64 C 12.537 14.688 11.887 14.68 11.593 14.627 C 10.951 14.513 10.342 14.196 9.967 13.78 C 9.82 13.617 9.533 13.194 9.551 13.163 C 9.559 13.153 9.625 13.113 9.698 13.069 C 9.896 12.956 10.094 12.842 10.292 12.727 L 10.751 12.461 L 10.847 12.603 C 10.982 12.808 11.276 13.09 11.454 13.184 C 11.963 13.453 12.664 13.414 13.009 13.105 C 13.156 12.971 13.217 12.831 13.217 12.626 C 13.217 12.44 13.194 12.359 13.097 12.22 C 12.973 12.042 12.719 11.892 11.999 11.58 C 11.174 11.225 10.819 11.005 10.495 10.654 C 10.307 10.452 10.129 10.127 10.056 9.855 C 9.995 9.63 9.98 9.064 10.028 8.836 C 10.198 8.039 10.799 7.483 11.667 7.319 C 11.948 7.265 12.603 7.286 12.879 7.354 Z M 9.127 8.021 L 9.132 8.676 L 7.052 8.676 L 7.052 14.586 L 5.581 14.586 L 5.581 8.676 L 3.501 8.676 L 3.501 8.034 C 3.501 7.679 3.508 7.382 3.519 7.374 C 3.526 7.364 4.792 7.359 6.327 7.362 L 9.12 7.369 Z" fill="rgb(0, 122, 204)" height="15.981661043952045px" id="avm17tFMG" width="15.981661043952073px"/></g></g></svg>)
TypeScript
NPM (Node.js)
TypeScript
NPM (Node.js)
Kotlin
Coming Soon
Kotlin
Coming Soon
Python
Coming Soon
Python
Coming Soon
Same high-level API across all languages.
Full performance of the Rust core from every language.
Convert once, integrate anywhere.
Built-in features every model gets automatically:
Speculative decoding.
A draft model predicts tokens ahead, your model verifies in one pass. Up to 2x faster generation.
Structured output.
Task-specific sessions.
Built-in performance metrics.
Speculative decoding
Structured output
Task-specific sessions
Built-in performance metrics
Supported models
Supported models:
Common questions:
How does model support work?
How does model support work?
What architectures are supported?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
What architectures are supported?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How does Mirai compare to other inference engines?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How does Mirai compare to other inference engines?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
What is the maximum supported model size?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
What is the maximum supported model size?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How can I run benchmarks myself?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How can I run benchmarks myself?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How can we discuss a specific use case?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
How can we discuss a specific use case?
Framer is a design tool that allows you to design websites on a freeform canvas, and then publish them as websites with a single click.
