Decide what runs local vs cloud. Automatically
Mirai’s routing engine gives you full control over performance, privacy, and price
On device or cloud. In real time
Mirai Routing Optimises
when low-latency matters
for sensitive data
when longer context is needed
to run less in the cloud
Configure routing without changing your app logic
Specify hard rules (always use cloud, never use cloud), prompt templates with routing hints, model families per task type and more…
