mlx-community/LFM2-350M-8bit
Run locally on Apple devices with Mirai
- Type
- local
- From
- LiquidAI
- Quantization
- MLX 8-bit
- Parameters
- 350M
- Size
- 364.0 MB
- Source
An 8-bit quantized version of LiquidAI's LFM2-350M, converted to Apple's MLX format for efficient on-device inference on Apple Silicon hardware. This community conversion makes Liquid AI's compact language model readily accessible for local text generation workflows on Mac.
Origin & Architecture
LFM2-350M is part of Liquid AI's second-generation Liquid Foundation Model family, designed specifically for edge deployment. At just 350 million parameters, it targets scenarios where low latency, small memory footprint, and on-device privacy are priorities. The 8-bit quantization further reduces the model's memory requirements while preserving practical output quality — ideal for resource-constrained environments.
Multilingual Support
Despite its compact size, LFM2-350M supports eight languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish, making it a versatile choice for multilingual text generation tasks at the edge.
Key Details
- Base model: LiquidAI/LFM2-350M
- Quantization: 8-bit
- Framework: MLX (via `mlx-lm` v0.26.0)
- Task: Text generation
- License: LFM 1.0 (custom)
Best For
- Local text generation on Apple Silicon Macs
- Edge and on-device language model experimentation
- Lightweight multilingual generation where full-scale models are impractical
- Developers exploring Liquid AI's novel architecture in a Mac-native runtime
This conversion is maintained by the mlx-community and provides a straightforward path to running one of the smallest capable multilingual models directly on Apple hardware without cloud dependencies.
spm https://github.com/trymirai/uzu.git
| 1 | import Uzu |
| 2 | |
| 3 | public func runChat() async throws { |
| 4 | let engineConfig = EngineConfig.create() |
| 5 | let engine = try await Engine.create(config: engineConfig) |
| 6 | |
| 7 | guard let model = try await engine.model(identifier: "mlx-community/LFM2-350M-8bit") else { |
| 8 | return |
| 9 | } |
| 10 | for try await update in try await engine.download(model: model).iterator() { |
| 11 | print("Download progress: \(update.progress())") |
| 12 | } |
| 13 | |
| 14 | let messages = [ |
| 15 | ChatMessage.system().withText(text: "You are a helpful assistant"), |
| 16 | ChatMessage.user().withText(text: "Tell me a short, funny story about a robot") |
| 17 | ] |
| 18 | let session = try await engine.chat(model: model, config: .create()) |
| 19 | let stream = await session.replyWithStream(input: messages, config: .create()) |
| 20 | var message: ChatMessage? = nil |
| 21 | for try await update in stream.iterator() { |
| 22 | switch update { |
| 23 | case .replies(let replies): |
| 24 | message = replies.last?.message |
| 25 | case .error(let error): |
| 26 | print("Error: \(error)") |
| 27 | } |
| 28 | } |
| 29 | print("Text: \(message?.text() ?? "empty")") |
| 30 | } |