mlx-community/LFM2.5-1.2B-Thinking-8bit
Run locally on Apple devices with Mirai
- Type
- local
- From
- LiquidAI
- Quantization
- MLX 8-bit
- Parameters
- 1.2B
- Size
- 1.2 GB
- Source
An 8-bit quantized MLX conversion of LiquidAI's LFM2.5-1.2B-Thinking, designed for efficient on-device inference on Apple Silicon hardware. This compact reasoning model brings chain-of-thought capabilities to edge deployments at just 1.2 billion parameters.
Origin & Architecture
Built by LiquidAI, the LFM2.5 family represents Liquid Foundation Models — a distinct architecture developed for high performance at small scale. The "Thinking" variant is specifically tuned for reasoning tasks, enabling the model to work through problems step-by-step before producing a final answer. This MLX conversion was produced by the mlx-community using mlx-lm v0.30.4, applying 8-bit quantization to reduce memory footprint while preserving model quality.
Key Highlights
- Edge-optimized reasoning: Chain-of-thought capabilities in a 1.2B parameter model, suitable for resource-constrained environments.
- Apple Silicon native: Converted to MLX format for optimized inference on Mac devices via the `mlx-lm` library.
- Multilingual support: Covers eight languages including English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
- 8-bit quantization: Reduces memory requirements compared to the full-precision base model, enabling faster local inference.
Use Cases
This model is well-suited for on-device reasoning tasks where privacy, latency, or offline operation matter — such as local coding assistants, step-by-step problem solving, multilingual Q&A, and lightweight agentic workflows. Its small footprint makes it practical for developers experimenting with reasoning models on laptops and other personal hardware.
Licensing
This model is released under the LFM 1.0 license from LiquidAI. Users should consult the license terms for permitted use cases and restrictions.
spm https://github.com/trymirai/uzu.git
| 1 | import Uzu |
| 2 | |
| 3 | public func runChat() async throws { |
| 4 | let engineConfig = EngineConfig.create() |
| 5 | let engine = try await Engine.create(config: engineConfig) |
| 6 | |
| 7 | guard let model = try await engine.model(identifier: "mlx-community/LFM2.5-1.2B-Thinking-8bit") else { |
| 8 | return |
| 9 | } |
| 10 | for try await update in try await engine.download(model: model).iterator() { |
| 11 | print("Download progress: \(update.progress())") |
| 12 | } |
| 13 | |
| 14 | let messages = [ |
| 15 | ChatMessage.system().withText(text: "You are a helpful assistant"), |
| 16 | ChatMessage.user().withText(text: "Tell me a short, funny story about a robot") |
| 17 | ] |
| 18 | let session = try await engine.chat(model: model, config: .create()) |
| 19 | let stream = await session.replyWithStream(input: messages, config: .create()) |
| 20 | var message: ChatMessage? = nil |
| 21 | for try await update in stream.iterator() { |
| 22 | switch update { |
| 23 | case .replies(let replies): |
| 24 | message = replies.last?.message |
| 25 | case .error(let error): |
| 26 | print("Error: \(error)") |
| 27 | } |
| 28 | } |
| 29 | print("Text: \(message?.text() ?? "empty")") |
| 30 | } |