mlx-community/LFM2-2.6B-8bit

Name: mlx-community/LFM2-2.6B-8bit
Author: LiquidAI

Run locally on Apple devices with Mirai

Type: local
From: LiquidAI
Quantization: MLX 8-bit
Parameters: 2.6B
Size: 2.5 GB
Source

An 8-bit quantized version of LiquidAI's LFM2-2.6B, converted to Apple's MLX format for efficient on-device inference on Apple Silicon hardware. This community conversion enables fast, memory-friendly text generation directly on Mac devices.

Origin & Architecture

LFM2-2.6B is developed by Liquid AI as part of their LFM2 (Liquid Foundation Model) series, designed specifically for edge deployment. The model sits at 2.6 billion parameters — compact enough for local use while still delivering capable language generation. This variant was quantized to 8-bit precision and converted to the MLX framework using `mlx-lm` v0.28.0.

Multilingual Support

The model supports eight languages out of the box:

English, French, German, Spanish
Arabic, Chinese, Japanese, Korean

This broad language coverage makes it a versatile choice for multilingual applications running on-device without cloud dependencies.

Key Strengths

Edge-optimized: Purpose-built for constrained environments, making it ideal for local deployment on laptops and desktops powered by Apple Silicon.
8-bit quantization: Reduces memory footprint while preserving model quality, allowing smooth inference even on machines with limited unified memory.
MLX-native: Takes full advantage of Apple's MLX framework for optimized performance on M-series chips.

Use Cases

LFM2-2.6B-8bit is well suited for local text generation tasks including conversational AI, content drafting, multilingual translation assistance, and lightweight coding support — all without requiring a network connection or external API. Its small footprint and chat-template support make it a practical choice for developers building private, responsive AI-powered applications on macOS.

License: LFM 1.0 (custom license from Liquid AI)

Explore all local models

Choose framework

Run the following command to install Mirai SDK

spm https://github.com/trymirai/uzu.git

Apply code

1import Uzu23public func runChat() async throws {4    let engineConfig = EngineConfig.create()5    let engine = try await Engine.create(config: engineConfig)67    guard let model = try await engine.model(identifier: "mlx-community/LFM2-2.6B-8bit") else {8        return9    }10    for try await update in try await engine.download(model: model).iterator() {11        print("Download progress: \(update.progress())")12    }1314    let messages = [15        ChatMessage.system().withText(text: "You are a helpful assistant"),16        ChatMessage.user().withText(text: "Tell me a short, funny story about a robot")17    ]18    let session = try await engine.chat(model: model, config: .create())19    let stream = await session.replyWithStream(input: messages, config: .create())20    var message: ChatMessage? = nil21    for try await update in stream.iterator() {22        switch update {23        case .replies(let replies):24            message = replies.last?.message25        case .error(let error):26            print("Error: \(error)")27        }28    }29    print("Text: \(message?.text() ?? "empty")")30}

1Choose framework

2Run the following command to install Mirai SDK

spm https://github.com/trymirai/uzu.git

3Apply code

1	import Uzu
2
3	public func runChat() async throws {
4	let engineConfig = EngineConfig.create()
5	let engine = try await Engine.create(config: engineConfig)
6
7	guard let model = try await engine.model(identifier: "mlx-community/LFM2-2.6B-8bit") else {
8	return
9	}
10	for try await update in try await engine.download(model: model).iterator() {
11	print("Download progress: \(update.progress())")
12	}
13
14	let messages = [
15	ChatMessage.system().withText(text: "You are a helpful assistant"),
16	ChatMessage.user().withText(text: "Tell me a short, funny story about a robot")
17	]
18	let session = try await engine.chat(model: model, config: .create())
19	let stream = await session.replyWithStream(input: messages, config: .create())
20	var message: ChatMessage? = nil
21	for try await update in stream.iterator() {
22	switch update {
23	case .replies(let replies):
24	message = replies.last?.message
25	case .error(let error):
26	print("Error: \(error)")
27	}
28	}
29	print("Text: \(message?.text() ?? "empty")")
30	}