Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.
Meta
available local models on Mirai:
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct
uint8
3B
Quant.
uint8
Size
3B
Llama-3.1-8B-Instruct-4bit
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct-4bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-1B-Instruct-8bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct-4bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-8bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint8
3B
Quant.
uint8
Size
3B
Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.
Meta
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct
uint8
3B
Quant.
uint8
Size
3B
Llama-3.1-8B-Instruct-4bit
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct-4bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-1B-Instruct-8bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct-4bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-8bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint8
3B
Quant.
uint8
Size
3B