Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. This particular model is the 3 billion parameter instruction-tuned version converted to MLX format for optimized performance. The model is designed for text generation tasks and builds on the Llama 3 architecture, representing Meta's continued advancement in open-source language modeling technology.
Meta
available local models on Mirai:
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct
uint8
3B
Quant.
uint8
Size
3B
Llama-3.1-8B-Instruct-4bit
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct-4bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-1B-Instruct-8bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct-4bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-8bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint8
3B
Quant.
uint8
Size
3B
Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. This particular model is the 3 billion parameter instruction-tuned version converted to MLX format for optimized performance. The model is designed for text generation tasks and builds on the Llama 3 architecture, representing Meta's continued advancement in open-source language modeling technology.
Meta
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct
uint8
3B
Quant.
uint8
Size
3B
Llama-3.1-8B-Instruct-4bit
uint8
8B
Quant.
uint8
Size
8B
Llama-3.2-1B-Instruct-4bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-1B-Instruct-8bit
uint8
1B
Quant.
uint8
Size
1B
Llama-3.2-3B-Instruct-4bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-8bit
uint8
3B
Quant.
uint8
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint8
3B
Quant.
uint8
Size
3B