This is the MLX format conversion of Llama 3.1 8B Instruct, a large language model optimized for instruction-following tasks. The model was converted from Meta's original Llama 3.1 8B Instruct using mlx-lm, enabling efficient inference on Apple silicon devices. It supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, and is designed to follow user instructions and engage in multi-turn conversations.
Meta
available local models on Mirai:
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct
uint4
3B
Quant.
uint4
Size
3B
Llama-3.1-8B-Instruct-4bit
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct-4bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-1B-Instruct-8bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct-4bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-8bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint4
3B
Quant.
uint4
Size
3B
This is the MLX format conversion of Llama 3.1 8B Instruct, a large language model optimized for instruction-following tasks. The model was converted from Meta's original Llama 3.1 8B Instruct using mlx-lm, enabling efficient inference on Apple silicon devices. It supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, and is designed to follow user instructions and engage in multi-turn conversations.
Meta
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct
uint4
3B
Quant.
uint4
Size
3B
Llama-3.1-8B-Instruct-4bit
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct-4bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-1B-Instruct-8bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct-4bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-8bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint4
3B
Quant.
uint4
Size
3B