Type
Type
Local
From
From
Alibaba
Quantization
Quantization
uint8
Parameters
Parameters
32B
Size
Size
Source
Source
Alibaba
available local models on Mirai:
Qwen2.5-Coder-0.5B-Instruct
0.5B
0.5B
Qwen2.5-Coder-1.5B-Instruct
1.5B
1.5B
Qwen2.5-Coder-14B-Instruct
14B
14B
Qwen2.5-Coder-32B-Instruct
32B
32B
Qwen2.5-Coder-3B-Instruct
3B
3B
Qwen2.5-Coder-7B-Instruct
7B
7B
Qwen3-0.6B
0.6B
0.6B
Qwen3-0.6B-MLX-4bit
0.6B
0.6B
Qwen3-0.6B-MLX-8bit
0.6B
0.6B
Qwen3-1.7B
1.7B
1.7B
Qwen3-1.7B-MLX-4bit
1.7B
1.7B
Qwen3-1.7B-MLX-8bit
1.7B
1.7B
Qwen3-14B
14B
14B
Qwen3-14B-AWQ
14B
14B
Qwen3-14B-MLX-4bit
14B
14B
Qwen3-14B-MLX-8bit
14B
14B
Qwen3-32B
32B
32B
Qwen3-32B-AWQ
32B
32B
Qwen3-32B-MLX-4bit
32B
32B
Qwen3-4B
4B
4B
Alibaba
available local models on Mirai:
Qwen2.5-Coder-0.5B-Instruct
0.5B
0.5B
Qwen2.5-Coder-1.5B-Instruct
1.5B
1.5B
Qwen2.5-Coder-14B-Instruct
14B
14B
Qwen2.5-Coder-32B-Instruct
32B
32B
Qwen2.5-Coder-3B-Instruct
3B
3B
Qwen2.5-Coder-7B-Instruct
7B
7B
Qwen3-0.6B
0.6B
0.6B
Qwen3-0.6B-MLX-4bit
0.6B
0.6B
Qwen3-0.6B-MLX-8bit
0.6B
0.6B
Qwen3-1.7B
1.7B
1.7B
Qwen3-1.7B-MLX-4bit
1.7B
1.7B
Qwen3-1.7B-MLX-8bit
1.7B
1.7B
Qwen3-14B
14B
14B
Qwen3-14B-AWQ
14B
14B
Qwen3-14B-MLX-4bit
14B
14B
Qwen3-14B-MLX-8bit
14B
14B
Qwen3-32B
32B
32B
Qwen3-32B-AWQ
32B
32B
Qwen3-32B-MLX-4bit
32B
32B
Qwen3-4B
4B
4B