Type
Type
Local
From
From
Meta
Quantisation
Quantisation
uint4
Size
Size
3B
Source
Source
Meta
available local models on Mirai:
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct
uint4
3B
Quant.
uint4
Size
3B
Llama-3.1-8B-Instruct-4bit
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct-4bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-1B-Instruct-8bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct-4bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-8bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint4
3B
Quant.
uint4
Size
3B
Meta
available local models on Mirai:
Name
Quantisation
Size
Llama-3.1-8B-Instruct
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct
uint4
3B
Quant.
uint4
Size
3B
Llama-3.1-8B-Instruct-4bit
uint4
8B
Quant.
uint4
Size
8B
Llama-3.2-1B-Instruct-4bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-1B-Instruct-8bit
uint4
1B
Quant.
uint4
Size
1B
Llama-3.2-3B-Instruct-4bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-8bit
uint4
3B
Quant.
uint4
Size
3B
Llama-3.2-3B-Instruct-AWQ
uint4
3B
Quant.
uint4
Size
3B