Llama-3.2-3B-Instruct-4bit

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

uint4

Precision

Precision

No

Size

Size

3B

Source

Source

Hugging Face Logo

This is Llama 3.2 3B Instruct converted to MLX format with 4-bit quantization. Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model is designed for instruction-following tasks and can be used for text generation. This particular version has been optimized for use with MLX, a machine learning framework designed for Apple Silicon, making it suitable for efficient inference on compatible hardware.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

Llama-3.2-3B-Instruct-4bit

Run locally Apple devices with Mirai

Type

Local

From

Meta

Quantisation

uint4

Precision

float16

Size

3B

Source

Hugging Face Logo

This is Llama 3.2 3B Instruct converted to MLX format with 4-bit quantization. Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model is designed for instruction-following tasks and can be used for text generation. This particular version has been optimized for use with MLX, a machine learning framework designed for Apple Silicon, making it suitable for efficient inference on compatible hardware.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...