Llama-3.2-1B-Instruct-8bit

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

uint8

Precision

Precision

No

Size

Size

1B

Source

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.

Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.

Llama-3.2-1B-Instruct-8bit

Run locally Apple devices with Mirai

Type

Local

From

Meta

Quantisation

uint8

Precision

float16

Size

1B

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.