Llama-3.2-1B-Instruct-8bit

Run locally on Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

uint8

Size

Size

1B

Source

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

Llama-3.2-1B-Instruct-8bit

Run locally on Apple devices with Mirai

Type

Local

From

Meta

Quantisation

uint8

Size

1B

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model released by Meta that supports text generation across multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model has been converted to MLX format for optimized performance on compatible hardware. This 1B instruction-tuned variant is designed for conversational use cases and can be readily integrated into applications using the mlx-lm library for efficient inference and generation tasks.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...