Llama-3.2-3B-Instruct-8bit

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

uint8

Precision

Precision

No

Size

Size

3B

Source

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. This particular model is the 3 billion parameter instruction-tuned version converted to MLX format for optimized performance. The model is designed for text generation tasks and builds on the Llama 3 architecture, representing Meta's continued advancement in open-source language modeling technology.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

Llama-3.2-3B-Instruct-8bit

Run locally Apple devices with Mirai

Type

Local

From

Meta

Quantisation

uint8

Precision

float16

Size

3B

Source

Hugging Face Logo

Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. This particular model is the 3 billion parameter instruction-tuned version converted to MLX format for optimized performance. The model is designed for text generation tasks and builds on the Llama 3 architecture, representing Meta's continued advancement in open-source language modeling technology.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...