Llama-3.1-8B-Instruct-4bit

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

uint4

Precision

Precision

No

Size

Size

8B

Source

Source

Hugging Face Logo

This is the MLX format conversion of Llama 3.1 8B Instruct, a large language model optimized for instruction-following tasks. The model was converted from Meta's original Llama 3.1 8B Instruct using mlx-lm, enabling efficient inference on Apple silicon devices. It supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, and is designed to follow user instructions and engage in multi-turn conversations.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

Llama-3.1-8B-Instruct-4bit

Run locally Apple devices with Mirai

Type

Local

From

Meta

Quantisation

uint4

Precision

float16

Size

8B

Source

Hugging Face Logo

This is the MLX format conversion of Llama 3.1 8B Instruct, a large language model optimized for instruction-following tasks. The model was converted from Meta's original Llama 3.1 8B Instruct using mlx-lm, enabling efficient inference on Apple silicon devices. It supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, and is designed to follow user instructions and engage in multi-turn conversations.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...