Llama-3.2-1B-Instruct

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Meta

Quantisation

Quantisation

No

Precision

Precision

No

Size

Size

1B

Source

Source

Hugging Face Logo

Llama 3.2 is a collection of multilingual large language models available in 1 billion and 3 billion parameter sizes, developed by Meta as pretrained and instruction-tuned generative models. The instruction-tuned text-only versions are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks, and outperform many available open source and closed chat models on common industry benchmarks. The model uses an optimized transformer architecture with grouped-query attention for improved inference scalability, and was pretrained on up to 9 trillion tokens of publicly available data with a knowledge cutoff of December 2023. Llama 3.2 supports eight languages officially: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, though it has been trained on a broader collection of languages. The 1B and 3B models incorporate knowledge distillation from larger Llama 3.1 models and use supervised fine-tuning, rejection sampling, and direct preference optimization for alignment. Quantized versions are available optimized for mobile and edge deployment through methods like SpinQuant and QLoRA, achieving significant speedups and memory reductions on constrained devices. The models are designed for deployment as part of broader AI systems with additional safety guardrails rather than in isolation, and are intended for both commercial and research applications.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

Llama-3.2-1B-Instruct

Run locally Apple devices with Mirai

Type

Local

From

Meta

Quantisation

No

Precision

float16

Size

1B

Source

Hugging Face Logo

Llama 3.2 is a collection of multilingual large language models available in 1 billion and 3 billion parameter sizes, developed by Meta as pretrained and instruction-tuned generative models. The instruction-tuned text-only versions are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks, and outperform many available open source and closed chat models on common industry benchmarks. The model uses an optimized transformer architecture with grouped-query attention for improved inference scalability, and was pretrained on up to 9 trillion tokens of publicly available data with a knowledge cutoff of December 2023. Llama 3.2 supports eight languages officially: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, though it has been trained on a broader collection of languages. The 1B and 3B models incorporate knowledge distillation from larger Llama 3.1 models and use supervised fine-tuning, rejection sampling, and direct preference optimization for alignment. Quantized versions are available optimized for mobile and edge deployment through methods like SpinQuant and QLoRA, achieving significant speedups and memory reductions on constrained devices. The models are designed for deployment as part of broader AI systems with additional safety guardrails rather than in isolation, and are intended for both commercial and research applications.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...