SmolLM2-1.7B-Instruct-AWQ

Run locally on Apple devices with Mirai

Type

Type

Local

From

From

HuggingFace

Quantisation

Quantisation

uint4

Size

Size

1.7B

Source

Source

Hugging Face Logo

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

HuggingFace

available local models on Mirai:

available local models on Mirai:

SmolLM2-1.7B-Instruct-AWQ

Run locally on Apple devices with Mirai

Type

Local

From

HuggingFace

Quantisation

uint4

Size

1.7B

Source

Hugging Face Logo

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...