Talk to us

Qwen2.5-Coder-7B-Instruct-AWQ

Run locally on Apple devices with Mirai

Run on device

Type

Type

Local

From

From

Alibaba

Quantisation

Quantisation

uint4

Size

Size

7B

Source

Source

Hugging Face Logo

Explore all local models

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key →
4
Apply code
Loading...

Alibaba

available local models on Mirai:

available local models on Mirai:

Name

Quantisation

Size

Qwen2.5-Coder-0.5B-Instruct

uint4

0.5B

Quant.

uint4

Size

0.5B

Qwen2.5-Coder-1.5B-Instruct

uint4

1.5B

Quant.

uint4

Size

1.5B

Qwen2.5-Coder-14B-Instruct

uint4

14B

Quant.

uint4

Size

14B

Qwen2.5-Coder-32B-Instruct

uint4

32B

Quant.

uint4

Size

32B

Qwen2.5-Coder-3B-Instruct

uint4

3B

Quant.

uint4

Size

3B

Qwen2.5-Coder-7B-Instruct

uint4

7B

Quant.

uint4

Size

7B

Qwen3-0.6B

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-0.6B-MLX-4bit

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-0.6B-MLX-8bit

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-1.7B

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-1.7B-MLX-4bit

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-1.7B-MLX-8bit

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-14B

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-AWQ

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-MLX-4bit

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-MLX-8bit

uint4

14B

Quant.

uint4

Size

14B

Qwen3-32B

uint4

32B

Quant.

uint4

Size

32B

Qwen3-32B-AWQ

uint4

32B

Quant.

uint4

Size

32B

Qwen3-32B-MLX-4bit

uint4

32B

Quant.

uint4

Size

32B

Qwen3-4B

uint4

4B

Quant.

uint4

Size

4B

Qwen2.5-Coder-7B-Instruct-AWQ

Run locally on Apple devices with Mirai

Run on device

Type

Local

From

Alibaba

Quantisation

uint4

Size

7B

Source

Hugging Face Logo

Explore all local models

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key →
4
Apply code
Loading...

Alibaba

available local models on Mirai:

Name

Quantisation

Size

Qwen2.5-Coder-0.5B-Instruct

uint4

0.5B

Quant.

uint4

Size

0.5B

Qwen2.5-Coder-1.5B-Instruct

uint4

1.5B

Quant.

uint4

Size

1.5B

Qwen2.5-Coder-14B-Instruct

uint4

14B

Quant.

uint4

Size

14B

Qwen2.5-Coder-32B-Instruct

uint4

32B

Quant.

uint4

Size

32B

Qwen2.5-Coder-3B-Instruct

uint4

3B

Quant.

uint4

Size

3B

Qwen2.5-Coder-7B-Instruct

uint4

7B

Quant.

uint4

Size

7B

Qwen3-0.6B

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-0.6B-MLX-4bit

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-0.6B-MLX-8bit

uint4

0.6B

Quant.

uint4

Size

0.6B

Qwen3-1.7B

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-1.7B-MLX-4bit

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-1.7B-MLX-8bit

uint4

1.7B

Quant.

uint4

Size

1.7B

Qwen3-14B

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-AWQ

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-MLX-4bit

uint4

14B

Quant.

uint4

Size

14B

Qwen3-14B-MLX-8bit

uint4

14B

Quant.

uint4

Size

14B

Qwen3-32B

uint4

32B

Quant.

uint4

Size

32B

Qwen3-32B-AWQ

uint4

32B

Quant.

uint4

Size

32B

Qwen3-32B-MLX-4bit

uint4

32B

Quant.

uint4

Size

32B

Qwen3-4B

uint4

4B

Quant.

uint4

Size

4B

Main

Company

Links

Platform / SDK

Inference Runtime

Models Conversion

Models Library

MacOS App

Blog

Docs

About us

Careers

Contact Us

Privacy Policy

Terms of Use

X (Twitter)

Github

LinkedIn

Discord

Platform / SDK

Inference Runtime

Models Conversion

Models Library

MacOS App

Blog

Docs

Main

About us

Careers

Contact Us

Privacy Policy

Terms of Use

Company

X (Twitter)

Github

LinkedIn

Discord

Links

Main

Company

Links

Platform / SDK

Inference Runtime

Models Conversion

Models Library

MacOS App

Blog

Docs

About us

Careers

Contact Us

Privacy Policy

Terms of Use

X (Twitter)

Github

LinkedIn

Discord

Product

Models library

MacOS app

Docs

Company

Talk to us

1455

Product

Models library

MacOS app

Docs

Company

Talk to us

1455