Optimised for on device

Qwen2.5-Coder-7B-Instruct-AWQ

From

Alibaba

Alibaba

Quantisation

uint4

uint4

Precision

Size

7B

7B

Source

Hugging Face Logo