gemma-3-27b-it-4bit

Run locally Apple devices with Mirai

Type

Type

Local

From

From

Google

Quantisation

Quantisation

uint4

Precision

Precision

No

Size

Size

27B

Source

Source

Hugging Face Logo

This model is a 4-bit quantized version of Google's Gemma 3 27B instruction-tuned model, converted to MLX format for efficient inference on Apple Silicon. It is a multimodal model capable of processing both images and text, allowing it to answer questions about images and perform vision-language tasks. The model maintains the capabilities of the original Gemma 3 instruction-tuned variant while being optimized for performance on MLX-compatible hardware through quantization.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...

gemma-3-27b-it-4bit

Run locally Apple devices with Mirai

Type

Local

From

Google

Quantisation

uint4

Precision

float16

Size

27B

Source

Hugging Face Logo

This model is a 4-bit quantized version of Google's Gemma 3 27B instruction-tuned model, converted to MLX format for efficient inference on Apple Silicon. It is a multimodal model capable of processing both images and text, allowing it to answer questions about images and perform vision-language tasks. The model maintains the capabilities of the original Gemma 3 instruction-tuned variant while being optimized for performance on MLX-compatible hardware through quantization.

1
Choose framework
2
Run the following command to install Mirai SDK
SPMhttps://github.com/trymirai/uzu-swift
3
Set Mirai API keyGet API Key
4
Apply code
Loading...