This is Llama 3.2 3B Instruct converted to MLX format with 4-bit quantization. Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model is designed for instruction-following tasks and can be used for text generation. This particular version has been optimized for use with MLX, a machine learning framework designed for Apple Silicon, making it suitable for efficient inference on compatible hardware.
This is Llama 3.2 3B Instruct converted to MLX format with 4-bit quantization. Llama 3.2 is a foundational large language model developed by Meta that supports multiple languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. The model is designed for instruction-following tasks and can be used for text generation. This particular version has been optimized for use with MLX, a machine learning framework designed for Apple Silicon, making it suitable for efficient inference on compatible hardware.