---
library_name: mlx
license: apache-2.0
language:
- en
pipeline_tag: text-generation
base_model: zenlm/zen-coder-24b-gguf
tags:
- mlx
- zen
- code
- hanzo
  - zenlm
---

# Zen Coder 24B (MLX)

Optimized MLX quantization of Zen Coder 24B for Apple Silicon.

## Specs

| Property | Value |
|----------|-------|
| Parameters | 24B |
| Format | MLX 4-bit quantized |
| License | Apache 2.0 |
| Developer | Hanzo AI |

## Usage

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("zenlm/zen-coder-24b-mlx")

prompt = "Write a Python function to sort a list"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)
```

## Links

- [Zen LM](https://zenlm.org) | [Hanzo AI](https://hanzo.ai)
- [GGUF Format](https://huggingface.co/zenlm/zen-coder-24b-gguf)
- [All Zen Models](https://huggingface.co/zenlm)