Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,570

Base only

Active filters: 2-bit

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

deucebucket/Qwen3.6-27B-Osmosis-Q2_K-GGUF

Text Generation • Updated Apr 30 • 283 • 2

ParetoQaft/1B-Instruct-Tulu-LoRA-2bit

1B • Updated Apr 29 • 3

ParetoQaft/1B-Instruct-Tulu-simplel4q-2bit

1B • Updated Apr 29 • 3

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-2Bit

Text Generation • 27B • Updated 24 days ago • 10.2k • 5

LuciaValentine/hiyori_gemma4_26b_a4b_exllama3_gemma-4_exllama3_2.0bpw

5B • Updated May 2 • 16

jesusoctavioas/Qwen3.6-27B-mlx-2Bit

Image-Text-to-Text • 27B • Updated May 1 • 407

firedancer/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated May 2 • 461

manjunathshiva/gpt-oss-120b-tq3a-tq2e-g32

Text Generation • 117B • Updated 28 days ago • 677

LuciaValentine/hiyori_gemma4_31b_exllama3_gemma-4_exllama3_2.0bpw

6B • Updated May 3 • 8

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit

Text Generation • 4B • Updated May 6 • 212

avneetsb/NVIDIA-Nemotron-3-Nano-4B-oQ2-fp16

0.4B • Updated May 5 • 44

avneetsb/Qwen3.5-9B-oQ2-fp16

1B • Updated May 5 • 40

chopraanmol1/Qwen3.6-35B-A3B-mlx-2Bit

Image-Text-to-Text • 35B • Updated May 5 • 142

chopraanmol1/Qwen3.6-27B-mlx-2Bit

Image-Text-to-Text • 27B • Updated May 5 • 247

culturerevolt/Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-Uncensored-mlx-2Bit

Text Generation • 34B • Updated May 6 • 381

avneetsb/Qwen3.5-2B-oQ2-fp16

0.5B • Updated May 6 • 17

shawon/Qwen3.6-35B-A3B-mlx-2Bit

Image-Text-to-Text • 35B • Updated 3 days ago • 424

avneetsb/Qwen3.5-4B-oQ2-fp16

0.8B • Updated May 6 • 16

tritesh/gemma-4-31B-it-mlx-2Bit

Image-Text-to-Text • 31B • Updated about 1 month ago • 100

harishkumar12k/gemma-4-E2B-it-mlx-2Bit

Any-to-Any • 0.4B • Updated about 1 month ago • 108

welcoma/Ternary-Bonsai-1.7B-bonsai_tq_f32-MLC

Text Generation • Updated about 1 month ago • 11

welcoma/Ternary-Bonsai-4B-bonsai_tq_f32-MLC

Text Generation • Updated about 1 month ago • 14

welcoma/Ternary-Bonsai-8B-bonsai_tq_f32-MLC

Text Generation • Updated about 1 month ago • 12

fcobos/Qwen3.6-35B-A3B-oQ2-mtp

4B • Updated about 1 month ago • 553

fcobos/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ2-mtp

4B • Updated about 1 month ago • 1.5k

zaydiscold/Qwen2.5-7B-Instruct-MLX-2bit

0.7B • Updated 30 days ago • 51

jinreiyu/Bonsai-REDUX2-MLX-2bit-pure

Text Generation • 0.6B • Updated 22 days ago • 377

Jackrong/Negentropy-claude-opus-4.7-9B-2bit

Text Generation • 0.8B • Updated 30 days ago • 388

LuciaValentine/origin_gemma3_27b_exllama3_2.0bpw

Image-Text-to-Text • 6B • Updated 29 days ago • 7