Inference Providers
Active filters: 5-bit
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 110k
• 9
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
• 141B • Updated • 113k
• 77
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
• 12B • Updated • 110k
• 19
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
• 8B • Updated • 238k
• 10
mlx-community/MiniMax-M2.7-5bit
Text Generation
• 229B • Updated • 428
• 1
majentik/MiniMax-M2.7-TurboQuant-MLX-5bit
Text Generation
• 229B • Updated • 840
• 1
mlx-community/Qwen3.6-27B-5bit
Image-Text-to-Text
• 6B • Updated • 1.71k
• 1
AntimatterAI/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-MLX-5bit
Text Generation
• 35B • Updated • 2.18k
• 1
cgs4huggingface/Qwen3.6-27B-MLX-VL-oQ5-fp16
Image-Text-to-Text
• 6B • Updated • 390
• 1
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 6
Text Generation
• 3B • Updated • 352
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.22k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 887
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 964
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 113
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 222
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 143
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 153
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 140
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 129
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 75
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 85
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 172
• 1
MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 492
• 6
MaziyarPanahi/finetuned-mistral-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 102
MaziyarPanahi/Mistral-7B-Instruct-guidance-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 83
MaziyarPanahi/KAI-7B-Instruct-v0.1-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 97
MaziyarPanahi/openbuddy-zephyr-7b-v14.1-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 102
MaziyarPanahi/japanese-stablelm-instruct-gamma-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 190
MaziyarPanahi/mistral-ft-optimized-1227-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 135