Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

946

Base only

Active filters: 4bit

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 19.8k • 140

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 17 days ago • 13.2k • 57

wang-yang/Agents-A1-MTPLX-Q4

Text Generation • 35B • Updated 1 day ago • 568 • 5

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 17 days ago • 14.3k • 73

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 840 • 38

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 17 days ago • 15.2k • 43

mlx-community/gpt-oss-20b-OptiQ-4bit

Text Generation • 21B • Updated 16 days ago • 1.34k • 5

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 19.2k • 269

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-4bit

Text Generation • 6B • Updated 2 days ago • 485 • 5

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 310 • 3

mlx-community/VibeThinker-3B-OptiQ-4bit

Text Generation • 0.6B • Updated 11 days ago • 215 • 2

mlx-community/Qwopus3.6-35B-A3B-Coder-4bit

Image-Text-to-Text • 6B • Updated 7 days ago • 443 • 2

ecastera/eva-mistral-7b-spanish-GGUF

7B • Updated Jan 29, 2024 • 85 • 10

JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4

Image-to-Text • 3B • Updated Feb 7 • 261 • 3

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 316 • 15

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 17 days ago • 7.82k • 23

NAME0x0/AVA-v2

Text Generation • Updated 25 days ago • 37 • 1

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 227 • 8

mlx-community/Qwen2-Audio-7B-Instruct-4bit

Audio-Text-to-Text • Updated Mar 29 • 242 • 3

livadies/gemma-4-31B-Ghetto-NF4

Image-to-Text • 32B • Updated Apr 3 • 134 • 7

Jiunsong/SuperGemma4-31b-abliterated-mlx-4bit

Text Generation • 31B • Updated Apr 15 • 14.8k • 44

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit

Text Generation • 6B • Updated 2 days ago • 1.94k • 14

AxisQuant/Qwen3.6-27b-gptq-int4

Text Generation • 27B • Updated 4 days ago • 4.53k • 4

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 11 days ago • 25.6k • 37

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 11 days ago • 4.65k • 8

Guess1212/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated 18 days ago • 758 • 1

iamthecage/Qwen3.6-27B-4.2Bit-OptiQ-MTP

Text Generation • 27B • Updated 12 days ago • 349 • 1

mlx-community/mini-coder-4b-OptiQ-4bit

Text Generation • 0.8B • Updated 5 days ago • 264 • 1

h1st0ry3D/Godoter-27B-MLX-4bit

Text Generation • 27B • Updated 4 days ago • 99 • 1

Alennnndy/Qwen3.6-27B-AWQ-4bit

Text Generation • 28B • Updated 3 days ago • 71 • 2