Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,639

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 1 day ago • 23 • • 495

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 1 day ago • 513 • 282

Cactus-Compute/needle

30.4M • Updated 3 days ago • 571 • 237

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 378k • 952

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 1 day ago • 6 • 73

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 1 day ago • 23 • 67

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 27.2k • 200

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 12.5k • 747

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 16.2k • 116

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 60.9k • 879

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 2.46k • 32

AutoArk-AI/Audio8-ASR-0.1B-iOS-ANE

Automatic Speech Recognition • Updated 1 day ago • 58 • 6

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 1.49k • 82

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 7.9k • 116

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 2.09k • 24

openbmb/MiniCPM5-1B-Base

Text Generation • 1B • Updated May 25 • 5.31k • 9

litert-community/FLUX.2-klein-4B-LiteRT

Text-to-Image • Updated 5 days ago • 735 • 4

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated 4 days ago • 52 • 4

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 5.92k • 79

Abdalrahman/needle-rs-safetensors

Text Generation • Updated May 18 • 10 • 5

Abiray/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 28 • 4.96k • 43

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated 20 days ago • 182 • 10

theabbie/needle-pi-coding-agent

Text Generation • Updated 3 days ago • 239 • 3

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 6.72k • 224

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 8.8k • 52

typomonster/supergemma4-e4b-abliterated-litert-lm

Text Generation • Updated Apr 24 • 716 • 14

younissk/nanoBeard-frigate-360M-GGUF

Text Generation • 0.4B • Updated Jun 1 • 957 • 4

wenshutang/ternlight

Sentence Similarity • Updated 7 days ago • 5

audarai/Audar-TTS-V1-Flash

Text-to-Speech • 0.6B • Updated 9 days ago • 252 • 4

PleIAs/Pleias-SLM-RAG

Text Generation • 0.3B • Updated 8 days ago • 79 • 3