Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,190

Base only

Active filters: llama-cpp

LegoKeeper/Qwen3-4b-Moe-Q4_K_M-GGUF

4B • Updated Feb 8 • 74 • 1

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated Apr 15 • 70.7k • 15

jinaai/jina-embeddings-v5-text-nano-classification

Text Classification • 0.2B • Updated Apr 15 • 2.09k • 10

DreadPoor/HERETICAL_IRIX-12B-Q4_K_M-GGUF

12B • Updated Feb 10 • 42 • 1

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 23 days ago • 45.1k • 26

jinaai/jina-embeddings-v5-text-nano-text-matching-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 364 • 2

sai237/llama-3.1-8B-ascii-cats-lora-F32-GGUF

24.3M • Updated Feb 22 • 34 • 1

LocoreMind/LocoOperator-4B-GGUF

4B • Updated Feb 24 • 3.1k • 15

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 1.27k • 8

forkjoin-ai/qwen2-audio-7b-instruct-gguf

Text-to-Audio • 8B • Updated 22 days ago • 1.7k • 2

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 7.69k • 10

cahlen/qwen3.5-35b-a3b-compacted-GGUF

23B • Updated Mar 28 • 225 • 1

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 981 • 6

WithinUsAI/Llama3.2-Octo.Thinker.iNano-1B-GGUF

Text Generation • 1B • Updated Mar 30 • 96 • 1

Blackeye6941/Emotional-assistant_tinyllama-Q4_K_M-GGUF

1B • Updated 1 day ago • 30 • 1

mudler/Qwen3.5-35B-A3B-APEX-GGUF

Text Generation • 35B • Updated Apr 27 • 17.3k • 92

majentik/gemma-4-E4B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 8B • Updated May 6 • 285 • 2

majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS

Text Generation • 4B • Updated May 6 • 27 • 1

0xSero/GLM-5.1-555B-GGUF

Text Generation • 563B • Updated May 30 • 146 • 7

ermiaazarkhalili/Qwen3.5-0.8B-SFT-Claude-Opus-Reasoning-GGUF

Text Generation • 0.8B • Updated Apr 18 • 108 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated May 6 • 64 • 1

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 20

jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF

Feature Extraction • 0.6B • Updated May 12 • 1.27k • 5

Youssofal/Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF

Text Generation • 27B • Updated Apr 30 • 9.16k • 24

Vikkyv9/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Apr 24 • 74 • 1

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 10.9k • 11

pet3art/Llama-3.1-8B-czech-legal-Q4_K_M-GGUF

8B • Updated Apr 27 • 63 • 1

pet3art/Llama-3.1-8B-czech-legal-Q8_0-GGUF

8B • Updated Apr 27 • 31 • 1

GestaltLabs/Ornstein-Hermes-3.6-27B-SABER-GGUF

Text Generation • 27B • Updated Apr 28 • 270 • 19

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 1.63k • 5