Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

132

Base only

Active filters: local-llm

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated 2 days ago • 7.13k • 24

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated 7 days ago • 1.77k • 27

neuralcrew/neutrino-instruct

Text Generation • 7B • Updated May 4 • 12.7k • 7

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated May 3 • 27.2k • 76

Surpem/Supertron2.1-0.6B-GGUF

Text Generation • 0.6B • Updated 11 days ago • 353 • 3

squishai/gemma-3-1b-it-bf16-squished

0.2B • Updated 4 days ago • 91 • 1

squishai/gemma-3-4b-it-bf16-squished

0.7B • Updated 4 days ago • 151 • 1

squishai/Qwen3-0.6B-bf16-squished

93.2M • Updated 4 days ago • 147 • 2

McaTech/Nonet

Text Generation • 0.1B • Updated Jun 30, 2025 • 263 • 3

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 30

umar141/gemma-3-Baro-finetune-v2-gguf

4B • Updated Apr 13, 2025 • 7 • 1

umar141/gemma-3-Baro-finetune-v3-gguf

4B • Updated Apr 17, 2025 • 56

dwili/gemma3-1b-ringkasan-bahasa-indo-gguf

1.0B • Updated Jun 29, 2025 • 19 • 1

Hussain2050/GGUF-Loader

shiv1119/ollama-model-shiv

Text Generation • Updated Jul 23, 2025

hedachi/LLM_Battle

Updated Aug 18, 2025 • 6

gpsworld/gpsworld

Text Generation • 3B • Updated Sep 2, 2025 • 1

Manojb/Qwen3-4B-toolcalling-gguf-codex

Text Generation • 4B • Updated Sep 21, 2025 • 6.45k • 53

Manojb/Qwen-7B-toolcalling-ReSearch-gguf-Q8_0-codex

Text Generation • 8B • Updated Sep 21, 2025 • 310 • 2

Manojb/Qwen3-4b-toolcall-gguf-llamacpp-codex

Text Generation • 4B • Updated Sep 25, 2025 • 918 • 7

Daizee/Luna-Gemma3-4b-GGUFs

4B • Updated Oct 27, 2025 • 36

AndriLawrence/Qwen-3B-Intent-Microplan-v1

Text Generation • 3B • Updated Nov 5, 2025 • 224

mradermacher/Qwen-3B-Intent-Microplan-v1-GGUF

3B • Updated Nov 3, 2025 • 336

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 11

distil-labs/Distil-Localdoc-Qwen3-0.6B

Text Generation • 0.6B • Updated Dec 21, 2025 • 8 • 2

Toadaid/tobyworld-mirror-q4km-gguf

Text Generation • 7B • Updated Dec 1, 2025 • 14 • 3

Toadaid/Tobyworld_Mirror_Llama_8B-Q4_K_M.gguf

Text Generation • 8B • Updated Dec 4, 2025 • 4

LiteMind/YutaLM-GGUF

Text Generation • 0.4B • Updated Dec 28, 2025 • 87 • 3

Toadaid/tobyworld-mirror-v2

Text Generation • 7B • Updated Jan 6 • 18 • 1

Irfanuruchi/Phi-4-mini-instruct-MLX-4bit

Text Generation • 0.6B • Updated Jan 17 • 18