Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48

Base only

Active filters: q4_k

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated Aug 3 • 376k • 215

vmlinux/Qwen3.8-Flash-Next-Uncensored-Gufo-Q4Mix-GGUF

Image-Text-to-Text • 177B • Updated 3 days ago • 2.26k • 5

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 198k • 144

soyaakinohara/qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf

Text Generation • 27B • Updated 15 days ago • 45.7k • 111

soyaakinohara/Qwen-3.8-flash-next-heretic-3.78bpw-gguf

Image-Text-to-Text • 177B • Updated 15 days ago • 3.89k • 7

Edmon02/deepseek-coder-7b-instruct-v1.5-GGUF

Text Generation • 7B • Updated Jun 4 • 1.02k

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 20

ko88201/ggml-breeze-asr-26-q4_k

Automatic Speech Recognition • Updated Apr 20

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated Aug 31 • 1.49M • 477

opensota/deepseek-v4-gguf

Text Generation • 284B • Updated May 12 • 110 • 2

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 284B • Updated May 13 • 207 • 5

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 182 • 2

transformerlab/ideogram-4-gguf-q4_k

Text-to-Image • 19B • Updated Jun 9 • 97 • 10

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 139 • 2

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated Jun 22 • 268

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated Aug 2 • 697 • 2

cloudyu/DeepSeek-V4-Flash-4Expert-GGUF

Text Generation • 284B • Updated Jul 1 • 107 • 1

eadx/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 5 • 98

wangyanwei123/deepseek-v4-gguf

Text Generation • 284B • Updated Jul 7 • 145

windy88/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 8 • 70

w3ss/ideogram-4-gguf-q4_k

Text-to-Image • 19B • Updated Jul 18 • 17

badgame/qwen-image-edit-gguf

Image-to-Image • 20B • Updated Jul 20 • 1.12k

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated Aug 1 • 312 • 25

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated Aug 1 • 177 • 10

DeepDavid/Qwen3.6-35B-A3B-qcache-q4k

34B • Updated Aug 5 • 95

GrEarl/Kimi-K3-Abliterated-V1-Q2_K-GGUF

Text Generation • 2.8T • Updated Aug 4 • 104 • 9

DeepDavid/gemma-4-31b-it-qcache-q4k

31B • Updated Aug 5 • 25

DeepDavid/gemma-4-26b-a4b-it-qcache-q4k

25B • Updated Aug 5 • 43

DeepDavid/Qwen3.6-27B-qcache-q4k

26B • Updated Aug 5 • 34

Rattende/Qwen-3.6-27B

Text Generation • 27B • Updated Aug 8 • 34