Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

gemma4_unified_assistant

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25

Base only

Active filters: gemma4_unified_assistant

google/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated 3 days ago • 10.9k • 64

google/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated 1 day ago • 108 • 7

mlx-community/gemma-4-12B-it-assistant-bf16

Any-to-Any • 0.4B • Updated 3 days ago • 2.5k • 3

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated 3 days ago • 135 • 2

mlx-community/gemma-4-12B-it-assistant-4bit

Any-to-Any • 66.1M • Updated 3 days ago • 1.42k • 1

Frniez/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated about 7 hours ago • 1

mlx-community/gemma-4-12B-it-assistant-5bit

Any-to-Any • 79.3M • Updated 3 days ago • 213

mlx-community/gemma-4-12B-it-assistant-6bit

Any-to-Any • 92.5M • Updated 3 days ago • 331

mlx-community/gemma-4-12B-it-assistant-8bit

Any-to-Any • 0.1B • Updated 3 days ago • 868

mlx-community/gemma-4-12B-it-assistant-nvfp4

Any-to-Any • 0.1B • Updated 3 days ago • 300

mlx-community/gemma-4-12B-it-assistant-mxfp4

Any-to-Any • 79.3M • Updated 3 days ago • 383

mlx-community/gemma-4-12B-it-assistant-mxfp8

Any-to-Any • 0.1B • Updated 3 days ago • 454

agentmish/gemma-4-12B-it-assistant-mlx-bf16

0.4B • Updated 3 days ago • 398

ekryski/gemma-4-12B-it-assistant-mlx-4bit

0.3B • Updated 3 days ago • 638

senapati484/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated 1 day ago • 10

mlx-community/gemma-4-12B-it-qat-assistant-4bit

Text Generation • 66.1M • Updated 1 day ago • 93

mlx-community/gemma-4-12B-it-qat-assistant-5bit

Text Generation • 79.3M • Updated 1 day ago • 34

mlx-community/gemma-4-12B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated 1 day ago • 62

mlx-community/gemma-4-12B-it-qat-assistant-6bit

Text Generation • 92.5M • Updated 1 day ago • 36

mlx-community/gemma-4-12B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated 1 day ago • 37

mlx-community/gemma-4-12B-it-qat-assistant-mxfp4

Text Generation • 79.3M • Updated 1 day ago • 33

mlx-community/gemma-4-12B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated 1 day ago • 41

mlx-community/gemma-4-12B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated 1 day ago • 102

brainworkup/gemma-4-12B-it-assistant-oQ8

0.1B • Updated about 6 hours ago

cwfgpt/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated 15 minutes ago