Text Classification
MLX
Safetensors
gemma4
decision-model
typed-decisions
optiq
gemma-4
apple-silicon
Eval Results
4-bit precision
Instructions to use mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision --local-dir gemma-4-e2b-it-OptiQ-4bit-decision
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download kv_config.json from mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision: direct link, hf CLI and curl.
- Browser
- Download file 982 Bytes
-
https://huggingface.co/mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision/resolve/main/kv_config.json
- Command line
-
hf download hf://mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision/kv_config.json
-
curl -L -o kv_config.json https://huggingface.co/mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision/resolve/main/kv_config.json
982 Bytes
| [ | |
| { | |
| "layer_idx": 0, | |
| "bits": 8, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 1, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 2, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 3, | |
| "bits": 8, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 4, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 5, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 6, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 7, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 8, | |
| "bits": 8, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 9, | |
| "bits": 8, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 10, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 11, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 12, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 13, | |
| "bits": 4, | |
| "group_size": 64 | |
| }, | |
| { | |
| "layer_idx": 14, | |
| "bits": 4, | |
| "group_size": 64 | |
| } | |
| ] |