Instructions to use mradermacher/DeepSeek-R1-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/DeepSeek-R1-i1-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/DeepSeek-R1-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +8 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part1of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part2of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part3of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part4of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part5of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part6of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part7of8 +3 -0
- DeepSeek-R1.i1-IQ4_XS.gguf.part8of8 +3 -0
.gitattributes
CHANGED
|
@@ -92,3 +92,11 @@ DeepSeek-R1.i1-Q6_K.gguf.part09of12 filter=lfs diff=lfs merge=lfs -text
|
|
| 92 |
DeepSeek-R1.i1-Q6_K.gguf.part10of12 filter=lfs diff=lfs merge=lfs -text
|
| 93 |
DeepSeek-R1.i1-Q6_K.gguf.part11of12 filter=lfs diff=lfs merge=lfs -text
|
| 94 |
DeepSeek-R1.i1-Q6_K.gguf.part12of12 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
DeepSeek-R1.i1-Q6_K.gguf.part10of12 filter=lfs diff=lfs merge=lfs -text
|
| 93 |
DeepSeek-R1.i1-Q6_K.gguf.part11of12 filter=lfs diff=lfs merge=lfs -text
|
| 94 |
DeepSeek-R1.i1-Q6_K.gguf.part12of12 filter=lfs diff=lfs merge=lfs -text
|
| 95 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part1of8 filter=lfs diff=lfs merge=lfs -text
|
| 96 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part2of8 filter=lfs diff=lfs merge=lfs -text
|
| 97 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part3of8 filter=lfs diff=lfs merge=lfs -text
|
| 98 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part4of8 filter=lfs diff=lfs merge=lfs -text
|
| 99 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part5of8 filter=lfs diff=lfs merge=lfs -text
|
| 100 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 101 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 102 |
+
DeepSeek-R1.i1-IQ4_XS.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
DeepSeek-R1.i1-IQ4_XS.gguf.part1of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:baf16bb12885ea0321392ab89c13b9c74cfebc697fc676fa68ba6cd2207bb40f
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part2of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a332a48bf123e6a5da272e6228b2e782f1b03df2376ccacbe829425313af0c59
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part3of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:56e28d780278abcb718dbe6abb2cc9b3b17d5eeedfa19ab510bb8174d73cb7c9
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part4of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:03b2e5471d2ba044849cd01e3cfbd8deac167aab58ec64ff7682a3bc01687ff7
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part5of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7513ae63df185378949d3a890a619971e80e41bfa7cc87ce6a9b18e236657a29
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part6of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:11356777cf4f8671e0bb0de7a187d5eb9de0ab7f7ab35b162a3c8d6c59b5ffad
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part7of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e3b7ba5785e293a861f448768473e9d45257a51e986b730117ad703ae36624c
|
| 3 |
+
size 45097156608
|
DeepSeek-R1.i1-IQ4_XS.gguf.part8of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3d06d0604eabf72c1a4cd8ad961e7c8b64b253fa1b39c13e013efd062f752300
|
| 3 |
+
size 41448583808
|