Hugging Face's logo

mradermacher
/
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill-i1-GGUF

Transformers
GGUF
English
text-generation-inference
unsloth
qwen3
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
ec3890e
·
verified ·
1 Parent(s): 82c3d21

uploaded from leia

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_M.gguf +3 -0
  3. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_S.gguf +3 -0
  4. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_M.gguf +3 -0
  5. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_S.gguf +3 -0
  6. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XS.gguf +3 -0
  7. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XXS.gguf +3 -0
  8. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_M.gguf +3 -0
  9. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_S.gguf +3 -0
  10. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XS.gguf +3 -0
  11. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XXS.gguf +3 -0
  12. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_NL.gguf +3 -0
  13. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_XS.gguf +3 -0
  14. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K.gguf +3 -0
  15. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K_S.gguf +3 -0
  16. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_L.gguf +3 -0
  17. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_M.gguf +3 -0
  18. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_S.gguf +3 -0
  19. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_0.gguf +3 -0
  20. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_1.gguf +3 -0
  21. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_M.gguf +3 -0
  22. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_S.gguf +3 -0
  23. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_M.gguf +3 -0
  24. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_S.gguf +3 -0
  25. Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41dd48d732680281f88c5f4dd0b3faf2a928b064eb9917684eea668dfb8a0f62
3
+ size 1127018880
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa4a3bea935b38a593057d054cb2691f4f407635aabf33ce3795036e1ee38d05
3
+ size 1055256960
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4a8aabc365983bea88b7ec1f216f4e12080e46d805e88cd25aa9cf08dff77be
3
+ size 1512984960
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20af8b95ac3c6da68b1c3d82baef65995d23a33f9b3257211ca28eff9e8756be
3
+ size 1417302400
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5d8e067e54a400f648eb6cbcfea0fbec7267a33323df746312f07352888f6bd
3
+ size 1354101120
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94f210e83cdaaaf890f5b33791edb4f90fc41ce6c9e117982833e7b29dba2ff8
3
+ size 1246622080
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e667d9f8e71b7bd420d153eb947f6a979a153d51a9a719e12c29489098b6ffe
3
+ size 1962897280
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ae724d54dc4a2a6eeff1f2d31633d995330ecda03264abcf16d5c6ca49ff267
3
+ size 1899532160
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aa2f614d15c05d2d64ede384650af36aa2d8bf5e5586d3fff17e8cf2a7267f3
3
+ size 1814376320
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9edf23803809c8c7ffbf5fd3470362e0751c9e9424191db2d8874fb9478a8814
3
+ size 1670189440
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5710f6ba062cb1edd891cae2ee8f091cb6f766f73937d43efbbf9c30f61ec69
3
+ size 2381344640
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eaa1d63aab3b15944cc5b8922893d97aa582b7d6e0e6a948aa8d3a87e492e1f5
3
+ size 2270752640
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcc5480114e6290f15f6040848237f9252cdf0c599196d24ff4d766a83b355aa
3
+ size 1669500800
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9915cf7ca658c43ed76a0e03c67a78ff38acbfbe68c11d8451daa8e6d0e0a1dd
3
+ size 1563455360
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6855fe02f6d65cb00226bb6f2e1c159efc8e531e49d7be29c6747dbc3519aa8
3
+ size 2239786880
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abf1ae279ee15b19f8f1d085d44e629cdfd89fb22d6cb7254f171f8e3065090c
3
+ size 2075619200
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:649e4146803abc4c082f78a06bdd464c9282254e02938b6d52436aaac5d34bff
3
+ size 1886998400
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aed589b75f408f18e0650708f08d5318fb1639ed6d25b6fec510e88fa8efe176
3
+ size 2375774080
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eeb76f0723c23d283410ca8d8ac5dfe6257e27ad19bc0a90953bdd9766f1843
3
+ size 2596630400
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d0c21cbab3395c7787c78cbc18de81047daf50a9f78c29c8b7236c69c1972c9
3
+ size 2497281920
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d3cd314b19e5d3a32d09522c7e84051ccc9de68bd8e8f946fd4a596157b4aa4
3
+ size 2383310720
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf3f4e14b118afde374246ef58b1026dc43491d4b0c266e24c655e47c5615c55
3
+ size 2889514880
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e7fea32d127cba657c794ff07335d025d14ac9a28704155f439308bdd596f4a
3
+ size 2823712640
Qwen3-4B-Thinking-2507-Claude-4.5-Opus-High-Reasoning-Distill.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e485af2797733bc1f86b719ae00d830db430677e35903875d6230bba72e1d91d
3
+ size 3306262400