Hugging Face's logo

Chainbase-Labs
/
Theia-Llama-3.1-8B-v1-GGUF

Text Generation
Transformers
GGUF
Inference Endpoints
conversational
Model card Files Community
chainbase commited on
Commit
a741030
·
verified ·
1 Parent(s): 697c25a

Upload weights

Browse files
Files changed (8) hide show
  1. Theia-Llama-3.1-8B-v1-q2_k.gguf +3 -0
  2. Theia-Llama-3.1-8B-v1-q3_k_m.gguf +3 -0
  3. Theia-Llama-3.1-8B-v1-q4_0.gguf +3 -0
  4. Theia-Llama-3.1-8B-v1-q4_k_m.gguf +3 -0
  5. Theia-Llama-3.1-8B-v1-q5_0.gguf +3 -0
  6. Theia-Llama-3.1-8B-v1-q5_k_m.gguf +3 -0
  7. Theia-Llama-3.1-8B-v1-q6_k.gguf +3 -0
  8. Theia-Llama-3.1-8B-v1-q8_0.gguf +3 -0
Theia-Llama-3.1-8B-v1-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73c34b9dabed191bb184dbf633631434eed0ed242e3fb71307619ed13a589a6d
3
+ size 3179132192
Theia-Llama-3.1-8B-v1-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6454dc847e90806b40d83d3053f86f1b15e05b94e8e213a1edafb314031ff48b
3
+ size 4018918688
Theia-Llama-3.1-8B-v1-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76a4bb2ef4a28f3109dfaf996aa92ce35bd1a3d340b279d40aa955c195f795ed
3
+ size 4661212448
Theia-Llama-3.1-8B-v1-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35d0c57d1ca8c2296da8af8cf044f0c30f381fd1223551b4882849be0d0124e4
3
+ size 4920735008
Theia-Llama-3.1-8B-v1-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:988e9b53f4235da7fbf17c52c090b9f2aec8f746e3a103000225d4e64f735be5
3
+ size 5599294752
Theia-Llama-3.1-8B-v1-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:726693559cc7baf1e630d5fb12cfccfaca95df06cfb477ba8ea6cb565a514358
3
+ size 5732988192
Theia-Llama-3.1-8B-v1-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:018ba6d154fdcb9e197aa4d494bb69f2d70bbb750b7ec7d23a1abddf08f74918
3
+ size 6596007200
Theia-Llama-3.1-8B-v1-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72fdcdbceaf990056e8808869e94b0c0064fc3657d88a999e0db3db5d4be24b0
3
+ size 8540771616