Hugging Face's logo

backyardai
/
Senku-70B-Full-A1-GGUF

PEFT
GGUF
Generated from Trainer
Inference Endpoints
imatrix
conversational
Model card Files Community
brooketh commited on
Commit
e12622a
·
verified ·
1 Parent(s): 6e7355c

Upload Senku-70B-Full-A1-GGUF

Browse files
Files changed (33) hide show
  1. .gitattributes +29 -0
  2. BackyardAI_Banner.png +0 -0
  3. BackyardAI_Logo.png +0 -0
  4. README.md +45 -0
  5. Senku-70B-Full-A1.F32-split-00001-of-00006.gguf +3 -0
  6. Senku-70B-Full-A1.F32-split-00002-of-00006.gguf +3 -0
  7. Senku-70B-Full-A1.F32-split-00003-of-00006.gguf +3 -0
  8. Senku-70B-Full-A1.F32-split-00004-of-00006.gguf +3 -0
  9. Senku-70B-Full-A1.F32-split-00005-of-00006.gguf +3 -0
  10. Senku-70B-Full-A1.F32-split-00006-of-00006.gguf +3 -0
  11. Senku-70B-Full-A1.IQ1_M.gguf +3 -0
  12. Senku-70B-Full-A1.IQ1_S.gguf +3 -0
  13. Senku-70B-Full-A1.IQ2_M.gguf +3 -0
  14. Senku-70B-Full-A1.IQ2_S.gguf +3 -0
  15. Senku-70B-Full-A1.IQ2_XS.gguf +3 -0
  16. Senku-70B-Full-A1.IQ2_XXS.gguf +3 -0
  17. Senku-70B-Full-A1.IQ3_M.gguf +3 -0
  18. Senku-70B-Full-A1.IQ3_S.gguf +3 -0
  19. Senku-70B-Full-A1.IQ3_XS.gguf +3 -0
  20. Senku-70B-Full-A1.IQ3_XXS.gguf +3 -0
  21. Senku-70B-Full-A1.IQ4_XS.gguf +3 -0
  22. Senku-70B-Full-A1.Q3_K_L.gguf +3 -0
  23. Senku-70B-Full-A1.Q3_K_M.gguf +3 -0
  24. Senku-70B-Full-A1.Q3_K_S.gguf +3 -0
  25. Senku-70B-Full-A1.Q4_K_M.gguf +3 -0
  26. Senku-70B-Full-A1.Q4_K_S.gguf +3 -0
  27. Senku-70B-Full-A1.Q5_K_M.gguf +3 -0
  28. Senku-70B-Full-A1.Q5_K_S.gguf +3 -0
  29. Senku-70B-Full-A1.Q6_K-split-00001-of-00002.gguf +3 -0
  30. Senku-70B-Full-A1.Q6_K-split-00002-of-00002.gguf +3 -0
  31. Senku-70B-Full-A1.Q8_0-split-00001-of-00002.gguf +3 -0
  32. Senku-70B-Full-A1.Q8_0-split-00002-of-00002.gguf +3 -0
  33. Senku-70B-Full-A1.imatrix +3 -0
.gitattributes CHANGED
@@ -33,3 +33,32 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Senku-70B-Full-A1.F32-split-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Senku-70B-Full-A1.F32-split-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Senku-70B-Full-A1.F32-split-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Senku-70B-Full-A1.F32-split-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Senku-70B-Full-A1.F32-split-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Senku-70B-Full-A1.F32-split-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Senku-70B-Full-A1.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Senku-70B-Full-A1.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Senku-70B-Full-A1.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Senku-70B-Full-A1.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Senku-70B-Full-A1.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Senku-70B-Full-A1.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Senku-70B-Full-A1.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Senku-70B-Full-A1.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Senku-70B-Full-A1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Senku-70B-Full-A1.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Senku-70B-Full-A1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Senku-70B-Full-A1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Senku-70B-Full-A1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Senku-70B-Full-A1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Senku-70B-Full-A1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Senku-70B-Full-A1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Senku-70B-Full-A1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Senku-70B-Full-A1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Senku-70B-Full-A1.Q6_K-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Senku-70B-Full-A1.Q6_K-split-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Senku-70B-Full-A1.Q8_0-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Senku-70B-Full-A1.Q8_0-split-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Senku-70B-Full-A1.imatrix filter=lfs diff=lfs merge=lfs -text
BackyardAI_Banner.png ADDED
BackyardAI_Logo.png ADDED
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc0-1.0
3
+ library_name: peft
4
+ tags:
5
+ - generated_from_trainer
6
+ base_model: ShinojiResearch/Senku-70B-Full
7
+ datasets:
8
+ - Open-Orca/SlimOrca
9
+ model_name: Senku-70B-Full-A1-GGUF
10
+ quantized_by: brooketh
11
+ parameter_count: 68976648192
12
+ ---
13
+ <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
14
+
15
+ **<p style="text-align: center;">The official library of GGUF format models for use in the local AI chat app, Backyard AI.</p>**
16
+
17
+ <p style="text-align: center;"><a href="https://backyard.ai/">Download Backyard AI here to get started.</a></p>
18
+
19
+ <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
20
+
21
+ ***
22
+ # Senku Full A1 70B
23
+ - **Creator:** [ShinojiResearch](https://huggingface.co/ShinojiResearch/)
24
+ - **Original:** [Senku Full 70B](https://huggingface.co/ShinojiResearch/Senku-70B-Full)
25
+ - **Date Created:** 2024-02-06
26
+ - **Trained Context:** 32764 tokens
27
+ - **Description:** Requanted (2024-06-04) finetune of miqu-70b-sf dequant of miqudev's leak of Mistral-70B (allegedly an early mistral medium). This version, using the ChatML prompt template, achieved an EQ-Bench score of 85.09.
28
+ ***
29
+ ## What is a GGUF?
30
+ GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
31
+ GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.
32
+
33
+ ***
34
+ <img src="BackyardAI_Logo.png" alt="Backyard.ai" style="height: 75px; min-width: 32px; display: block; horizontal align: left;">
35
+
36
+ ## Backyard AI
37
+ - Free, local AI chat application.
38
+ - One-click installation on Mac and PC.
39
+ - Automatically use GPU for maximum speed.
40
+ - Built-in model manager.
41
+ - High-quality character hub.
42
+ - Zero-config desktop-to-mobile tethering.
43
+ Backyard AI makes it easy to start chatting with AI using your own characters or one of the many found in the built-in character hub. The model manager helps you find the latest and greatest models without worrying about whether it's the correct format. Backyard AI supports advanced features such as lorebooks, author's note, text formatting, custom context size, sampler settings, grammars, local TTS, cloud inference, and tethering, all implemented in a way that is straightforward and reliable.
44
+ **Join us on [Discord](https://discord.gg/SyNN2vC9tQ)**
45
+ ***
Senku-70B-Full-A1.F32-split-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e196777c1c8da3dd52f58c8fcfc128a3dc0b7462091b48c5db49e2682d1f7d1f
3
+ size 49905511456
Senku-70B-Full-A1.F32-split-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8d2a977f9a848c911dcfa3a28fbd8ae28c81efdca0c75a89e6540a682bdba49
3
+ size 49829289696
Senku-70B-Full-A1.F32-split-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b33a993e9d04ee4a0297e0ed8a2f2201d95149e57bae9525e43544fdf3faf82f
3
+ size 49426636576
Senku-70B-Full-A1.F32-split-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eea62cefab5b7b5a195ed1f806f977fd597cd2b210345035b0ce92d5832ccc50
3
+ size 49829289696
Senku-70B-Full-A1.F32-split-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bfd9d809078e87bff8546be4c0e5a453b71aaf47e1fdfad9381b85b086d5316
3
+ size 49997029280
Senku-70B-Full-A1.F32-split-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:604012723824c05564974ee9dfccb4571c70a352a5c410b7f4662dbc53d1e6a7
3
+ size 26919604416
Senku-70B-Full-A1.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e28ef9241043ff310d178ef5a95442a45971ac173ba146b14b2add0e5584d712
3
+ size 15943251776
Senku-70B-Full-A1.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8948d3e15080eac784153681b7bc2d324d66c1d06e09cb37b45e57348676692e
3
+ size 14535538496
Senku-70B-Full-A1.IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5e35740d201f743d838955b7dbbe4734ab09ef9fd9ed0e107fbac025109f8ac
3
+ size 23231264576
Senku-70B-Full-A1.IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:613af4c43f955f0673d7df5dc5d0a22abba0e9eefa2c36f56cf627292d947153
3
+ size 21354313536
Senku-70B-Full-A1.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dac0add5c8b0aaf6fe56406929cc843ebea73c6e996747a1a8fe1dec7b7605c9
3
+ size 20334163776
Senku-70B-Full-A1.IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d513165b9adccd907df4c7c6620035905a6b8bc65d869d2fd838a7f1764a3fb
3
+ size 18289440576
Senku-70B-Full-A1.IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:952212bff21892fe88977847156feed314a70f3e64119d7586c379c199ccf036
3
+ size 30944278336
Senku-70B-Full-A1.IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad840a7170c1fe1c28cc4652b78963d1a9d992b97722ddfef603d1e234a29816
3
+ size 29919295296
Senku-70B-Full-A1.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b11b7b58cc81f7c88d6137901d1f88b79f7efbe76744390b3d0ff41002afc3d
3
+ size 28314974016
Senku-70B-Full-A1.IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac38cca8f9ea14b33f91c1eb3d26f93212f600b06aa5e4245be04abd3a27220e
3
+ size 26581464896
Senku-70B-Full-A1.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5853b51805aee5ee6bc42a53cc6b98669374763a4e27503ba69b657f5b3e3c9
3
+ size 36829820736
Senku-70B-Full-A1.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4f9ca5f47fc6cf8decdd0f72f717725c41b8193b339fc0a618c954e9dbacf13
3
+ size 36147836512
Senku-70B-Full-A1.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2db0058fcb1819b9c01edc110d1885d32f9d87e6b95f817cfe6fe1f6d8fdb956
3
+ size 33274738272
Senku-70B-Full-A1.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5280d29c40275353396126a938b924d0eee2676cdef9da6e3f02b9afc44ce90
3
+ size 29919295072
Senku-70B-Full-A1.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:788624c956a45efe33c7273b640b1fefb7030c55ae820ca60a085dab8f2854b5
3
+ size 41422911072
Senku-70B-Full-A1.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:020ddb5e30921edf13d02673933d2ae370a0ce8a3428209e7c2386d1f0d132f6
3
+ size 39249737312
Senku-70B-Full-A1.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daeb6ff1c2deadad7a83aa7de49304d8f2399e8a92d23d61c6a3601cd849e71c
3
+ size 48753768032
Senku-70B-Full-A1.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bd7d9f61fbca7f36af95185af789249a12fafefe493f4e8795c49d871d9e31d
3
+ size 47461398112
Senku-70B-Full-A1.Q6_K-split-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eda015432070296dd8d5eb0011bd09e6d650f3645fc554ae142a51d899272c48
3
+ size 49992753920
Senku-70B-Full-A1.Q6_K-split-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b3721cd3ce7d2efc1ef3f94b96a8a4500e101a66a4989f7ca8e4d0bb74f0e6c
3
+ size 6594614336
Senku-70B-Full-A1.Q8_0-split-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3184e686230394aff5de586e301582887430b9ed2713db94610f66118b7cbb16
3
+ size 49874206816
Senku-70B-Full-A1.Q8_0-split-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fb22b3eda8f3aac3deabf876a9368b466bff7b65a29c50993994c0dc899d16d
3
+ size 23418124000
Senku-70B-Full-A1.imatrix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7221c582f750df725936a20b1b81766fe7b711cb21cbd52e1bb94cad89c02124
3
+ size 24922281