Fredithefish commited on
Commit
69a3c98
·
1 Parent(s): 170469a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ tags:
7
+ - mistral
8
+ - merge
9
+ - openchat
10
+ - 7b
11
+ - zephyr
12
+ ---
13
+
14
+ <div align="center">
15
+ <img src="https://huggingface.co/Fredithefish/MadMix-v0.1/resolve/main/logo.jpg" alt="Alt Text" width="450"/>
16
+
17
+ <h1>🔥 MadMix: Merging the top Seven Billion-Parameter Mistral-Based Open Source Models 🔥</h1>
18
+ This Model is a ties merge between various high-quality open-source models, it was done by using the <a>https://github.com/cg123/mergekit</a> repository.<br>
19
+ </div>
20
+ <br><br>
21
+
22
+ # Details
23
+ Due to the apache-2 license, the model is fully commercially usable
24
+ - **Models included in the merge:**
25
+ - [OpenChat_3.5](https://huggingface.co/openchat/openchat_3.5)
26
+ - [MetaMath 7B](https://huggingface.co/meta-math/MetaMath-Mistral-7B)
27
+ - [Zephyr 7B beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
28
+ - [OpenHermes-2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)
29
+ - [Neural-chat 7b v3.1](https://huggingface.co/Intel/neural-chat-7b-v3-1)
30
+ - [Mistral-7B v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) (serving as the base for the merge)
31
+
32
+
33
+ # Evals
34
+ (soon...)