Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
| Model | MT Bench | EQ Bench | MMLU | Logic Test |
|
| 2 |
+
|----------------------|----------|----------|---------|-------------|
|
| 3 |
+
| GPT-4-Turbo | 9.32 | - | - | - |
|
| 4 |
+
| GPT-4 | 8.99 | 62.52 | 86.4 | 0.86 |
|
| 5 |
+
| **Kunoichi-DPO-v2-7B** | **8.51** | **42.18** | - | **-** |
|
| 6 |
+
| **Kunoichi-DPO-7B** | **8.29** | **41.60** | - | **0.59** |
|
| 7 |
+
| **Kunoichi-7B** | **8.14** | **44.32** | **64.9** | **0.58** |
|
| 8 |
+
| Starling-7B | 8.09 | - | 63.9 | 0.51 |
|
| 9 |
+
| Claude-2 | 8.06 | 52.14 | 78.5 | - |
|
| 10 |
+
| Silicon-Maid-7B | 7.96 | 40.44 | 64.7 | 0.54 |
|
| 11 |
+
| Loyal-Macaroni-Maid-7B | 7.95 | 38.66 | 64.9 | 0.57 |
|
| 12 |
+
| GPT-3.5-Turbo | 7.94 | 50.28 | 70 | 0.57 |
|
| 13 |
+
| Claude-1 | 7.9 | - | 77 | - |
|
| 14 |
+
| Openchat-3.5 | 7.81 | 37.08 | 64.3 | 0.39 |
|
| 15 |
+
| Dolphin-2.6-DPO | 7.74 | 42.88 | 61.9 | 0.53 |
|
| 16 |
+
| Zephyr-7B-beta | 7.34 | 38.71 | 61.4 | 0.30 |
|
| 17 |
+
| Llama-2-70b-chat-hf | 6.86 | 51.56 | 63 | - |
|
| 18 |
+
| Neural-chat-7b-v3-1 | 6.84 | 43.61 | 62.4 | 0.30 |
|
| 19 |
+
|
| 20 |
+
| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|
| 21 |
+
|---|---:|---:|---:|---:|---:|
|
| 22 |
+
| **Kunoichi-DPO-7B**|**58.4**| 45.08 | 74| 66.99| 47.52|
|
| 23 |
+
| [Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B)|57.54| 44.99| 74.86| 63.72| 46.58|
|
| 24 |
+
| [OpenPipe/mistral-ft-optimized-1218](https://huggingface.co/OpenPipe/mistral-ft-optimized-1218)| 56.85 | 44.74 | 75.6 | 59.89 | 47.17 |
|
| 25 |
+
| [Silicon-Maid-7B](https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B) | 56.45| 44.74| 74.26| 61.5| 45.32|
|
| 26 |
+
| [mlabonne/NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B) | 53.51 | 43.67 | 73.24 | 55.37 | 41.76 |
|
| 27 |
+
| [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) | 52.42 | 42.75 | 72.99 | 52.99 | 40.94 |
|
| 28 |
+
| [openchat/openchat_3.5](https://huggingface.co/openchat/openchat_3.5) | 51.34 | 42.67 | 72.92 | 47.27 | 42.51 |
|
| 29 |
+
| [berkeley-nest/Starling-LM-7B-alpha](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha) | 51.16 | 42.06 | 72.72 | 47.33 | 42.53 |
|
| 30 |
+
| [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) | 50.99 | 37.33 | 71.83 | 55.1 | 39.7 |
|