macadeliccc
commited on
Upload folder using huggingface_hub
Browse files
.gitattributes
CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
dolphin-2.9.2-phi-3-medium.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
dolphin-2.9.2-phi-3-medium.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
dolphin-2.9.2-phi-3-medium.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
dolphin-2.9.2-phi-3-medium.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- unsloth/Phi-3-mini-4k-instruct
|
7 |
+
datasets:
|
8 |
+
- cognitivecomputations/Dolphin-2.9.2
|
9 |
+
- teknium/OpenHermes-2.5
|
10 |
+
- m-a-p/CodeFeedback-Filtered-Instruction
|
11 |
+
- cognitivecomputations/dolphin-coder
|
12 |
+
- cognitivecomputations/samantha-data
|
13 |
+
- microsoft/orca-math-word-problems-200k
|
14 |
+
- internlm/Agent-FLAN
|
15 |
+
- cognitivecomputations/SystemChat-2.0
|
16 |
+
---
|
17 |
+
|
18 |
+
# Dolphin 2.9.2 Phi 3 Medium 🐬
|
19 |
+
|
20 |
+
Curated and trained by Eric Hartford, Lucas Atkins, Fernando Fernandes, and with help from the community of Cognitive Computations
|
21 |
+
|
22 |
+
[![Discord](https://img.shields.io/discord/1156064224225808488?logo=Discord&logoColor=%23ffffff&label=Discord&link=https%3A%2F%2Fdiscord.gg%2FtCMkMDDHwm)](https://discord.gg/cognitivecomputations)
|
23 |
+
Discord: https://discord.gg/cognitivecomputations
|
24 |
+
|
25 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
|
26 |
+
|
27 |
+
Our appreciation for the sponsor of Dolphin 2.9.2:
|
28 |
+
- [Crusoe Cloud](https://crusoe.ai/) - provided excellent on-demand 8xL40Snode
|
29 |
+
|
30 |
+
This model is based on Phi-3-Medium-Instruct-4k, and is governed by the MIT license with which Microsoft released Phi-3.
|
31 |
+
|
32 |
+
Since Microsoft only released the fine-tuned model - Dolphin-2.9.2-Phi-3-Medium has not been entirely cleaned of refusals.
|
33 |
+
|
34 |
+
The base model has 4k context, and the qLoRA fine-tuning was with 4k sequence length.
|
35 |
+
|
36 |
+
It took 3.5 days on 8xL40S node provided by Crusoe Cloud
|
37 |
+
|
38 |
+
This model uses the ChatML prompt template.
|
39 |
+
|
40 |
+
example:
|
41 |
+
|
42 |
+
```
|
43 |
+
<|im_start|>system
|
44 |
+
You are Dolphin, a helpful AI assistant.<|im_end|>
|
45 |
+
<|im_start|>user
|
46 |
+
{prompt}<|im_end|>
|
47 |
+
<|im_start|>assistant
|
48 |
+
|
49 |
+
```
|
50 |
+
|
51 |
+
Dolphin-2.9.2 has a variety of instruction, conversational, and coding skills. It also has initial agentic abilities and supports function calling.
|
52 |
+
We have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. Please read my blog post about uncensored models. https://erichartford.com/uncensored-models You are responsible for any content you create using this model. Enjoy responsibly.
|
53 |
+
|
54 |
+
|
55 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/3dLaIlx3pVme2jWEtwbNp.png)
|
56 |
+
|
57 |
+
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
58 |
+
|
59 |
+
## evals:
|
60 |
+
<img src="https://i.ibb.co/jrBsPLY/file-9gw-A1-Ih-SBYU3-PCZ92-ZNb-Vci-P.png" width="600" />
|
dolphin-2.9.2-phi-3-medium.q4_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:94ee11eeb43eedb46dd117dd7d2f6fb290597c651bc6e71a5387b9a2e155fdd5
|
3 |
+
size 8404011648
|
dolphin-2.9.2-phi-3-medium.q5_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ee562b2016444580e6a65cc0dbd569723774952ac01f12afb28a25343dbc5e22
|
3 |
+
size 9882708608
|
dolphin-2.9.2-phi-3-medium.q6_k.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:76b3ff62882bdb6fb7350b422316e528cc979fb5b8a9d41ebf6b592b133e1706
|
3 |
+
size 11453824128
|
dolphin-2.9.2-phi-3-medium.q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:72204cf958ad7644925c2a011f588ecec2b204736fcd98344806999e2209526f
|
3 |
+
size 14834718848
|