Update README.md
Browse files
README.md
CHANGED
@@ -1,21 +1,22 @@
|
|
1 |
---
|
2 |
-
base_model:
|
3 |
tags:
|
4 |
- Llama-3
|
5 |
- instruct
|
6 |
- finetune
|
7 |
- chatml
|
8 |
- axolotl
|
|
|
9 |
license: apache-2.0
|
10 |
language:
|
11 |
- en
|
12 |
---
|
13 |
![image/png](Pantheon.png)
|
14 |
# Pantheon-RP-8b-Llama-3
|
15 |
-
Pantheon Roleplay is a model that has been in the making for
|
16 |
|
17 |
## Model details
|
18 |
-
This model features a diverse collection of datasets, totaling ~
|
19 |
|
20 |
- For general instructions I created GPT 4 and Claude Opus variations of the No-Robots dataset. I actually ended up not including NoRo itself as it made the model worse.
|
21 |
- For roleplay I used an extensive collection of GPT 4 and Claude Opus data, augmented by the always popular LimaRP for the "human factor".
|
@@ -38,14 +39,20 @@ I use the following settings for inference:
|
|
38 |
```
|
39 |
Besides the basic instructional sets all other datasets were trained with character names added. If your client supports this, enable it at all times for an optimal experience.
|
40 |
|
|
|
|
|
41 |
### Roleplay
|
42 |
|
43 |
-
The majority of the roleplaying data in this model uses an asterisk action, no quote for speech style as that seems to be the norm nowadays.
|
|
|
|
|
44 |
|
45 |
### Aiva the Assistant
|
46 |
|
47 |
**System Prompt:** `You are a caring and empathetic sentient AI companion named Aiva.`
|
48 |
-
Aiva is a distinct mixture of instructional and roleplay data - There's really little she can't do at this point. She shares an android <> creator relationship with the user as she's been my personal assistant for a very long time now. I hope you like her!
|
|
|
|
|
49 |
|
50 |
### Personas
|
51 |
|
@@ -98,6 +105,7 @@ Aiva:
|
|
98 |
- Everyone from [MinervaAI](https://huggingface.co/MinervaAI)! Hi, guys!
|
99 |
- Huge, huge thanks to [kubernetes_bad](https://huggingface.co/kubernetes-bad) for the compute that made my hundreds of experiments possible!
|
100 |
- All the folks I chat with on a daily basis on Discord! You know who you are.
|
|
|
101 |
|
102 |
## Finally
|
103 |
If you've read this far I encourage you to give this model a serious try and leave feedback! I'd love to see what people think of my first true base model.
|
|
|
1 |
---
|
2 |
+
base_model: meta-llama/Meta-Llama-3-8B
|
3 |
tags:
|
4 |
- Llama-3
|
5 |
- instruct
|
6 |
- finetune
|
7 |
- chatml
|
8 |
- axolotl
|
9 |
+
- roleplay
|
10 |
license: apache-2.0
|
11 |
language:
|
12 |
- en
|
13 |
---
|
14 |
![image/png](Pantheon.png)
|
15 |
# Pantheon-RP-8b-Llama-3
|
16 |
+
Pantheon Roleplay is a model that has been in the making for the past six months or so, starting from a collection of personas but steadily having grown into a full-fledged roleplaying model that simultaneously features a smart assistant in the form of Aiva.
|
17 |
|
18 |
## Model details
|
19 |
+
This model features a diverse collection of datasets, totaling ~22 million tokens;
|
20 |
|
21 |
- For general instructions I created GPT 4 and Claude Opus variations of the No-Robots dataset. I actually ended up not including NoRo itself as it made the model worse.
|
22 |
- For roleplay I used an extensive collection of GPT 4 and Claude Opus data, augmented by the always popular LimaRP for the "human factor".
|
|
|
39 |
```
|
40 |
Besides the basic instructional sets all other datasets were trained with character names added. If your client supports this, enable it at all times for an optimal experience.
|
41 |
|
42 |
+
**Note:** Due to the nature of the datasets inside this model you will not be getting page-long roleplay replies. On average, they will be about one or two paragraphs in length.
|
43 |
+
|
44 |
### Roleplay
|
45 |
|
46 |
+
The majority of the roleplaying data in this model uses an asterisk action, no quote for speech style as that seems to be the norm nowadays.
|
47 |
+
|
48 |
+
There are no strict rules in regards to character card formatting as the model was trained with a wide variety of inputs.
|
49 |
|
50 |
### Aiva the Assistant
|
51 |
|
52 |
**System Prompt:** `You are a caring and empathetic sentient AI companion named Aiva.`
|
53 |
+
Aiva is a distinct mixture of instructional and roleplay data - There's really little she can't do at this point with how extensive her training has been. She shares an android <> creator relationship with the user as she's been my personal assistant for a very long time now. I hope you like her!
|
54 |
+
|
55 |
+
She's basically a sexier version of [Eric Hartford's Samantha](https://erichartford.com/meet-samantha).
|
56 |
|
57 |
### Personas
|
58 |
|
|
|
105 |
- Everyone from [MinervaAI](https://huggingface.co/MinervaAI)! Hi, guys!
|
106 |
- Huge, huge thanks to [kubernetes_bad](https://huggingface.co/kubernetes-bad) for the compute that made my hundreds of experiments possible!
|
107 |
- All the folks I chat with on a daily basis on Discord! You know who you are.
|
108 |
+
- Anyone I forgot to mention, just in case!
|
109 |
|
110 |
## Finally
|
111 |
If you've read this far I encourage you to give this model a serious try and leave feedback! I'd love to see what people think of my first true base model.
|