Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# ai-msgbot GPT2-L
|
| 2 |
+
|
| 3 |
+
_NOTE: model card is WIP_
|
| 4 |
+
|
| 5 |
+
GPT2-L (774M parameters) trained on the Wizard of Wikipedia dataset for 40k steps with 34/36 layers frozen using `aitextgen`. Designed for use with [ai-msgbot](https://github.com/pszemraj/ai-msgbot).
|