kaixkhazaki commited on
Commit
ccd9edf
·
verified ·
1 Parent(s): 77b1753

Create README.md

Browse files

Generative Pretrained Transformer(GPT) model with 124,4 million parameters, trained from scratch using a custom dataset gathering 200 short stories from Anton Chekhov.
CONFIG = {
"vocab_size": 50257,
"context_length": 1024,
"emb_dim": 768,
"n_heads": 12,
"n_layers": 12,
"drop_rate": 0.1,
"qkv_bias": False
}

Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ library_name: transformers
7
+ tags:
8
+ - chekhov
9
+ - story
10
+ - text-generation
11
+ - gpt
12
+ ---