Hugging Face's logo

Crystalcareai
/
Quiet-Star-Custom

Text Generation
Transformers
Safetensors
quiet
custom_code
Model card Files Community
2
Crystalcareai commited on
Commit
e5b376c
·
verified ·
1 Parent(s): b06b404

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +2 -2
config.json CHANGED
@@ -1,7 +1,7 @@
1
  {
2
  "_name_or_path": "Crystalcareai/Quiet-Star-Custom",
3
  "architectures": [
4
- "MistralForCausalLM"
5
  ],
6
  "attention_dropout": 0.0,
7
  "auto_map": {
@@ -20,7 +20,7 @@
20
  "merged_lm_and_talk_heads": false,
21
  "merged_lm_and_think_heads": true,
22
  "merged_talk_heads": true,
23
- "model_type": "mistral",
24
  "num_attention_heads": 32,
25
  "num_hidden_layers": 32,
26
  "num_key_value_heads": 8,
 
1
  {
2
  "_name_or_path": "Crystalcareai/Quiet-Star-Custom",
3
  "architectures": [
4
+ "QuietForCausalLM"
5
  ],
6
  "attention_dropout": 0.0,
7
  "auto_map": {
 
20
  "merged_lm_and_talk_heads": false,
21
  "merged_lm_and_think_heads": true,
22
  "merged_talk_heads": true,
23
+ "model_type": "quiet",
24
  "num_attention_heads": 32,
25
  "num_hidden_layers": 32,
26
  "num_key_value_heads": 8,