Crystalcareai
/

Quiet-Star-Custom

Text Generation

Model card Files Files and versions Community

Crystalcareai commited on Apr 6, 2024

Commit

257e2f1

·

verified ·

1 Parent(s): 3da56b6

Update generate.py

Files changed (1) hide show

generate.py +1 -1

generate.py CHANGED Viewed

@@ -133,7 +133,7 @@ def generate(
     forced_eos_token_id=None,
     remove_invalid_values=None,
     synced_gpus=None,
-    n_ahead=12,
     n_ahead_talk=4,
     merged_talk_heads=True,
     merged_lm_and_talk_heads=False,

     forced_eos_token_id=None,
     remove_invalid_values=None,
     synced_gpus=None,
+    n_ahead=4,
     n_ahead_talk=4,
     merged_talk_heads=True,
     merged_lm_and_talk_heads=False,