lunahr
/

thea-pro-2b-100r

Text Generation

text-generation-inference

Model card Files Files and versions Metrics Training metrics Community

lunahr commited on 1 day ago

Commit

b233a8b

·

verified ·

1 Parent(s): 0304897

trust the remote code

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ MAX_RESPONSE_TOKENS = 512
 model_name = "lunahr/thea-pro-2b-100r"
-model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 prompt = "Which is greater 9.9 or 9.11 ??"

 model_name = "lunahr/thea-pro-2b-100r"
+model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto", trust_remote_code=True)
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 prompt = "Which is greater 9.9 or 9.11 ??"