Spaces:

htigenai
/

model-inference

Runtime error

htigenai commited on Nov 19, 2024

Commit

760ddcc

verified ·

1 Parent(s): cbc070f

changed to 4-bit precision model (finetune_test_2)

Files changed (1) hide show

app.py CHANGED Viewed

@@ -36,7 +36,7 @@ log_system_info()
 try:
     print("Loading model and tokenizer...")
-    model_id = "htigenai/finetune_test"
     with timer("Loading tokenizer"):
         tokenizer = AutoTokenizer.from_pretrained(

 try:
     print("Loading model and tokenizer...")
+    model_id = "htigenai/finetune_test_2_4bit"
     with timer("Loading tokenizer"):
         tokenizer = AutoTokenizer.from_pretrained(