Hugging Face's logo

OpenVINO
/
TinyLlama-1.1B-Chat-v1.0-int8-ov

Text Generation
Transformers
OpenVINO
llama
conversational
Inference Endpoints
Model card Files Community
sylwia-kuros commited on
Commit
e4331c2
·
verified ·
1 Parent(s): 998eb36

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -49,7 +49,7 @@ pip install optimum[openvino]
49
  from transformers import AutoTokenizer
50
  from optimum.intel.openvino import OVModelForCausalLM
51
 
52
- model_id = "OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov"
53
  tokenizer = AutoTokenizer.from_pretrained(model_id)
54
  model = OVModelForCausalLM.from_pretrained(model_id)
55
 
 
49
  from transformers import AutoTokenizer
50
  from optimum.intel.openvino import OVModelForCausalLM
51
 
52
+ model_id = "OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov"
53
  tokenizer = AutoTokenizer.from_pretrained(model_id)
54
  model = OVModelForCausalLM.from_pretrained(model_id)
55