update readme
Browse filesSigned-off-by: wenhuach <[email protected]>
README.md
CHANGED
@@ -26,7 +26,7 @@ model = AutoModelForCausalLM.from_pretrained(quantized_model_dir,
|
|
26 |
tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
|
27 |
text = "There is a girl who likes adventure,"
|
28 |
inputs = tokenizer(text, return_tensors="pt").to(model.device)
|
29 |
-
print(tokenizer.decode(model.generate(**inputs, max_new_tokens=50
|
30 |
##<bos>There is a girl who likes adventure, and she is a girl who likes to travel. She is a girl who likes to explore the world and see new things. She is a girl who likes to meet new people and learn about their cultures. She is a girl who likes to take risks
|
31 |
```
|
32 |
|
|
|
26 |
tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
|
27 |
text = "There is a girl who likes adventure,"
|
28 |
inputs = tokenizer(text, return_tensors="pt").to(model.device)
|
29 |
+
print(tokenizer.decode(model.generate(**inputs, max_new_tokens=50)[0]))
|
30 |
##<bos>There is a girl who likes adventure, and she is a girl who likes to travel. She is a girl who likes to explore the world and see new things. She is a girl who likes to meet new people and learn about their cultures. She is a girl who likes to take risks
|
31 |
```
|
32 |
|