Update README.md

README.md

@@ -10,24 +10,10 @@ language:
 ## Model Details
 
 This model is an int4 model with group_size 128 of [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)  generated by [intel/auto-round](https://github.com/intel/auto-round). 
+Inference of this model is compatible with AutoGPTQ's Kernel.
 
 
 
-### INT4 Inference with AutoGPTQ's Kernel
-
-```python
-##pip install auto-gptq[triton] 
-##pip install triton==2.2.0
-from transformers import AutoModelForCausalLM, AutoTokenizer
-quantized_model_dir = "Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc"
-model = AutoModelForCausalLM.from_pretrained(quantized_model_dir,
-                                             device_map="auto",
-                                             trust_remote_code=False,
-                                             )
-tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
-print(tokenizer.decode(model.generate(**tokenizer("There is a girl who likes adventure,", return_tensors="pt").to(model.device),max_new_tokens=50)[0]))
-```
-
 
 
 ### Evaluate the model