update ipex result

README.md

@@ -18,14 +18,15 @@ Please follow the license of the original model.
 
 ## How To Use
 
-### INT4 Inference on CPU with Qbits
+### INT4 Inference on CPU with Qbits(Recommend)
 
 
 **pip3 install auto-round** (it will install intel-extension-for-pytorch and intel-extension-for-transformers both). For intel cpu, it will  prioritize using intel-extension-for-pytorch , for other cpus, it will prioritize using intel-extension-for-transformers.
 
-**To make sure to use qbits with intel-extension-for-transformers, please uninstall intel-extension-for-pytorch, which we have not tested for this model yet.**
-
+**To make sure to use qbits with intel-extension-for-transformers, please uninstall intel-extension-for-pytorch**
 
+intel-extension-for-transformers faster repacking, slower inference,higher accuracy
+intel-extension-for-pytorch  much slower repacking, faster inferecne, lower accuracy
 
 ~~~python
 from auto_round import AutoRoundConfig ##must import for autoround format
@@ -161,7 +162,91 @@ prompt = "Please give a brief introduction of DeepSeek company."
 """DeepSeek Artificial Intelligence Co., Ltd. (referred to as "DeepSeek" or "深度求索") , founded in 2023, is a Chinese company dedicated to making AGI a reality"""
 ~~~
 
+### INT4 Inference on CPU with IPEX
+**pip3 install auto-round** (it will install intel-extension-for-pytorch and intel-extension-for-transformers both). For intel cpu, it will  prioritize using intel-extension-for-pytorch , for other cpus, it will prioritize using intel-extension-for-transformers.
+
+**To make sure to use intel-extension-for-pytorch, please uninstall intel-extension-for-transformers**
+
+use the same code above
+
+
+```python
+Prompt: 9.11和9.8哪个数字大
+Generated: 要比较 **9.11** 和 **9.8** 的大小，可以按照以下步骤进行：
+
+1. **比较整数部分**：
+   - 两个数的整数部分都是 **9**，所以整数部分相同。
+
+2. **比较小数部分**：
+   - **9.11** 的小数部分是 **0.11**
+   - **9.8** 的小数部分是 **0.8**
+
+3. **统一小数位数**：
+   - 将 **0.8** 转换为 **0.80**，以便于比较。
+
+4. **直接比较小数部分**：
+   - **0.80** > **0.11**
+
+因此，**9.8** 大于 **9.11**。
+
+最终答案：\boxed{9.8}
+
+```
+-------------------------------------
+Prompt: strawberry中有几个r?
+Generated: ### 第一步：理解问题
+
+首先，我需要明确问题的含义。问题是：“strawberry中有几个r？”。这里的“strawberry”是一个英文单词，意思是“草莓”。问题问的是这个单
+词中有多少个字母“r”。
+
+### 第二步：分解单词
+
+为了找出“strawberry”中有多少个“r”，我需要将这个单词分解成单个字母。让我们逐个字母来看：
+
+- s
+- t
+- r
+- a
+- w
+- b
+- e
+- r
+- r
+- y
+
+### 第三步：识别字母“r”
+
+现在，我需要找出这些字母中哪些是“r”。让我们逐一检查：
+
+1. s - 不是r
+2. t - 不是r
+3. r - 是r
+4. a - 不是r
+5. w - 不是r
+6. b
+
+-------------------------------------
+Prompt: How many r in strawberry.
+Generated: The word "strawberry" contains **3 "r"s.
+
+-------------------------------------
+Prompt: There is a girl who likes adventure,
+Generated: That sounds like the start of an exciting story! A girl who loves adventure could be the protagonist of countless thrilling tales. Here are a few ideas to spark your imagination:
+
+1. **The Explorer of Lost Lands**: She discovers a hidden map leading to a forgotten civilization deep in the jungle. Along the way, she faces wild animals, solves ancient puzzles, and uncovers secrets about her own family.
+
+2. **The Skybound Adventurer**: She builds or finds a mysterious airship and sets off to explore floating islands, sky cities, and uncharted clouds. Along the way, she encounters sky pirates, befriends mythical creatures, and learns to navigate the winds.
+
+3. **The Time Traveler**: She stumbles upon a device that allows her to travel through time. She visits ancient civilizations, future worlds, and pivotal moments in history, all while trying to fix a timeline that’
+
+
+-----------------------------------------
+Prompt: Please give a brief introduction of DeepSeek company.
+Generated: DeepSeek Artificial Intelligence Co., Ltd. (referred to as "DeepSeek" or "深度求索") , founded in 2023, is a Chinese company dedicated to making AGI a reality.
 
+-----------------------------------------
+Prompt: hello
+Generated: Hello! How can I assist you today? 😊
 
 ### INT4 Inference on CUDA(have not tested, maybe need 8X80G GPU)