cicdatopea
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,7 @@ Please follow the license of the original model.
|
|
21 |
### INT4 Inference on CPU with Qbits
|
22 |
|
23 |
|
24 |
-
pip3 install auto-round
|
25 |
|
26 |
**To make sure to use qbits with intel-extension-for-transformers, please uninstall intel-extension-for-pytorch, which we have not tested for this model yet.**
|
27 |
|
|
|
21 |
### INT4 Inference on CPU with Qbits
|
22 |
|
23 |
|
24 |
+
**pip3 install auto-round** (it will install intel-extension-for-pytorch and intel-extension-for-transformers both). For intel cpu, it will prioritize using intel-extension-for-pytorch , for other cpus, it will prioritize using intel-extension-for-transformers.
|
25 |
|
26 |
**To make sure to use qbits with intel-extension-for-transformers, please uninstall intel-extension-for-pytorch, which we have not tested for this model yet.**
|
27 |
|