Intel
/

distilbert-base-cased-distilled-squad-int8-static-inc

Question Answering

Intel® Neural Compressor

PostTrainingStatic

Inference Endpoints

Model card Files Files and versions Community

echarlaix HF staff commited on Mar 21, 2024

Commit

67bf704

•

1 Parent(s): d399043

update loading instructions

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -32,8 +32,8 @@ The linear module **distilbert.transformer.layer.1.ffn.lin2** falls back to fp32
 ### Load with optimum:
 ```python
-from optimum.intel.neural_compressor.quantization import IncQuantizedModelForQuestionAnswering
-int8_model = IncQuantizedModelForQuestionAnswering(
-    'Intel/distilbert-base-cased-distilled-squad-int8-static',
-)
 ```

 ### Load with optimum:
 ```python
+from optimum.intel import INCModelForQuestionAnswering
+model_id = "Intel/distilbert-base-cased-distilled-squad-int8-static"
+int8_model = INCModelForQuestionAnswering.from_pretrained(model_id)
 ```