MengniWang
commited on
Commit
·
e66bcc3
1
Parent(s):
51f395a
update readme
Browse files
README.md
CHANGED
@@ -1,3 +1,55 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- librispeech_asr
|
5 |
+
metrics:
|
6 |
+
- wer
|
7 |
+
pipeline_tag: automatic-speech-recognition
|
8 |
+
tags:
|
9 |
+
- automatic-speech-recognition
|
10 |
+
- int8
|
11 |
+
- ONNX
|
12 |
+
- PostTrainingDynamic
|
13 |
+
- Intel® Neural Compressor
|
14 |
+
- neural-compressor
|
15 |
+
library_name: transformers
|
16 |
---
|
17 |
+
|
18 |
+
## Model Details: INT8 Whisper large
|
19 |
+
|
20 |
+
Whisper is a pre-trained model for automatic speech recognition (ASR) and speech translation. Trained on 680k hours of labelled data, Whisper models demonstrate a strong ability to generalise to many datasets and domains without the need for fine-tuning.
|
21 |
+
|
22 |
+
This int8 ONNX model is generated by [neural-compressor](https://github.com/intel/neural-compressor) and the fp32 model can be exported with below command:
|
23 |
+
```shell
|
24 |
+
optimum-cli export onnx --model openai/whisper-large whisper-large-with-past/ --task automatic-speech-recognition-with-past --opset 13
|
25 |
+
```
|
26 |
+
|
27 |
+
| Model Detail | Description |
|
28 |
+
| ----------- | ----------- |
|
29 |
+
| Model Authors - Company | Intel |
|
30 |
+
| Date | May 15, 2022 |
|
31 |
+
| Version | 1 |
|
32 |
+
| Type | Speech Recognition |
|
33 |
+
| Paper or Other Resources | - |
|
34 |
+
| License | Apache 2.0 |
|
35 |
+
| Questions or Comments | [Community Tab](https://huggingface.co/Intel/whisper-large-int8-dynamic/discussions)|
|
36 |
+
|
37 |
+
| Intended Use | Description |
|
38 |
+
| ----------- | ----------- |
|
39 |
+
| Primary intended uses | You can use the raw model for automatic speech recognition inference |
|
40 |
+
| Primary intended users | Anyone doing automatic speech recognition inference |
|
41 |
+
| Out-of-scope uses | This model in most cases will need to be fine-tuned for your particular task. The model should not be used to intentionally create hostile or alienating environments for people.|
|
42 |
+
|
43 |
+
|
44 |
+
### How to use
|
45 |
+
|
46 |
+
Download the model and script by cloning the repository:
|
47 |
+
```shell
|
48 |
+
git clone https://huggingface.co/Intel/whisper-large-int8-dynamic
|
49 |
+
```
|
50 |
+
|
51 |
+
## Metrics (Model Performance):
|
52 |
+
| Model | Model Size (GB) | wer |
|
53 |
+
|---|:---:|:---:|
|
54 |
+
| FP32 |9.4|3.04|
|
55 |
+
| INT8 |2.4|2.80|
|