qaihm-bot commited on
Commit
db90fb2
·
verified ·
1 Parent(s): ab6fa3e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +7 -8
README.md CHANGED
@@ -38,10 +38,10 @@ More details on model performance across various devices, can be found
38
 
39
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  | ---|---|---|---|---|---|---|---|
41
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 610.635 ms | 8 - 417 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite)
42
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.644 ms | 16 - 20 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite)
43
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1969.063 ms | 1 - 216 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.so)
44
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.731 ms | 118 - 191 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.so)
45
 
46
 
47
 
@@ -104,15 +104,15 @@ python -m qai_hub_models.models.whisper_small_en.export
104
  Profile Job summary of WhisperEncoder
105
  --------------------------------------------------
106
  Device: Snapdragon X Elite CRD (11)
107
- Estimated Inference Time: 1682.16 ms
108
  Estimated Peak Memory Range: 0.92-0.92 MB
109
  Compute Units: NPU (1473) | Total (1473)
110
 
111
  Profile Job summary of WhisperDecoder
112
  --------------------------------------------------
113
  Device: Snapdragon X Elite CRD (11)
114
- Estimated Inference Time: 20.40 ms
115
- Estimated Peak Memory Range: 121.48-121.48 MB
116
  Compute Units: NPU (2255) | Total (2255)
117
 
118
 
@@ -138,7 +138,6 @@ from qai_hub_models.models.whisper_small_en import Model
138
 
139
  # Load the model
140
  torch_model = Model.from_pretrained()
141
- torch_model.eval()
142
 
143
  # Device
144
  device = hub.Device("Samsung Galaxy S23")
 
38
 
39
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  | ---|---|---|---|---|---|---|---|
41
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 615.85 ms | 53 - 482 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite)
42
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.012 ms | 16 - 20 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite)
43
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1802.215 ms | 0 - 225 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.so)
44
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.923 ms | 115 - 186 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.so)
45
 
46
 
47
 
 
104
  Profile Job summary of WhisperEncoder
105
  --------------------------------------------------
106
  Device: Snapdragon X Elite CRD (11)
107
+ Estimated Inference Time: 1093.55 ms
108
  Estimated Peak Memory Range: 0.92-0.92 MB
109
  Compute Units: NPU (1473) | Total (1473)
110
 
111
  Profile Job summary of WhisperDecoder
112
  --------------------------------------------------
113
  Device: Snapdragon X Elite CRD (11)
114
+ Estimated Inference Time: 17.21 ms
115
+ Estimated Peak Memory Range: 121.47-121.47 MB
116
  Compute Units: NPU (2255) | Total (2255)
117
 
118
 
 
138
 
139
  # Load the model
140
  torch_model = Model.from_pretrained()
 
141
 
142
  # Device
143
  device = hub.Device("Samsung Galaxy S23")