Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -38,10 +38,10 @@ More details on model performance across various devices, can be found
|
|
38 |
|
39 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
40 |
| ---|---|---|---|---|---|---|---|
|
41 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite |
|
42 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.
|
43 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library |
|
44 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.
|
45 |
|
46 |
|
47 |
|
@@ -104,15 +104,15 @@ python -m qai_hub_models.models.whisper_small_en.export
|
|
104 |
Profile Job summary of WhisperEncoder
|
105 |
--------------------------------------------------
|
106 |
Device: Snapdragon X Elite CRD (11)
|
107 |
-
Estimated Inference Time:
|
108 |
Estimated Peak Memory Range: 0.92-0.92 MB
|
109 |
Compute Units: NPU (1473) | Total (1473)
|
110 |
|
111 |
Profile Job summary of WhisperDecoder
|
112 |
--------------------------------------------------
|
113 |
Device: Snapdragon X Elite CRD (11)
|
114 |
-
Estimated Inference Time:
|
115 |
-
Estimated Peak Memory Range: 121.
|
116 |
Compute Units: NPU (2255) | Total (2255)
|
117 |
|
118 |
|
@@ -138,7 +138,6 @@ from qai_hub_models.models.whisper_small_en import Model
|
|
138 |
|
139 |
# Load the model
|
140 |
torch_model = Model.from_pretrained()
|
141 |
-
torch_model.eval()
|
142 |
|
143 |
# Device
|
144 |
device = hub.Device("Samsung Galaxy S23")
|
|
|
38 |
|
39 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
40 |
| ---|---|---|---|---|---|---|---|
|
41 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 615.85 ms | 53 - 482 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite)
|
42 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.012 ms | 16 - 20 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite)
|
43 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1802.215 ms | 0 - 225 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.so)
|
44 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.923 ms | 115 - 186 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.so)
|
45 |
|
46 |
|
47 |
|
|
|
104 |
Profile Job summary of WhisperEncoder
|
105 |
--------------------------------------------------
|
106 |
Device: Snapdragon X Elite CRD (11)
|
107 |
+
Estimated Inference Time: 1093.55 ms
|
108 |
Estimated Peak Memory Range: 0.92-0.92 MB
|
109 |
Compute Units: NPU (1473) | Total (1473)
|
110 |
|
111 |
Profile Job summary of WhisperDecoder
|
112 |
--------------------------------------------------
|
113 |
Device: Snapdragon X Elite CRD (11)
|
114 |
+
Estimated Inference Time: 17.21 ms
|
115 |
+
Estimated Peak Memory Range: 121.47-121.47 MB
|
116 |
Compute Units: NPU (2255) | Total (2255)
|
117 |
|
118 |
|
|
|
138 |
|
139 |
# Load the model
|
140 |
torch_model = Model.from_pretrained()
|
|
|
141 |
|
142 |
# Device
|
143 |
device = hub.Device("Samsung Galaxy S23")
|