Update README.md
Browse files
README.md
CHANGED
@@ -22,7 +22,7 @@ DirectML is a high-performance, hardware-accelerated DirectX 12 library for mach
|
|
22 |
## ONNX Models
|
23 |
|
24 |
Here are some of the optimized configurations we have added:
|
25 |
-
- **ONNX model for int4
|
26 |
- **ONNX model for int4 CPU and Mobile:** ONNX model for CPU and mobile using int4 quantization via RTN. There are two versions uploaded to balance latency vs. accuracy. Acc=1 is targeted at improved accuracy, while Acc=4 is for improved performance. For mobile devices, we recommend using the model with acc-level-4.
|
27 |
|
28 |
## Usage
|
|
|
22 |
## ONNX Models
|
23 |
|
24 |
Here are some of the optimized configurations we have added:
|
25 |
+
- **ONNX model for int4 DirectML:** ONNX model for AMD, Intel, and NVIDIA GPUs on Windows, quantized to int4 using AWQ.
|
26 |
- **ONNX model for int4 CPU and Mobile:** ONNX model for CPU and mobile using int4 quantization via RTN. There are two versions uploaded to balance latency vs. accuracy. Acc=1 is targeted at improved accuracy, while Acc=4 is for improved performance. For mobile devices, we recommend using the model with acc-level-4.
|
27 |
|
28 |
## Usage
|