Update README.md
Browse files
README.md
CHANGED
@@ -62,7 +62,7 @@ python -m venv dmlgenai<br>
|
|
62 |
dmlgenai\Scripts\activate.bat<br>
|
63 |
pip install onnxruntime-genai-directml
|
64 |
|
65 |
-
|
66 |
It is modified version of "https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3-qa.py".<br>
|
67 |
The modification makes the text output changes to new line after "., :, and ;" to make the output easier to be read.
|
68 |
|
@@ -71,7 +71,7 @@ cd this_onnx_model_directory<br>
|
|
71 |
python onnxgenairun.py --help<br>
|
72 |
python onnxgenairun.py -m . -v -g
|
73 |
|
74 |
-
|
75 |
a. Open "dml-device-specific-optim.py" with text editor and change the file path accordingly.<br>
|
76 |
b. Run the python script: python dml-device-specific-optim.py<br>
|
77 |
c. Rename the original model.onnx to other file name and put and rename the optimized onnx file from step 5.b to model.onnx file.<br>
|
|
|
62 |
dmlgenai\Scripts\activate.bat<br>
|
63 |
pip install onnxruntime-genai-directml
|
64 |
|
65 |
+
4. Use the onnxgenairun.py to get chat interface.<br>
|
66 |
It is modified version of "https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3-qa.py".<br>
|
67 |
The modification makes the text output changes to new line after "., :, and ;" to make the output easier to be read.
|
68 |
|
|
|
71 |
python onnxgenairun.py --help<br>
|
72 |
python onnxgenairun.py -m . -v -g
|
73 |
|
74 |
+
5. (Optional but recommended) Device specific optimization.<br>
|
75 |
a. Open "dml-device-specific-optim.py" with text editor and change the file path accordingly.<br>
|
76 |
b. Run the python script: python dml-device-specific-optim.py<br>
|
77 |
c. Rename the original model.onnx to other file name and put and rename the optimized onnx file from step 5.b to model.onnx file.<br>
|