Commit
•
3bcc149
1
Parent(s):
eac2deb
Add infinity to readme (#39)
Browse files- Add infinity to readme (7816d43c4efd2fead216afbb7522d2093b44b16b)
Co-authored-by: Michael <[email protected]>
README.md
CHANGED
@@ -5575,6 +5575,15 @@ print(similarities)
|
|
5575 |
# [0.31938642 0.7853526 ]]
|
5576 |
```
|
5577 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5578 |
# FAQ
|
5579 |
|
5580 |
Q: The details of training?
|
|
|
5575 |
# [0.31938642 0.7853526 ]]
|
5576 |
```
|
5577 |
|
5578 |
+
## Infinity
|
5579 |
+
|
5580 |
+
Usage with [Infinity, MIT Licensed Inference Server](https://github.com/michaelfeil/infinity) and Docker.
|
5581 |
+
```bash
|
5582 |
+
docker run --gpus all -v $PWD/data:/app/.cache \
|
5583 |
+
michaelf34/infinity:0.0.69-trt-onnx \
|
5584 |
+
v2 --model-id dunzhang/stella_en_1.5B_v5 --batch-size 16 --device cuda --engine torch --port 7997
|
5585 |
+
```
|
5586 |
+
|
5587 |
# FAQ
|
5588 |
|
5589 |
Q: The details of training?
|