infgrad michaelfeil commited on
Commit
3bcc149
1 Parent(s): eac2deb

Add infinity to readme (#39)

Browse files

- Add infinity to readme (7816d43c4efd2fead216afbb7522d2093b44b16b)


Co-authored-by: Michael <[email protected]>

Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -5575,6 +5575,15 @@ print(similarities)
5575
  # [0.31938642 0.7853526 ]]
5576
  ```
5577
 
 
 
 
 
 
 
 
 
 
5578
  # FAQ
5579
 
5580
  Q: The details of training?
 
5575
  # [0.31938642 0.7853526 ]]
5576
  ```
5577
 
5578
+ ## Infinity
5579
+
5580
+ Usage with [Infinity, MIT Licensed Inference Server](https://github.com/michaelfeil/infinity) and Docker.
5581
+ ```bash
5582
+ docker run --gpus all -v $PWD/data:/app/.cache \
5583
+ michaelf34/infinity:0.0.69-trt-onnx \
5584
+ v2 --model-id dunzhang/stella_en_1.5B_v5 --batch-size 16 --device cuda --engine torch --port 7997
5585
+ ```
5586
+
5587
  # FAQ
5588
 
5589
  Q: The details of training?