Update infinity section

#22
by michaelfeil - opened
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -416,6 +416,13 @@ async def main():
416
  asyncio.run(main())
417
  ```
418
 
 
 
 
 
 
 
 
419
  ## Evaluation
420
 
421
  `baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
 
416
  asyncio.run(main())
417
  ```
418
 
419
+ For a docker based deployment:
420
+ ```bash
421
+ docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
422
+ michaelf34/infinity:0.0.68 \
423
+ v2 --model-id BAAI/bge-reranker-base --revision "main" --dtype float16 --batch-size 32 --engine torch --port 7997
424
+ ```
425
+
426
  ## Evaluation
427
 
428
  `baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**