Update infinity section
#22
by
michaelfeil
- opened
README.md
CHANGED
@@ -416,6 +416,13 @@ async def main():
|
|
416 |
asyncio.run(main())
|
417 |
```
|
418 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
419 |
## Evaluation
|
420 |
|
421 |
`baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
|
|
|
416 |
asyncio.run(main())
|
417 |
```
|
418 |
|
419 |
+
For a docker based deployment:
|
420 |
+
```bash
|
421 |
+
docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
|
422 |
+
michaelf34/infinity:0.0.68 \
|
423 |
+
v2 --model-id BAAI/bge-reranker-base --revision "main" --dtype float16 --batch-size 32 --engine torch --port 7997
|
424 |
+
```
|
425 |
+
|
426 |
## Evaluation
|
427 |
|
428 |
`baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
|