requirements.txt

vllm==0.2.5
torch==2.1.2
huggingface_hub==0.19.4
hf-transfer==0.1.4
requests
datasets