vllm==0.8.0
transformers==4.51.3
torch>=2
accelerate
gradio