jiahui
/
vllm
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
使用vllm部署
21 Commits
1 Branch
0 Tags
198 KiB
Tree: 301a1ec91f
vllm/run_model_predict.sh

1 line
88 B
Raw Normal View History

chatgpt服务使用vllm方式预测
2 years ago
nohup python mistral_model_predict_vllm.py > mistral_model_predict_vllm_logs.file 2>&1 &