jiahui
/
vllm
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
使用vllm部署
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
20 Commits
1 Branch
0 Tags
198 KiB
Tree: 06b249f4a3
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '06b249f4a3'
${ noResults }
vllm/run_api_gunicorn.sh

1 line
46 B
Raw Normal View History

chatgpt服务使用vllm方式预测
1 year ago
gunicorn mistral_api:app -c gunicorn_config.py