jiahui
/
vllm
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
使用vllm部署
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
17 Commits
1 Branch
0 Tags
198 KiB
 
 
Tree: e39975bcf8
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'e39975bcf8'
${ noResults }
vllm/README.md

185 B
Raw Blame History

VLLM项目

项目启动

bash run_model_predict.sh bash run_api.sh

调用示例

"http://192.168.31.74:12000/predict"

{ "texts": "你好" }

返回示例

请求参数