You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
|
|
|
# VLLM项目
|
|
|
|
|
|
|
|
|
|
## 项目启动
|
|
|
|
|
bash run_model_predict.sh
|
|
|
|
|
bash run_api.sh
|
|
|
|
|
|
|
|
|
|
## 调用示例
|
|
|
|
|
"http://192.168.31.74:12000/predict"
|
|
|
|
|
|
|
|
|
|
{
|
|
|
|
|
"texts": "User:你好\nAssistant:"
|
|
|
|
|
}
|
|
|
|
|
## 返回示例
|
|
|
|
|
## 请求参数
|
