You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
202 B
202 B
VLLM项目
项目启动
bash run_model_predict.sh bash run_api.sh
调用示例
"http://192.168.31.74:12000/predict"
{ "texts": "User:你好\nAssistant:" }