
1 changed files with 30 additions and 0 deletions
@ -0,0 +1,30 @@ |
|||
## 安装环境 |
|||
|
|||
```bash |
|||
conda create -n your_env_name python=3.8 |
|||
pip install -r requirements.txt |
|||
``` |
|||
|
|||
## 启动项目 |
|||
启动此项目前必须启动 vllm-main 项目 |
|||
|
|||
```bash |
|||
conda activate llama_paper |
|||
bash run_model.sh |
|||
bash run_api.sh |
|||
bash run_app_search.sh |
|||
``` |
|||
|
|||
## 测试 |
|||
|
|||
{ |
|||
"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E" |
|||
} |
|||
|
|||
```bash |
|||
curl -H "Content-Type: application/json" -X POST -d '{"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E"}' http://101.37.83.210:16005/search |
|||
``` |
|||
|
|||
返回"status_code"不出现 400 则调用成功 |
|||
|
|||
|
Loading…
Reference in new issue