
1 changed files with 30 additions and 0 deletions
@ -0,0 +1,30 @@ |
|||||
|
## 安装环境 |
||||
|
|
||||
|
```bash |
||||
|
conda create -n your_env_name python=3.8 |
||||
|
pip install -r requirements.txt |
||||
|
``` |
||||
|
|
||||
|
## 启动项目 |
||||
|
启动此项目前必须启动 vllm-main 项目 |
||||
|
|
||||
|
```bash |
||||
|
conda activate llama_paper |
||||
|
bash run_model.sh |
||||
|
bash run_api.sh |
||||
|
bash run_app_search.sh |
||||
|
``` |
||||
|
|
||||
|
## 测试 |
||||
|
|
||||
|
{ |
||||
|
"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E" |
||||
|
} |
||||
|
|
||||
|
```bash |
||||
|
curl -H "Content-Type: application/json" -X POST -d '{"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E"}' http://101.37.83.210:16005/search |
||||
|
``` |
||||
|
|
||||
|
返回"status_code"不出现 400 则调用成功 |
||||
|
|
||||
|
|
Loading…
Reference in new issue