You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
31 lines
539 B
31 lines
539 B
1 year ago
|
## 安装环境
|
||
|
|
|
||
|
|
```bash
|
||
|
|
conda create -n your_env_name python=3.8
|
||
|
|
pip install -r requirements.txt
|
||
|
|
```
|
||
|
|
|
||
|
|
## 启动项目
|
||
|
|
启动此项目前必须启动 vllm-main 项目
|
||
|
|
|
||
|
|
```bash
|
||
|
|
conda activate llama_paper
|
||
|
|
bash run_model.sh
|
||
|
|
bash run_api.sh
|
||
|
|
bash run_app_search.sh
|
||
|
|
```
|
||
|
|
|
||
|
|
## 测试
|
||
|
|
|
||
|
|
{
|
||
|
|
"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E"
|
||
|
|
}
|
||
|
|
|
||
|
|
```bash
|
||
|
|
curl -H "Content-Type: application/json" -X POST -d '{"orderid": "EEAE880E-BE95-11EE-8D23-D5E5C66DD02E"}' http://101.37.83.210:16005/search
|
||
|
|
```
|
||
|
|
|
||
|
|
返回"status_code"不出现 400 则调用成功
|
||
|
|
|
||
|
|
|