You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
|
|
|
## 安装环境
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
conda create -n your_env_name python=3.8
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## 启动项目
|
|
|
|
|
启动此项目前必须启动 vllm-main 项目
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
conda activate llama_paper
|
|
|
|
|
bash run_api_gunicorn.sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## 测试
|
|
|
|
|
|
|
|
|
|
https://console-docs.apipost.cn/preview/b695e277612f8e42/f55e4c16c06e5db2
|
