You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
majiahui@haimaqingfan.com
6e000b18fd
|
2 years ago | |
|---|---|---|
| .idea | 2 years ago | |
| README.md | 2 years ago | |
| accurate_check.py | 2 years ago | |
| flask_api.py | 2 years ago | |
| gunicorn_config.py | 2 years ago | |
| run_api_gunicorn.sh | 2 years ago | |
README.md
安装环境
conda create -n your_env_name python=3.8
启动项目
启动此项目前必须启动 vllm-main 项目
conda activate llama_paper
bash run_api_gunicorn.sh
测试
https://console-docs.apipost.cn/preview/b695e277612f8e42/f55e4c16c06e5db2