You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
majiahui@haimaqingfan.com
e39975bcf8
|
2 years ago | |
|---|---|---|
| .idea | 2 years ago | |
| README.md | 2 years ago | |
| articles_directory_predict.py | 2 years ago | |
| config_llama_api.py | 2 years ago | |
| flask_batch.py | 2 years ago | |
| flask_predict.py | 2 years ago | |
| flask_test.py | 2 years ago | |
| gen_paper.py | 2 years ago | |
| gunicorn_config.py | 2 years ago | |
| img.png | 2 years ago | |
| img_1.png | 2 years ago | |
| mistral_model_predict_vllm.py | 2 years ago | |
| predict.py | 2 years ago | |
| run_api.sh | 2 years ago | |
| run_model_predict.sh | 2 years ago | |
| tokenizer.py | 2 years ago | |
| vllm_predict_batch.py | 2 years ago | |
| yace.py | 2 years ago | |
| yace2.py | 2 years ago | |
| yuce3.py | 2 years ago | |
README.md
VLLM项目
项目启动
bash run_model_predict.sh bash run_api.sh
调用示例
"http://192.168.31.74:12000/predict"
{ "texts": "你好" }