You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
马家辉
9281dfbe78
|
2 weeks ago | |
|---|---|---|
| README.md | 2 weeks ago | |
| ceshi_scokt.py | 6 months ago | |
| main.py | 2 weeks ago | |
| main_scokt.py | 2 weeks ago | |
| model_api.py | 7 months ago | |
| model_api_deepspeed.py | 7 months ago | |
| model_api_vllm.py | 7 months ago | |
README.md
知识库增删改查
python main.py
知识库流式问答socket
python main_scokt.py
仿deepseek流式问答 socket （非 rag相关内容）
python main_scoket_deepspeek.py
具体接口可以参考接口文档11
接口文档.docx
https://console-docs.apipost.cn/preview/55b7d541588142d1/f4645422856c695a
https://console-docs.apipost.cn/preview/f03a79d844523711/2f4079d715d28b32
大模型启动方式：
conda activate vllm_0_8cuda_12
cd /home/zhangbaoxun/project/qwq_32_vllm
bash run_openai_api.sh