You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
573 B
573 B
知识库增删改查
python main.py
知识库流式问答socket
python main_scokt.py
仿deepseek流式问答 socket （非 rag相关内容）
python main_scoket_deepspeek.py
具体接口可以参考接口文档11
接口文档.docx
https://console-docs.apipost.cn/preview/55b7d541588142d1/f4645422856c695a
https://console-docs.apipost.cn/preview/f03a79d844523711/2f4079d715d28b32
大模型启动方式：
conda activate vllm_0_8cuda_12
cd /home/zhangbaoxun/project/qwq_32_vllm
bash run_openai_api.sh