|
@ -19,5 +19,6 @@ python main_scoket_deepspeek.py |
|
|
https://console-docs.apipost.cn/preview/f03a79d844523711/2f4079d715d28b32 |
|
|
https://console-docs.apipost.cn/preview/f03a79d844523711/2f4079d715d28b32 |
|
|
|
|
|
|
|
|
### 大模型启动方式: |
|
|
### 大模型启动方式: |
|
|
|
|
|
conda activate vllm_0_8cuda_12 |
|
|
cd /home/zhangbaoxun/project/qwq_32_vllm |
|
|
cd /home/zhangbaoxun/project/qwq_32_vllm |
|
|
bash run_openai_api.sh |
|
|
bash run_openai_api.sh |