You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. I have searched related issues but cannot get the expected help.
2. The bug has not been fixed in the latest version.
3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
5. Please use English, otherwise it will be closed.
Describe the bug
'test_2_add_and_remove_worker' failed , can not use add_worker and remove_worker, such as ' curl -X POST "127.0.0.1:30000/remove_worker?url=http://127.0.0.1:31000" ', there is no any response or logging even in debug mode,
Reproduction
python -m sglang_router.launch_server --model-path /mnt/140/llama3/Meta-Llama-3-8B-Instruct --dp-size 4 --router-verbose
curl -X POST "127.0.0.1:30000/remove_worker?url=http://127.0.0.1:31000
curl -X POST "127.0.0.1:30000/add_worker?url=http://127.0.0.1:31001
python test_launch_server.py
Environment
Python: 3.10.15 (main, Oct 3 2024, 07:27:34) [GCC 11.2.0]
CUDA available: True
GPU 0,1,2,3,4,5,6,7: NVIDIA A100-SXM4-80GB
The text was updated successfully, but these errors were encountered:
nannaer
changed the title
[Bug]
[Bug] add_worker API no response
Jan 4, 2025
Checklist
Describe the bug
'test_2_add_and_remove_worker' failed , can not use add_worker and remove_worker, such as ' curl -X POST "127.0.0.1:30000/remove_worker?url=http://127.0.0.1:31000" ', there is no any response or logging even in debug mode,
Reproduction
python -m sglang_router.launch_server --model-path /mnt/140/llama3/Meta-Llama-3-8B-Instruct --dp-size 4 --router-verbose
curl -X POST "127.0.0.1:30000/remove_worker?url=http://127.0.0.1:31000
curl -X POST "127.0.0.1:30000/add_worker?url=http://127.0.0.1:31001
python test_launch_server.py
Environment
Python: 3.10.15 (main, Oct 3 2024, 07:27:34) [GCC 11.2.0]
CUDA available: True
GPU 0,1,2,3,4,5,6,7: NVIDIA A100-SXM4-80GB
The text was updated successfully, but these errors were encountered: