-
Notifications
You must be signed in to change notification settings - Fork 535
[fix] fix bug in 1p1d disaggregated_prefill example #1153
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
|
Hi, I want to know the current disaggregated prefill is just for vllm v0 version or it can work in v1 version? |
just for v0,v1 is in developing |
|
@ChenTaoyu-SJTU V1 support is WIP #950 |
|
When will this PR be merged? |
| re.match(r".*\n\t([0-9]+).*", | ||
| npu_info.stdout).group(1)) # type: ignore | ||
|
|
||
| # 提取所有 Ascend 设备的 NPU ID(排除 Mcu 行) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please rewrite to english
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
because my email changed,I will close this PR and create a new: #1184 check and merge it,thank you very much.
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
### What this PR does / why we need it? fix bug in 1p1d disaggregated_prefill example ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested with python find_device_ips.py and run disaggregated_prefill example Signed-off-by: wangyanhui <1027866388@qq.com>
What this PR does / why we need it?
fix bug in 1p1d disaggregated_prefill example
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Tested with python find_device_ips.py and run disaggregated_prefill example