[BugFix] Fix broken import in initialize_ray_cluster() #27838
Conversation
Signed-off-by: Nick Hill <nhill@redhat.com>
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request corrects a broken import for cuda_device_count_stateless in vllm/v1/executor/ray_utils.py. The import path is updated from vllm.utils to vllm.utils.torch_utils, which reflects a recent refactoring. This is a necessary fix to prevent an ImportError at runtime. The change is correct and I have no further suggestions.
|
Hi @njhill , can you peg in a docstring fix in this PR? https://github.com/vllm-project/vllm/blob/main/vllm/config/parallel.py#L198 After #25775, ray is no longer a default fallback and needs to be explicitly specified, otherwise an error will be raised. |
|
@hjjq could you open another PR for that. Sorry I'm doing 10 things at once and not sure exactly of the wording change that you're asking for. |
…27838) Signed-off-by: Nick Hill <nhill@redhat.com>
…27838) Signed-off-by: Nick Hill <nhill@redhat.com>
4 participants
Broken by #25775.