-
-
Notifications
You must be signed in to change notification settings - Fork 11.7k
[doc] add guide about the provided PTX was compiled with an unsupported toolchain #28305
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[doc] add guide about the provided PTX was compiled with an unsupported toolchain #28305
Conversation
…lchain Signed-off-by: youkaichao <youkaichao@gmail.com>
|
Documentation preview: https://vllm--28305.org.readthedocs.build/en/28305/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request adds a new section to the troubleshooting documentation to help users resolve the CUDA error: the provided PTX was compiled with an unsupported toolchain. error. The new guide correctly identifies the cause and suggests installing a cuda-compat package as a solution. My review focuses on ensuring the provided example is consistent with the rest of the documentation. I've suggested updating the CUDA version in the example to match the version vLLM is compiled with, as stated elsewhere in the docs, to avoid user confusion.
ywang96
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for adding this!
…ed toolchain (vllm-project#28305) Signed-off-by: youkaichao <youkaichao@gmail.com>
…ed toolchain (vllm-project#28305) Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
…ed toolchain (vllm-project#28305) Signed-off-by: youkaichao <youkaichao@gmail.com>
Purpose
Fixes #27405 #27103 #25143 #17392
Test Plan
Manual test and verify, confirm with the cuda driver team.
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.