Closed
Description
Problem
- Have an outdated cuda toolkit and nvidia driver
- Get error message:
× CUDA version 12.3 is not compatible with TensorRT-LLM models. Required version: 12.4
3.Install latest cuda toolkit
4. Get the same message
5. Realize also need to install Nvidia Driver (is that where we're checking cuda version?)
6. Issue resolved.
Success Criteria
Low hanging fruit is to just give a better error message:
Your Nvidia Driver and Cuda Toolkit is not compatible with the latest TRT-LLM Models.
Please download the latest:
NVIDIA driver version ___ or higher.
CUDA Toolkit version ___ or higher.
Additional context
Add any other context or screenshots about the feature request here.
Metadata
Metadata
Assignees
Type
Projects
Status
Discontinued