Skip to content

feat: TensorRT-LLM better error logs for Cuda/Nvidia driver out of date #1019

Closed
@freelerobot

Description

@freelerobot

Problem

  1. Have an outdated cuda toolkit and nvidia driver
  2. Get error message:
× CUDA version 12.3 is not compatible with TensorRT-LLM models. Required version: 12.4

3.Install latest cuda toolkit
4. Get the same message
5. Realize also need to install Nvidia Driver (is that where we're checking cuda version?)
6. Issue resolved.

Success Criteria
Low hanging fruit is to just give a better error message:

Your Nvidia Driver and Cuda Toolkit is not compatible with the latest TRT-LLM Models.
Please download the latest:
NVIDIA driver version ___ or higher.
CUDA Toolkit version ___ or higher.

Additional context
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Discontinued

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions