Why not runing whisper CUDA on GPU 1050TI on windows?

[spaceVpn]

I downloaded this version: whisper-cublas-bin-x64.zip
I start decryption, all work goes on the processor.
GPU is not loaded.
The console shows: CUDA is available.
Attached screenshots.
Can you tell me how to run whisper with gpu usage on windows.

[bobqianic]

You can monitor the GPU utilization rate using GPU-Z. I've noticed a similar phenomenon where the Windows Task Manager fails to display the GPU utilization rate accurately. I'm not sure of the reason behind this discrepancy.

Edit: https://stackoverflow.com/questions/61507765/gpu-usage-shows-zero-when-cuda-with-pytorch-using-on-windows

[spaceVpn]

You can monitor the GPU utilization rate using GPU-Z. I've noticed a similar phenomenon where the Windows Task Manager fails to display the GPU utilization rate accurately. I'm not sure of the reason behind this discrepancy.

It's something else

[bobqianic]

It's something else

Okay, my mistake. You're right, the v1.5.1 cublas binary isn't working. I uploaded it last night using binaries from GitHub runners, but since they don't have GPUs, the CUDA code didn't compile properly. I'll compile it locally on my machine, where I have the necessary GPU support, and then upload it again.

Edit: Even if there is no GPU, nvcc should compile CUDA code correctly.
https://stackoverflow.com/questions/20186848/can-i-compile-a-cuda-program-without-having-a-cuda-device

[ggerganov]

It's better to fix the build + CI if it is not working. I don't have Windows to debug this