You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When running llama-cli.exe for vulkan on Windows, it detects the same graphics card twice, which means it does not work out of the box.
by default it will try to use "both" which then leads to the cryptic error
MESA: error: == VALIDATION ERROR =============================================
error: Total Thread Group Shared Memory storage is 33792, exceeded 32768.
Validation failed.
Setting
$env:GGML_VK_VISIBLE_DEVICES=0
is necessary and works, but that's not really documented anywhere.
Name and Version
./llama-cli.exe --version
version: 3772 (23e0d70)
built with MSVC 19.29.30154.0 for x64
What operating system are you seeing the problem on?
What happened?
When running llama-cli.exe for vulkan on Windows, it detects the same graphics card twice, which means it does not work out of the box.
by default it will try to use "both" which then leads to the cryptic error
Setting
is necessary and works, but that's not really documented anywhere.
Name and Version
./llama-cli.exe --version
version: 3772 (23e0d70)
built with MSVC 19.29.30154.0 for x64
What operating system are you seeing the problem on?
Windows
Relevant log output
The text was updated successfully, but these errors were encountered: