-
-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Open
Labels
Description
llama-cpp vulkan: Throws error on model load:
DEBUG GRPC stderr id="gpt-oss-120b-127.0.0.1:36315" line="/backends/vulkan-llama-cpp/llama-cpp-avx2: /backends/vulkan-llama-cpp/lib/libc.so.6: version `GLIBC_2.38' not found (required by /lib/x86_64-linux-gnu/libvulkan.so.1)" caller={caller.file="/build/pkg/model/process.go" caller.L=146 }
llama-cpp vulkan development: has memory leak that causes kernel panic due to OOM