Linking error(s) trying to use llama.cpp

[ldraconus]

Trying to write a Qt based chat-bot. Not using cmake (I know, I know, I can switch if that is the answer but...):

Here is what I'm trying (generated from a qmake file):

g++ -Wl,-subsystem,windows -mthreads -o debug\RPG_Llama.exe debug/QLlama.o debug/main.o debug/MW.o debug/moc_MW.o debug/moc_QLlama.o -LE:\QtSource\llama\build\src -LE:\QtSource\llama\build\ggml\src -LE:\QtSource\llama\build\ggml\src\ggml-vulkan -LE:\QtSource\llama\build\common E:\QtSource\llama\build\ggml\src\ggml-cpu.a E:\QtSource\llama\build\ggml\src\ggml-vulkan\ggml-vulkan.a -lllama E:\QtSource\llama\build\ggml\src\ggml.a E:\QtSource\llama\build\ggml\src\ggml-base.a -lcommon D:\Qt\6.9.0\mingw_64\lib\libQt6Widgets.a D:\Qt\6.9.0\mingw_64\lib\libQt6Gui.a D:\Qt\6.9.0\mingw_64\lib\libQt6Core.a -lmingw32 D:\Qt\6.9.0\mingw_64\lib\libQt6EntryPoint.a -lshell3

Getting this linker error:

D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1ad35): undefined reference to GOMP_barrier'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1b4bc): undefined reference to GOMP_barrier' D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1bad9): undefined reference to GOMP_barrier'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1bf2e): undefined reference to GOMP_barrier' D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1c656): undefined reference to GOMP_barrier'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1cf4f): more undefined references to GOMP_barrier' follow D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2a51d): undefined reference to GOMP_single_start'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2a526): undefined reference to GOMP_barrier' D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2a52b): undefined reference to omp_get_thread_num'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2a551): undefined reference to omp_get_num_threads' D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2cd57): undefined reference to GOMP_parallel'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x1b5a8): undefined reference to GOMP_barrier' D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml-cpu.a(ggml-cpu.c.obj):ggml-cpu.c:(.text+0x2a58c): undefined reference to GOMP_barrier'
D:/Qt/Tools/mingw1310_64/bin/../lib/gcc/x86_64-w64-mingw32/13.1.0/../../../../x86_64-w64-mingw32/bin/ld.exe: E:\QtSource\llama\build\ggml\src\ggml.a(ggml-backend-reg.cpp.obj):ggml-backend-reg.cpp:(.text+0xabd): undefined reference to ggml_backend_vk_reg' collect2.exe: error: ld returned 1 exit status mingw32-make[1]: *** [Makefile.Debug:78: debug/RPG_Llama.exe] Error 1 mingw32-make[1]: Leaving directory 'E:/QtSource/RPG_Llama/build/Desktop_Qt_6_9_0_MinGW_64_bit-Debug'

I can't find these functions in source code anywhere ...

Thank you for your help ... even if the answer is just use cmake (I can do that)

Chris Olson

[slaren]

These are OpenMP functions, you are probably missing -fopenmp. However if you using your own build scripts you are completely on your own, there are many details that you may get wrong. Best would be to use cmake.

[ldraconus]

Ah, thank you. I figured. I'm switching to cmake, and I'll add the openmp library to my project... thank you!

[ldraconus]

(Corrected obvious typo)

... and after switching to cmake, adding the proper llama libs, and finding openmp and vulkan (find_package is your friend) it compiles and links! Thank you for your help figuring that out!