Skip to content

Commit

Permalink
Merge pull request #297 from janhq/update-submodule-2024-11-20-17-01
Browse files Browse the repository at this point in the history 
Update llama.cpp submodule to latest release b4143
  • Loading branch information
@jan-service-account
jan-service-account authored Nov 20, 2024
2 parents f6d3f24 + e7d6c8b commit c86159e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama.cpp
Submodule llama.cpp updated 51 files
+161 −0 .clang-format
+1 −1 .devops/full-cuda.Dockerfile
+1 −1 .devops/full-musa.Dockerfile
+1 −1 .devops/llama-cli-cann.Dockerfile
+1 −1 .devops/llama-cli-cuda.Dockerfile
+1 −1 .devops/llama-cli-intel.Dockerfile
+1 −1 .devops/llama-cli-musa.Dockerfile
+1 −1 .devops/llama-cli-vulkan.Dockerfile
+1 −1 .devops/llama-server-cuda.Dockerfile
+1 −1 .devops/llama-server-intel.Dockerfile
+1 −1 .devops/llama-server-musa.Dockerfile
+1 −1 .devops/llama-server-vulkan.Dockerfile
+7 −0 CMakeLists.txt
+4 −4 Makefile
+35 −19 cmake/llama-config.cmake.in
+6 −0 common/common.cpp
+5 −0 convert_hf_to_gguf.py
+12 −7 docs/backend/SYCL.md
+390 −312 examples/llama-bench/llama-bench.cpp
+3 −3 flake.lock
+5 −6 ggml/CMakeLists.txt
+1 −1 ggml/src/CMakeLists.txt
+0 −1 ggml/src/ggml-blas/CMakeLists.txt
+5 −0 ggml/src/ggml-cpu/CMakeLists.txt
+3 −3 ggml/src/ggml-cuda/CMakeLists.txt
+4 −2 ggml/src/ggml-cuda/ggml-cuda.cu
+15 −0 ggml/src/ggml-metal/ggml-metal.m
+41 −19 ggml/src/ggml-metal/ggml-metal.metal
+7 −3 ggml/src/ggml-sycl/CMakeLists.txt
+0 −4 ggml/src/ggml-sycl/ggml-sycl.cpp
+76 −47 ggml/src/ggml-vulkan/ggml-vulkan.cpp
+48 −0 ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs.comp
+2 −0 ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq4_nl.comp
+4 −0 ggml/src/ggml-vulkan/vulkan-shaders/get_rows_quant.comp
+80 −12 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp
+3 −0 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.comp
+4 −0 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q2_k.comp
+4 −0 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q3_k.comp
+9 −25 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q4_k.comp
+93 −51 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q5_k.comp
+50 −19 ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q6_k.comp
+4 −0 ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp
+89 −23 ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp
+122 −4 ggml/src/ggml-vulkan/vulkan-shaders/types.comp
+6 −6 ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp
+18 −0 gguf-py/gguf/constants.py
+14 −14 gguf-py/gguf/tensor_mapping.py
+3 −0 include/llama.h
+1 −1 scripts/sync-ggml.last
+191 −1 src/llama.cpp
+8 −0 tests/test-backend-ops.cpp

0 comments on commit c86159e

Please sign in to comment.