Code

Refactor/online repacking#10446

Code

Merged

ggerganov merged 9 commits intoggml-org:masterggml-org/llama.cpp:masterfrom Djip007:refactor/online_repackingDjip007/llama.cpp:refactor/online_repackingCopy head branch name to clipboardDec 7, 2024

+1,135-1,048

Commits

Commits on Dec 5, 2024

• rename ggml-cpu-aarch64.c to .cpp

  Djip007

  committed
  9ac05c1

  Copy full SHA for 9ac05c1

• reformat extra cpu backend.

  Show description for 98ea414
  Djip007

  committed
  98ea414

  Copy full SHA for 98ea414

• clang-format

  Djip007

  committed
  95322e9

  Copy full SHA for 95322e9

• Clean Q4_0_N_M ref

  Show description for 3a042b4
  Djip007

  committed
  3a042b4

  Copy full SHA for 3a042b4

• add op GGML_OP_MUL_MAT_ID for Q4_0_N_M with runtime repack

  Djip007

  committed
  0a2be72

  Copy full SHA for 0a2be72

Commits on Dec 6, 2024

• added/corrected control on tensor size for Q4 repacking.

  Djip007

  committed
  b14b471

  Copy full SHA for b14b471

Commits on Dec 7, 2024

• Update ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp

  Show description for 7dc8a3e
  

  Djip007

  and

  ggerganov

  authored
  7dc8a3e

  Copy full SHA for 7dc8a3e

• Update ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp

  Show description for e115f6f
  

  Djip007

  and

  ggerganov

  authored
  e115f6f

  Copy full SHA for e115f6f

• add debug logs on repacks.

  Djip007

  committed
  1221d13

  Copy full SHA for 1221d13