Code

Temp1#22

Code

Merged

apicalshark merged 54 commits intotempapicalshark/llama.cpp:tempfrom temp1apicalshark/llama.cpp:temp1Copy head branch name to clipboardNov 22, 2024

+7,266-8,795

Commits

Commits on Nov 16, 2024

• server: (web UI) Add samplers sequence customization (ggerganov#10255)

  Show description for bcdb7a2
  

  MaggotHATE

  and

  ngxson

  authored
  bcdb7a2

  Copy full SHA for bcdb7a2

• make : auto-determine dependencies (#0)

  ggerganov

  committed
  8ee0d09

  Copy full SHA for 8ee0d09

• llamafile : fix include path (#0)

  Show description for db4cfd5
  ggerganov

  committed
  db4cfd5

  Copy full SHA for db4cfd5

• llama/ex: remove --logdir argument (ggerganov#10339)

  JohannesGaessler

  authored
  4e54be0

  Copy full SHA for 4e54be0

• docs : vulkan build instructions to use git bash mingw64 (ggerganov#10303)

  FirstTimeEZ

  authored
  0fff7fd

  Copy full SHA for 0fff7fd

Commits on Nov 17, 2024

• scripts : update sync

  ggerganov

  committed
  5c9a8b2

  Copy full SHA for 5c9a8b2

• ggml: new optimization interface (ggml/988)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  8a43e94

  Copy full SHA for 8a43e94

• ggml : fix compile warnings (#0)

  Show description for 68fcb47
  ggerganov

  committed
  68fcb47

  Copy full SHA for 68fcb47

• tests : remove test-grad0

  ggerganov

  committed
  84274a1

  Copy full SHA for 84274a1

• make : add ggml-opt (#0)

  Show description for a4200ca
  ggerganov

  committed
  a4200ca

  Copy full SHA for a4200ca

• ggml : adapt AMX to tensor->grad removal (#0)

  Show description for 5d9e599
  ggerganov

  committed
  5d9e599

  Copy full SHA for 5d9e599

• ggml : inttypes.h -> cinttypes (#0)

  Show description for 24203e9
  ggerganov

  committed
  24203e9

  Copy full SHA for 24203e9

• ggml : fix possible buffer use after free in sched reserve (ggerganov#9930)

  slaren

  authored
  eda7e1d

  Copy full SHA for eda7e1d

• CMake: default to -arch=native for CUDA build (ggerganov#10320)

  JohannesGaessler

  authored
  467576b

  Copy full SHA for 467576b

• CUDA: remove DMMV, consolidate F16 mult mat vec (ggerganov#10318)

  JohannesGaessler

  authored
  c3ea58a

  Copy full SHA for c3ea58a

• ggml : fix undefined reference to 'getcpu' (ggerganov#10354)

  Show description for a431782
  FirstTimeEZ

  authored
  a431782

  Copy full SHA for a431782

• metal : refactor kernel args into structs (ggerganov#10238)

  Show description for cf32a9b
  ggerganov

  authored
  cf32a9b

  Copy full SHA for cf32a9b

• gitignore : ignore local run scripts [no ci]

  ggerganov

  committed
  20a780c

  Copy full SHA for 20a780c

• llama : only use default buffer types for the KV cache (ggerganov#10358)

  slaren

  authored
  be5cacc

  Copy full SHA for be5cacc

• CMake: fix typo in comment [no ci] (ggerganov#10360)

  JohannesGaessler

  authored
  ce2e59b

  Copy full SHA for ce2e59b

• CUDA: fix MMV kernel being used for FP16 src1 (ggerganov#10357)

  JohannesGaessler

  authored
  76e9e58

  Copy full SHA for 76e9e58

• docker: use GGML_NATIVE=OFF (ggerganov#10368)

  JohannesGaessler

  authored
  75207b3

  Copy full SHA for 75207b3

Commits on Nov 18, 2024

• Vulkan: Fix device info output format specifiers (ggerganov#10366)

  Show description for 9b75f03
  0cc4m

  authored
  9b75f03

  Copy full SHA for 9b75f03

• flake.lock: Update (ggerganov#10346)

  Show description for 2eb76b2
  

  ggerganov

  and

  github-actions[bot]

  authored
  2eb76b2

  Copy full SHA for 2eb76b2

• vulkan: remove use of null initializer (ggerganov#10372)

  Show description for f139d2e
  jeffbolznv

  authored
  f139d2e

  Copy full SHA for f139d2e

• Skip searching root path for cross-compile builds (ggerganov#10383)

  bandoti

  authored
  531cb1c

  Copy full SHA for 531cb1c

• cuda : only use native when supported by cmake (ggerganov#10389)

  slaren

  authored
  d3481e6

  Copy full SHA for d3481e6

Commits on Nov 19, 2024

• sycl: Revert MUL_MAT_OP support changes (ggerganov#10385)

  Alcpz

  authored
  557924f

  Copy full SHA for 557924f

• vulkan: Optimize soft_max (ggerganov#10301)

  Show description for b3e5859
  jeffbolznv

  authored
  b3e5859

  Copy full SHA for b3e5859

• sycl : Add option to set the SYCL architecture for all targets (ggerganov#10266)

  Show description for 2a1507c
  Rbiessy

  authored
  2a1507c

  Copy full SHA for 2a1507c

• llama : add OLMo November 2024 support (ggerganov#10394)

  Show description for a88ad00
  2015aroras

  authored
  a88ad00

  Copy full SHA for a88ad00

• llama : add check for KV cache shifts (ggerganov#10401)

  Show description for 8e752a7
  ggerganov

  authored
  8e752a7

  Copy full SHA for 8e752a7

• cuda : fix CUDA_FLAGS not being applied (ggerganov#10403)

  slaren

  authored
  3ee6382

  Copy full SHA for 3ee6382

• Add required ggml-base and backend libs to cmake pkg (ggerganov#10407)

  bandoti

  authored
  2a11b6b

  Copy full SHA for 2a11b6b

• cmake: force MSVC compiler charset to utf-8 (ggerganov#9989)

  shou692199

  authored
  342397d

  Copy full SHA for 342397d

• metal : add GGML_UNARY_OP_ELU kernel (ggml/1018)

  

  PABannier

  authored and

  ggerganov

  committed
  12b0ad9

  Copy full SHA for 12b0ad9

• metal : fox offset integer overflows in im2col (ggml/1015)

  Show description for 611fabd
  

  pminev

  authored and

  ggerganov

  committed
  611fabd

  Copy full SHA for 611fabd

• sync : ggml

  ggerganov

  committed
  9fe0fb0

  Copy full SHA for 9fe0fb0

• add cmake rvv support (ggerganov#10411)

  lhpqaq

  authored
  42ae10b

  Copy full SHA for 42ae10b

• Fix missing file renames in Makefile due to changes in commit ae8de6d (ggerganov#10413)

  avdg

  authored
  3952a22

  Copy full SHA for 3952a22

Commits on Nov 20, 2024

• update rel to 4040 (ggerganov#10395)

  Show description for ad21c9e
  

  NeoZhangJianyu

  and

  arthw

  authored
  ad21c9e

  Copy full SHA for ad21c9e

• vulkan: further optimize mul_mat_vec using larger loads (ggerganov#10387)

  Show description for 1bacb9f
  jeffbolznv

  authored
  1bacb9f

  Copy full SHA for 1bacb9f

• vulkan: copy iq4_nl LUT into shared memory (ggerganov#10409)

  jeffbolznv

  authored
  8fd4b7f

  Copy full SHA for 8fd4b7f

• llama : add .clang-format file (ggerganov#10415)

  slaren

  authored
  fab5d30

  Copy full SHA for fab5d30

• cmake: add link dependencies to cmake find pkg (ggerganov#10433)

  Show description for f95caa7
  bandoti

  authored
  f95caa7

  Copy full SHA for f95caa7

• vulkan: predicate max operation in soft_max shaders/soft_max (ggerganov#10437)

  Show description for 9abe9ee
  jeffbolznv

  authored
  9abe9ee

  Copy full SHA for 9abe9ee

Commits on Nov 21, 2024

• ggml-opt: fix data corruption (ggml/1022)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  02e4eaf

  Copy full SHA for 02e4eaf

• ggml/sched : do not skip views in pre-assignments

  

  slaren

  authored and

  ggerganov

  committed
  59b9172

  Copy full SHA for 59b9172

• sync : ggml

  ggerganov

  committed
  87a533b

  Copy full SHA for 87a533b

• llama : handle KV shift for recurrent models (ggerganov#10402)

  Show description for 1bb30bf
  ggerganov

  authored
  1bb30bf

  Copy full SHA for 1bb30bf

• cuda : optimize argmax (ggerganov#10441)

  Show description for a5e4759
  

  slaren

  and

  JohannesGaessler

  authored
  a5e4759

  Copy full SHA for a5e4759

Commits on Nov 22, 2024

• CANN: Support Ascend310P to accelerate F32 and F16 Model (ggerganov#10216)

  Show description for c18610b
  leo-pony

  authored
  c18610b

  Copy full SHA for c18610b

• GitHub: ask for more info in issue templates (ggerganov#10426)

  Show description for 599b3e0
  JohannesGaessler

  authored
  599b3e0

  Copy full SHA for 599b3e0

• Merge branch 'temp' into temp1

  apicalshark

  authored
  35c08c2

  Copy full SHA for 35c08c2