Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Temp #16

Merged
merged 30 commits into from
Nov 8, 2024
Merged

Temp #16

merged 30 commits into from
Nov 8, 2024

Conversation

apicalshark
Copy link
Owner

pminev and others added 29 commits November 4, 2024 10:33
@pminev @ggerganov
metal : fix minor string leaks (ggml/1004)
e2292aa
@ykhrustalev @ggerganov
cmake : make it possible linking ggml as external lib (ggml/1003)
284e5b0
@ggerganov
sync : ggml
ce027ad
@leo-pony
CANN: adjust backend registry refactor. (ggerganov#10158)
329ed91 
remove buffer->iface.get_name that used in cann as it was removed in backend registry refactor PR.
@ggerganov
metal : move dequantize templates to beginning of MSL source (#0)
f8e5813
@ggerganov
metal : simplify f16 and f32 dequant kernels (#0)
05697f6
@slaren
cuda : clear error after changing peer access (ggerganov#10153)
ea02c75
@snadampal
fix build break on arm64 linux (ggerganov#10166)
6a066b9 
This fixes the build break from the recent changes
to move the CPU backend to separate files
ggerganov#10144
@ngxson
server : clarify /slots endpoint, add is_processing (ggerganov#10162)
9e0ecfb 
* server : clarify /slots endpoint, add is_processing

* fix tests
@slaren
ggml : fix q4xx mat mul, increase ggml_aligned_malloc alignment (gger…
401558b 
…ganov#10167)
@slaren
ggml : fix gelu tables initialization (ggerganov#10172)
d5a409e
@netrunnereve
Q6_K AVX improvements (ggerganov#10118)
3407364 
* q6_k instruction reordering attempt

* better subtract method

* should be theoretically faster

small improvement with shuffle lut, likely because all loads are already done at that stage

* optimize bit fiddling

* handle -32 offset separately. bsums exists for a reason!

* use shift

* Update ggml-quants.c

* have to update ci macos version to 13 as 12 doesnt work now. 13 is still x86
@slaren
ggml : fix arch check in bf16_to_fp32 (ggerganov#10164)
a9e8a9a
@gabe-l-hart
llama : add <|tool_call|> formatting to Granite template (ggerganov#1…
b8deef0 
…0177)

Branch: GraniteToolCallTemplate

Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
@ggerganov
metal : add quantized FA support (ggerganov#10149)
a1eaf6a 
* metal : add quantized FA (vec) support

ggml-ci

* metal : add quantized FA (non-vec) support

* metal : fix support check

ggml-ci

* metal : clean-up

* metal : clean-up (cont)

* metal : fix shared memory calc + reduce smem + comments

* metal : float-correctness

* metal : minor [no ci]
@ggerganov
ggml : adjust is_first_call init value (ggerganov#10193)
1dc04b2 
ggml-ci
@slaren
metal : fix from ptr buffer name (ggerganov#10189)
94d8cb8
@ggerganov
server : remove hack for extra parallel slot (ggerganov#10187)
b11f9ba 
ggml-ci
@ggerganov
metal : add BF16 support (ggerganov#8439)
5c333e0 
* ggml : add initial BF16 support

ggml-ci

* metal : add mul_mat_id BF16 support

ggml-ci

* metal : check for bfloat support on the Metal device

ggml-ci

* metal : better var names [no ci]

* metal : do not build bfloat kernels when not supported

ggml-ci

* metal : try to fix BF16 support check

ggml-ci

* metal : this should correctly check bfloat support
@uniartisan @ggerganov
@slaren @pminev @ykhrustalev @airMeng
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acc…
3bcd40b 
…eleration (ggerganov#10133)

* rwkv6: rename to wkv6

* rwkv6: support avx2 avx512 armv8 armv9

* rwkv6: update cuda file name

* rwkv6: rename params

* wkv on sycl

* sycl: add some ops

* sycl: Enhance OP support judgment

* wkv6: drop armv9 and tranfer to GGML style

ggml-ci

* sync : ggml

* update the function to use appropriate types

* fix define error

* Update ggml/src/ggml-cpu.c

* add appropriate asserts

* move element-wise functions outside

* put the declaration outside the loop

* rewrite to be more inline with the common pattern for distributing threads

* use recommended way GGML_TENSOR_LOCALS

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Diego Devesa <slarengh@gmail.com>
Co-authored-by: Plamen Minev <pacominev@gmail.com>
Co-authored-by: Yuri Khrustalev <ykhrustalev@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <airdldl@163.com>
@snadampal
fix q4_0_8_8 format for corrupted tokens issue (ggerganov#10198)
2319126 
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-62-167.us-west-2.compute.internal>
@wwoodsTM
DRY: Fixes clone functionality (ggerganov#10192)
5107e8c
@fmz
Remove identical wte/etw logic for jais (ggerganov#10203)
60e17ce
@slaren
ggml : add ggml-cpu.h to the public headers (ggerganov#10204)
97404c4
@ggerganov
scripts : sync update
a2c6fd7
@ggerganov
sync : ggml
3b08828
@ggerganov
scripts : add amx to sync-ggml.sh [no ci]
eec4d71
@ngxson
server : revamp chat UI with vuejs and daisyui (ggerganov#10175)
a71d81c 
* server : simple chat UI with vuejs and daisyui

* move old files to legacy folder

* embed deps into binary

* basic markdown support

* add conversation history, save to localStorage

* fix bg-base classes

* save theme preferences

* fix tests

* regenerate, edit, copy buttons

* small fixes

* docs: how to use legacy ui

* better error handling

* make CORS preflight more explicit

* add GET method for CORS

* fix tests

* clean up a bit

* better auto scroll

* small fixes

* use collapse-arrow

* fix closeAndSaveConfigDialog

* small fix

* remove console.log

* fix style for <pre> element

* lighter bubble color (less distract when reading)
@ngxson
server : minor UI fix (ggerganov#10207)
76c6e7f
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Nov 8, 2024
@apicalshark apicalshark merged commit 9e3c483 into master Nov 8, 2024
10 checks passed
@apicalshark apicalshark deleted the temp branch November 8, 2024 02:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
devops documentation Improvements or additions to documentation examples ggml Nvidia GPU python script server SYCL testing
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.