Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ggerganov master to upstreamchanges #2

Closed
wants to merge 7 commits into from
Closed

ggerganov master to upstreamchanges #2

wants to merge 7 commits into from

Conversation

YellowRoseCx
Copy link
Owner

No description provided.

katsu560 and others added 7 commits April 15, 2023 08:51
@katsu560
cmake : add finding the OpenBLAS header file (#992)
106faaf
@dfyz
benchmark : fix result validation in benchmark-q4_0-matmult (#987)
c12b14b
@ggerganov
ggml : use posix_memalign on non-Windows env
aa485ce
@ggerganov @sw
ggml : add Q8_0 quantization for intermediate results (#951)
e95b655 
* ggml : add Q8_0 quantization for intermediate results

* quantize-stats : fix test + add it to Makefile default

* Q8: use int8_t, AVX/AVX2 optimizations

* ggml : fix quantize_row_q8_0() ARM_NEON rounding

* minor : updates after rebase to latest master

* quantize-stats : delete obsolete strings

* ggml : fix q4_1 dot func

---------

Co-authored-by: Stephan Walter <stephan@walter.name>
@sw
Refactor ggml.c for future tensor types (#1001)
0ad9646
@sw
Fix potential int8 overflow in non-SIMD vec_dot (#986)
2f7c8e0
@comex
convert.py: Fix loading safetensors and ggml format on Windows (#991)
74f5899 
Calling `mmap.mmap` on Windows apparently resets the file offset of the
raw file object (and makes the BufferedReader return a *negative* file
offset).  For safetensors, avoid using the file offset after calling
mmap.  For GGML format, explicitly save and restore the offset.

Fixes #966.
@YellowRoseCx YellowRoseCx self-assigned this Apr 15, 2023
YellowRoseCx pushed a commit that referenced this pull request Oct 9, 2023
@vvhg1 @cebtenzzre
infill : add new example + extend server API (ggerganov#3296)
c97f01c 
* vvhg-code-infill (#1)

* infill in separate example (#2)

* reverted changes to main and added infill example

* cleanup

* naming improvement

* make : add missing blank line

* fix missing semicolon

* brought infill up to current main code

* cleanup

---------

Co-authored-by: Cebtenzzre <cebtenzzre@gmail.com>
YellowRoseCx pushed a commit that referenced this pull request Jul 26, 2024
@BBC-Esq
Streamline with fstrings (LostRuins#1006)
ce971a0 
* fstring #1

* fstring #2
YellowRoseCx pushed a commit that referenced this pull request Jul 26, 2024
@BBC-Esq
Streamline with dictionaries (LostRuins#1005)
7de1ebf 
* dictionary #1

* dictionary #2
YellowRoseCx pushed a commit that referenced this pull request Oct 13, 2024
@rgerganov @0cc4m
vulkan : do not use tensor->extra (ggerganov#9407)
00b7317 
* vulkan : do not use tensor->extra

This patch allows using the Vulkan backend with the RPC backend as
tensor->extra is no longer used.

Ref: ggerganov#8536

* Adapt GGML_VULKAN_CHECK_RESULTS to extra removal (#2)

---------

Co-authored-by: 0cc4m <picard12@live.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@YellowRoseCx YellowRoseCx

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@YellowRoseCx @katsu560 @dfyz @ggerganov @sw @comex