-
Notifications
You must be signed in to change notification settings - Fork 11.2k
Pull requests: ggml-org/llama.cpp
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Q4_0 scale selection using RMSE
enhancement
New feature or request
Less than 4 bits
Efforts related to viable quantized models using <4 bits
research 🔬
Review Complexity : High
Generally require indepth knowledge of LLMs or GPUs
Run several single thread operators parellel
threading
Parallel processing and thread management
#850
opened Apr 8, 2023 by
howard0su
Add command mode to interactive mode.
enhancement
New feature or request
Review Complexity : Medium
Generally require more time to grok but manageable by beginner to medium expertise level
#1022
opened Apr 17, 2023 by
wbpxre150
Add a option to force the token end of text apears even on interative, and also shows loading porcentage
#1058
opened Apr 19, 2023 by
jeffersoncgo
Create run.py
enhancement
New feature or request
obsolete?
Marker for potentially obsolete PR
python
python script changes
Review Complexity : Low
Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix
script
Script related
#1204
opened Apr 27, 2023 by
jdpsl
Loading…
Add "-e"/"--eval-threads" to distinguish thread counts for single-token eval and prompt eval
threading
Parallel processing and thread management
#744
opened Apr 3, 2023 by
MagisterLuddite
•
Draft
ggml : spread compute across threads in chunks
demo
Demonstrate some concept or idea, not intended to be merged
threading
Parallel processing and thread management
#1507
opened May 17, 2023 by
ggerganov
Loading…
Added Arbitrary mixed quantization
Less than 4 bits
Efforts related to viable quantized models using <4 bits
research 🔬
#1834
opened Jun 13, 2023 by
Milkdrop
Loading…
Draft: #1776 making bos and eos available for user input
#1986
opened Jun 24, 2023 by
HashemAlsaket
•
Draft
Avoid unused constant warnings
refactoring
Refactoring
Review Complexity : Low
Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix
#2029
opened Jun 28, 2023 by
set-soft
Loading…
Previous Next
ProTip!
Find all pull requests that aren't related to any open issues with -linked:issue.