Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update submodules #146

Closed
4 tasks done
github-actions bot opened this issue Oct 15, 2024 · 4 comments
Closed
4 tasks done

Update submodules #146

github-actions bot opened this issue Oct 15, 2024 · 4 comments
Assignees
@iboB
Labels
refactor Refactoring existing code

Comments

@github-actions
Copy link

github-actions bot commented Oct 15, 2024 •
edited by iboB
Loading

It's time to update our forks and submodules. Check for upstream updates and merge them if necessary.

Don't forget to use the guide.

Subbmodules to update:

  • inference/ggml
  • inference/llama.cpp/llama.cpp
  • inference/whisper/whisper.cpp
  • wrapper/java/jni.hpp
@github-actions github-actions bot added the refactor Refactoring existing code label Oct 15, 2024
@iboB iboB self-assigned this Oct 23, 2024
@iboB iboB moved this from Todo to In Progress in Local SDK MVP Oct 28, 2024
@iboB
Copy link
Member

iboB commented Oct 28, 2024

llama_sampler_init_softmax will be removed in the future (see ggerganov/llama.cpp#9896 (comment))

@iboB
Copy link
Member

iboB commented Oct 28, 2024

llama_batch_get_one interface has changed. New sampling API

iboB added a commit that referenced this issue Oct 28, 2024
@iboB
chore: update inference submodules, ref #146
429a833
iboB added a commit that referenced this issue Oct 28, 2024
@iboB
fix(llama): remove old style greedy sampling, ref #146
35ef2b5
iboB added a commit that referenced this issue Oct 28, 2024
@iboB
feat(llama): add infill and xtc sampling, ref #146
2244c90
@iboB
Copy link
Member

iboB commented Oct 28, 2024

adding two new samplers

@iboB
Copy link
Member

iboB commented Oct 28, 2024

done

@iboB iboB closed this as completed Oct 28, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in Local SDK MVP Oct 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iboB iboB

Labels
refactor Refactoring existing code
Projects
No open projects
Local SDK MVP
Status: Done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@iboB