Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add embedding.json #8

Merged
merged 2 commits into from
Sep 1, 2024
Merged

Add embedding.json #8

merged 2 commits into from
Sep 1, 2024

Conversation

L-jasmine
Copy link
Collaborator

No description provided.

@L-jasmine
Add embedding.json
5e118fc 
Signed-off-by: csh <458761603@qq.com>
@L-jasmine L-jasmine mentioned this pull request Sep 1, 2024
Merged
juntao
juntao reviewed Sep 1, 2024
View reviewed changes
Copy link
Contributor

@juntao juntao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please note that the "vector size" is 768 and the "context size" is 8192 for this model.

When we start this model on llama-api-server, we use

ctx-size 8192
batch-size 8192

@L-jasmine
fix embedding.json ctx
d37fd01 
Signed-off-by: csh <458761603@qq.com>
@juntao juntao merged commit 8fe37e1 into moxin-org:main Sep 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@juntao juntao juntao approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@L-jasmine @juntao