Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGML_ASSERT: ggml.c:4014: false zsh: abort ./main -m ./models/65B/ggml-model-q4_0.bin -t 16 -n 256 --repeat_penalty 1.0 #400

Closed
nazthelizard122 opened this issue Mar 22, 2023 · 5 comments
Closed

GGML_ASSERT: ggml.c:4014: false zsh: abort ./main -m ./models/65B/ggml-model-q4_0.bin -t 16 -n 256 --repeat_penalty 1.0 #400

nazthelizard122 opened this issue Mar 22, 2023 · 5 comments
Labels
need more info The OP should provide more details about the issue

Comments

@nazthelizard122
Copy link

Not sure why this happens, I am on the latest commit and I am up-to-date on everything
I did some tests and it seems like it breaks after 500~ tokens
Is this a model limitation or can I fix this by increasing some value?
@gjmulder gjmulder added the question Further information is requested label Mar 22, 2023
@gjmulder
Copy link
Collaborator

Please review and use our issue template to provide more details so we can better understand your problem and answer you.

@gjmulder gjmulder added need more info The OP should provide more details about the issue and removed question Further information is requested labels Mar 22, 2023
@nazthelizard122
Copy link
Author

Idk how to use it

@gjmulder
Copy link
Collaborator

Sorry, better link

Copy everything from line 10 and try to complete as requested.

@nazthelizard122
Copy link
Author

idk how to get the check mark

@nazthelizard122
Copy link
Author

now I'm running into another error, it segfaults with the regular script

@sw sw closed this as not planned Won't fix, can't repro, duplicate, stale Apr 19, 2023
@Bearsaerker Bearsaerker mentioned this issue Mar 12, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
need more info The OP should provide more details about the issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sw @gjmulder @nazthelizard122