Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Infinite loop with complex prompt in Mistral 7b #22

Closed
rsoika opened this issue Aug 2, 2024 · 0 comments
Closed

Infinite loop with complex prompt in Mistral 7b #22

rsoika opened this issue Aug 2, 2024 · 0 comments
Labels
bug Something isn't working testing
Milestone
1.1.0

Comments

@rsoika
Copy link
Member

rsoika commented Aug 2, 2024

If the prompt is very long we run in an infinite loop.
This problem seems to be discussed here

Maybe we should take more care about the context length and the \n. In the concrete case we have multiple newlines (more than 10 several times)
@rsoika rsoika added the bug Something isn't working label Aug 2, 2024
@rsoika rsoika added this to the 1.1.0 milestone Aug 2, 2024
rsoika added a commit that referenced this issue Aug 2, 2024
@rsoika
impl
e9e1d2f 
Issue #22
@rsoika rsoika added the testing label Aug 2, 2024
@rsoika rsoika closed this as completed Oct 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working testing
Projects
None yet
Milestone
1.1.0
Development

No branches or pull requests
1 participant
@rsoika