Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix n^2 loop in tokenization #254

Merged
merged 1 commit into from
Mar 18, 2023
Merged

Fix n^2 loop in tokenization #254

merged 1 commit into from
Mar 18, 2023

Conversation

glinscott
Copy link
Collaborator

This causes long prompts to parse very slowly (and looks like it was intended to use max_len here).

Verified

This commit was signed with the committer’s verified signature.
emilio Emilio Cobos Álvarez
This causes long prompts to parse very slowly.
@sw sw merged commit a81d0c2 into ggml-org:master Mar 18, 2023
mudler pushed a commit to go-skynet/llama that referenced this pull request Mar 19, 2023
This causes long prompts to parse very slowly.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants