Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the eos token to exllama bad words. #65

Merged
merged 1 commit into from
Aug 28, 2023
Merged

Add the eos token to exllama bad words. #65

merged 1 commit into from
Aug 28, 2023

Commits on Aug 27, 2023

  1. Add the eos token to exllama bad words. 

    The bos token was already hardcoded as a bad word id.
Store badwords in a list and iterate over them during generation.
Add the Llama eos token to the list of bad words.
Also support "single line mode", which adds newline (13) to badwords.
    @pi6am
    pi6am committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    08ff7c1 View commit details
    Browse the repository at this point in the history