Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix max_position_embeddings default value for llama2 to 4096 #28241 #28754

Merged
merged 6 commits into from
Feb 9, 2024
Merged

Fix max_position_embeddings default value for llama2 to 4096 #28241 #28754

merged 6 commits into from
Feb 9, 2024

Commits on Jan 29, 2024

  1. Changed max_position_embeddings default value from 2048 to 4096

    @karl-hajjar
    karl-hajjar committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    0dfd39e View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. force push

    @karl-hajjar
    karl-hajjar committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    21a08a1 View commit details
    Browse the repository at this point in the history

  2. Fixed formatting issues. Fixed missing argument in write_model.

    @karl-hajjar
    karl-hajjar committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    a3fc357 View commit details
    Browse the repository at this point in the history

  3. Reverted to the default value 2048 in the Llama config. Added comment… 

    …s for the llama_version argument.
    @karl-hajjar
    karl-hajjar committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    b5a9788 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Fixed issue with default value value of max_position_embeddings in do… 

    …cstring
    @karl-hajjar
    karl-hajjar committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    4792f49 View commit details
    Browse the repository at this point in the history

  2. Updated help message for llama versions 

    Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
    @karl-hajjar @amyeroberts
    karl-hajjar and amyeroberts authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    51adf95 View commit details
    Browse the repository at this point in the history