Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixes for training models with bf16 + freshly initialized optimizer via load_module_only #4141

Merged
merged 8 commits into from
Jan 18, 2024
Merged

Fixes for training models with bf16 + freshly initialized optimizer via load_module_only #4141

merged 8 commits into from
Jan 18, 2024

Commits on Aug 9, 2023

  1. commit 3 hacks

    @haileyschoelkopf
    haileyschoelkopf committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    1590973 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @haileyschoelkopf
    haileyschoelkopf committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    32fc3e9 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2023

  1. no longer need [None] check with better fixes

    haileyschoelkopf committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    8cbdbaa View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Merge branch 'master' into new-fix

    @haileyschoelkopf
    haileyschoelkopf authored Nov 7, 2023
    Configuration menu
    Copy the full SHA
    51aa22b View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Merge branch 'master' into new-fix

    @tjruwase
    tjruwase authored Dec 13, 2023
    Configuration menu
    Copy the full SHA
    3743929 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. Merge branch 'master' into new-fix

    @tjruwase
    tjruwase authored Jan 15, 2024
    Configuration menu
    Copy the full SHA
    64c7787 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. Merge branch 'master' into new-fix

    @loadams
    loadams authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    e11975f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into new-fix

    @loadams
    loadams authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    5797d3e View commit details
    Browse the repository at this point in the history