Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add util for ram efficient loading of model when using fsdp #25107

Merged
merged 16 commits into from
Aug 17, 2023
Merged

add util for ram efficient loading of model when using fsdp #25107

merged 16 commits into from
Aug 17, 2023

Commits on Jul 26, 2023

  1. add util for ram efficient loading of model when using fsdp

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e8873d9 View commit details
    Browse the repository at this point in the history

  2. make fix-copies

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    6f34229 View commit details
    Browse the repository at this point in the history

  3. fixes 😅

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    67d13df View commit details
    Browse the repository at this point in the history

  4. docs

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    fb99633 View commit details
    Browse the repository at this point in the history

  5. making it further easier to use

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    a48cc1a View commit details
    Browse the repository at this point in the history

  6. rename the function

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    6388596 View commit details
    Browse the repository at this point in the history

  7. refactor to handle fsdp ram efficiency in from_pretrained

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    b18a103 View commit details
    Browse the repository at this point in the history

  8. fixes

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    353fa8a View commit details
    Browse the repository at this point in the history

  9. fixes

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    3442100 View commit details
    Browse the repository at this point in the history

  10. fixes

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e75646d View commit details
    Browse the repository at this point in the history

  11. update

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    79351ae View commit details
    Browse the repository at this point in the history

  12. fixes

    @pacman100
    pacman100 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    2a5acd1 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. revert load_pretrained_model_only_on_rank0

    @pacman100
    pacman100 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    449afd4 View commit details
    Browse the repository at this point in the history

  2. resolve load_from_checkpoint

    @pacman100
    pacman100 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    3adfddd View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. Merge branch 'main' into smangrul/fsdp_cpu_ram_efficient_model_loadin… 

    …g_util
    @pacman100
    pacman100 committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    dd8fe12 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2023

  1. Merge branch 'main' into smangrul/fsdp_cpu_ram_efficient_model_loadin… 

    …g_util
    @pacman100
    pacman100 committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    ea48377 View commit details
    Browse the repository at this point in the history