Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

per-micro-batch input loader #5635

Merged
merged 20 commits into from
Feb 9, 2023
Merged

per-micro-batch input loader #5635

merged 20 commits into from
Feb 9, 2023

Commits on Feb 7, 2023

  1. per-micro-batch input loader

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    f097c4a View commit details
    Browse the repository at this point in the history

  2. per-micro-batch input loader 

    set arg default val
    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    14cdcd4 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci @erhoo82
    pre-commit-ci[bot] authored and erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    3574676 View commit details
    Browse the repository at this point in the history

  4. minor fix

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    dab2118 View commit details
    Browse the repository at this point in the history

  5. apply per-microbatch-loader to only GPT

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    4979f7e View commit details
    Browse the repository at this point in the history

  6. update docstring on micro-batch input loader

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    be04e8c View commit details
    Browse the repository at this point in the history

  7. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci @erhoo82
    pre-commit-ci[bot] authored and erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    8acf409 View commit details
    Browse the repository at this point in the history

  8. fixed the default arg val

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    cf4d85f View commit details
    Browse the repository at this point in the history

  9. fix batch size to 1 at log stat registration

    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    6561d3b View commit details
    Browse the repository at this point in the history

  10. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci @erhoo82
    pre-commit-ci[bot] authored and erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    f3eb580 View commit details
    Browse the repository at this point in the history

  11. update container for CI 

    Signed-off-by: ericharper <complex451@gmail.com>
    @ericharper @erhoo82
    ericharper authored and erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    4efc72e View commit details
    Browse the repository at this point in the history

  12. update container in jenkinsfile 

    Signed-off-by: ericharper <complex451@gmail.com>
    @ericharper
    ericharper committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    8d82f15 View commit details
    Browse the repository at this point in the history

  13. update container for CI 

    Signed-off-by: ericharper <complex451@gmail.com>

fix merge conflict
    @ericharper @erhoo82
    ericharper authored and erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    817cc89 View commit details
    Browse the repository at this point in the history

  14. Merge branch 'slym/per_microbatch_loader' of https://github.com/NVIDI… 

    …A/NeMo into slym/per_microbatch_loader
    @erhoo82
    erhoo82 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    a3dcb84 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. revert Jenkinsfile

    @erhoo82
    erhoo82 committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    d23b775 View commit details
    Browse the repository at this point in the history

  2. Revert "revert Jenkinsfile" 

    This reverts commit d23b775.
    @erhoo82
    erhoo82 committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    8b5ac9a View commit details
    Browse the repository at this point in the history

  3. Update nemo/collections/nlp/models/language_modeling/megatron_gpt_mod… 

    …el.py

Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
    @timmoon10
    timmoon10 committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    8068ad7 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2023

  1. Merge branch 'main' into slym/per_microbatch_loader

    @ericharper
    ericharper committed Feb 9, 2023
    Configuration menu
    Copy the full SHA
    139231a View commit details
    Browse the repository at this point in the history

  2. add GradScaler

    @erhoo82
    erhoo82 committed Feb 9, 2023
    Configuration menu
    Copy the full SHA
    001a467 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 9, 2023
    Configuration menu
    Copy the full SHA
    c2a1763 View commit details
    Browse the repository at this point in the history