Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[PyTorch] Bugfix for wgrad bulk overlap conflict when dgrad overlap is reduce-scatter #1341

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

[PyTorch] Bugfix for wgrad bulk overlap conflict when dgrad overlap is reduce-scatter #1341

wants to merge 4 commits into from

Commits on Nov 22, 2024

  1. fixed bug where the bulk wgrad config was not being disabled when rs … 

    …dgrad overlap is enabled

Signed-off-by: Alp Dener <adener@nvidia.com>
    @denera
    denera committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    89f99c3 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci @denera
    pre-commit-ci[bot] authored and denera committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    63a1393 View commit details
    Browse the repository at this point in the history

  3. Fix linter warning 

    Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
    @timmoon10 @denera
    timmoon10 authored and denera committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    ead250e View commit details
    Browse the repository at this point in the history

  4. fixed incorrect kwarg name in TP overlap test 

    Signed-off-by: Alp Dener <adener@nvidia.com>
    @denera
    denera committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2ca29de View commit details
    Browse the repository at this point in the history