Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support split qkv linear and sp overlap comm #415

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

support split qkv linear and sp overlap comm #415

wants to merge 13 commits into from

Commits on Jun 5, 2024

  1. fix rope precision for long context

    @inkcherry
    inkcherry committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    8bda975 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. enable o_compute aynsc

    @inkcherry
    inkcherry committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    2e69e22 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. enable qk_bwd_ayncall2all

    @inkcherry
    inkcherry committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    f78b8f5 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. fwd optim

    @inkcherry
    inkcherry committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    0be1080 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. fix arg

    @inkcherry
    inkcherry committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    bdc9f91 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. use current_stream

    @inkcherry
    inkcherry committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    e9f8e99 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'my_mega/fwd_optimim'

    @inkcherry
    inkcherry committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    b35b4d0 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. split qkv + sp overlap comm

    @inkcherry
    inkcherry committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    231d2e9 View commit details
    Browse the repository at this point in the history

  2. revert rope change

    @inkcherry
    inkcherry committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    35d6d54 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Merge branch 'main' into split_qkv_overlap_comm

    @inkcherry
    inkcherry committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    191fbf7 View commit details
    Browse the repository at this point in the history

  2. fix merge

    @inkcherry
    inkcherry committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    08fedf4 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Merge branch 'origin' into HEAD

    @inkcherry
    inkcherry committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    62baaec View commit details
    Browse the repository at this point in the history

  2. merge branch

    @inkcherry
    inkcherry committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    8516213 View commit details
    Browse the repository at this point in the history