Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Eliminate parallel worker per-step task scheduling overhead #4894

Merged
merged 7 commits into from
May 22, 2024
Merged

[Core] Eliminate parallel worker per-step task scheduling overhead #4894

merged 7 commits into from
May 22, 2024

Commits on May 18, 2024

  1. [Core] Eliminate parallel worker per-step task scheduling overhead

    @njhill
    njhill committed May 18, 2024
    Configuration menu
    Copy the full SHA
    4f644da View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Merge remote-tracking branch 'refs/remotes/origin/main' into streamli… 

    …ne-tp-new
    @njhill
    njhill committed May 21, 2024
    Configuration menu
    Copy the full SHA
    e81f5b8 View commit details
    Browse the repository at this point in the history

  2. Address @rkooo567 review comments, add missed stop_execution_loop method

    @njhill
    njhill committed May 21, 2024
    Configuration menu
    Copy the full SHA
    35626d5 View commit details
    Browse the repository at this point in the history

  3. Support TP speculative decoding

    @njhill
    njhill committed May 21, 2024
    Configuration menu
    Copy the full SHA
    9d17755 View commit details
    Browse the repository at this point in the history

  4. Fix arg name

    @njhill
    njhill committed May 21, 2024
    Configuration menu
    Copy the full SHA
    b67ed6c View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge remote-tracking branch 'refs/remotes/origin/main' into streamli… 

    …ne-tp-new
    @njhill
    njhill committed May 22, 2024
    Configuration menu
    Copy the full SHA
    104e7fe View commit details
    Browse the repository at this point in the history

  2. Fix spec decoding; add more detail to comments

    @njhill
    njhill committed May 22, 2024
    Configuration menu
    Copy the full SHA
    7722474 View commit details
    Browse the repository at this point in the history