Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Speculative decoding][Re-take] Enable TP>1 speculative decoding #4840

Merged
merged 20 commits into from
May 16, 2024
Merged

[Speculative decoding][Re-take] Enable TP>1 speculative decoding #4840

merged 20 commits into from
May 16, 2024

Commits on May 9, 2024

  1. hacks for tp gt 1

    @cadedaniel
    cadedaniel committed May 9, 2024
    Configuration menu
    Copy the full SHA
    6681459 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. wip clean up spec worker

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    bfcf524 View commit details
    Browse the repository at this point in the history

  2. fix

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4da918f View commit details
    Browse the repository at this point in the history

  3. fix

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    75b84bd View commit details
    Browse the repository at this point in the history

  4. fix

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    048145d View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/main' into tp_gt_1

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    6572fab View commit details
    Browse the repository at this point in the history

  6. fix

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    38c9710 View commit details
    Browse the repository at this point in the history

  7. clean

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    3072caa View commit details
    Browse the repository at this point in the history

  8. clean

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    b680d42 View commit details
    Browse the repository at this point in the history

  9. format

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    91d2c3e View commit details
    Browse the repository at this point in the history

  10. fix nccl failures

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d2dcf84 View commit details
    Browse the repository at this point in the history

  11. lint

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    9340502 View commit details
    Browse the repository at this point in the history

  12. ngram test

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    86dde18 View commit details
    Browse the repository at this point in the history

  13. comment

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ddcdef7 View commit details
    Browse the repository at this point in the history

  14. format

    @cadedaniel
    cadedaniel committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ca42fc3 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. fix tests

    @comaniac
    comaniac committed May 15, 2024
    Configuration menu
    Copy the full SHA
    9c4347a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into cody/tp_gt_1

    @comaniac
    comaniac committed May 15, 2024
    Configuration menu
    Copy the full SHA
    c976199 View commit details
    Browse the repository at this point in the history

  3. add test

    @comaniac
    comaniac committed May 15, 2024
    Configuration menu
    Copy the full SHA
    9ddeab3 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. disable hip

    @comaniac
    comaniac authored May 16, 2024
    Configuration menu
    Copy the full SHA
    7e52660 View commit details
    Browse the repository at this point in the history

  2. format

    @comaniac
    comaniac committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b98a60d View commit details
    Browse the repository at this point in the history