Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling #3103

Merged
merged 73 commits into from
Mar 9, 2024
Merged

[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling #3103

merged 73 commits into from
Mar 9, 2024

Commits on Feb 24, 2024

  1. first test passes

    @cadedaniel
    cadedaniel committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    d74ff5c View commit details
    Browse the repository at this point in the history

  2. test

    @cadedaniel
    cadedaniel committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    74b5c48 View commit details
    Browse the repository at this point in the history

  3. test

    @cadedaniel
    cadedaniel committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    f6a730b View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    aafebd0 View commit details
    Browse the repository at this point in the history

  2. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    415db01 View commit details
    Browse the repository at this point in the history

  3. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    76dfe1a View commit details
    Browse the repository at this point in the history

  4. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    069b564 View commit details
    Browse the repository at this point in the history

  5. test for metrics, separate out metrics functionality

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    7f13ccd View commit details
    Browse the repository at this point in the history

  6. metrics test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    c91a55b View commit details
    Browse the repository at this point in the history

  7. clean

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    3a69d54 View commit details
    Browse the repository at this point in the history

  8. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    73212b7 View commit details
    Browse the repository at this point in the history

  9. fixes

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    f796ab0 View commit details
    Browse the repository at this point in the history

  10. nvtx_range

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    384dc9d View commit details
    Browse the repository at this point in the history

  11. profile and cache tests

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    2d1a192 View commit details
    Browse the repository at this point in the history

  12. test

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    bec5cba View commit details
    Browse the repository at this point in the history

  13. Merge remote-tracking branch 'upstream/main' into draft-target-worker

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    273baea View commit details
    Browse the repository at this point in the history

  14. lint

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    7a18f37 View commit details
    Browse the repository at this point in the history

  15. attempt add tests to ci

    @cadedaniel
    cadedaniel committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    4eb8e04 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. refactor outline

    @cadedaniel
    cadedaniel committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    e0ec4b4 View commit details
    Browse the repository at this point in the history

  2. wip

    @cadedaniel
    cadedaniel committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    b7e580b View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. WIP

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    665ed8e View commit details
    Browse the repository at this point in the history

  2. sampler mock raw tensors

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    8fcb257 View commit details
    Browse the repository at this point in the history

  3. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    79a1f6c View commit details
    Browse the repository at this point in the history

  4. asd

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    7a42183 View commit details
    Browse the repository at this point in the history

  5. asd

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    c86b44e View commit details
    Browse the repository at this point in the history

  6. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    f5e5d76 View commit details
    Browse the repository at this point in the history

  7. bugfix

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    68284ed View commit details
    Browse the repository at this point in the history

  8. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    87cc31a View commit details
    Browse the repository at this point in the history

  9. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    c142006 View commit details
    Browse the repository at this point in the history

  10. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    c026de9 View commit details
    Browse the repository at this point in the history

  11. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    1486a84 View commit details
    Browse the repository at this point in the history

  12. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    264b5cb View commit details
    Browse the repository at this point in the history

  13. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    8cc8caf View commit details
    Browse the repository at this point in the history

  14. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    ee1efff View commit details
    Browse the repository at this point in the history

  15. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    cadac54 View commit details
    Browse the repository at this point in the history

  16. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    2c2dd86 View commit details
    Browse the repository at this point in the history

  17. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    b112463 View commit details
    Browse the repository at this point in the history

  18. wip

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    e09c666 View commit details
    Browse the repository at this point in the history

  19. fix

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    807aa02 View commit details
    Browse the repository at this point in the history

  20. clean

    @cadedaniel
    cadedaniel committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    5545e73 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    49c9798 View commit details
    Browse the repository at this point in the history

  2. remove

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    978a711 View commit details
    Browse the repository at this point in the history

  3. clean

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    d548db4 View commit details
    Browse the repository at this point in the history

  4. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    a277fe0 View commit details
    Browse the repository at this point in the history

  5. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    c1357d6 View commit details
    Browse the repository at this point in the history

  6. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    136a59b View commit details
    Browse the repository at this point in the history

  7. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    5657feb View commit details
    Browse the repository at this point in the history

  8. rename

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    059beba View commit details
    Browse the repository at this point in the history

  9. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    4ce7119 View commit details
    Browse the repository at this point in the history

  10. clean

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    db52bee View commit details
    Browse the repository at this point in the history

  11. clean

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    20297f2 View commit details
    Browse the repository at this point in the history

  12. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    13aebbf View commit details
    Browse the repository at this point in the history

  13. clean

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    524ada4 View commit details
    Browse the repository at this point in the history

  14. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    e3f57b0 View commit details
    Browse the repository at this point in the history

  15. clean

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    aff7a34 View commit details
    Browse the repository at this point in the history

  16. rename

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    c2beb94 View commit details
    Browse the repository at this point in the history

  17. first autoformat

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    2c835de View commit details
    Browse the repository at this point in the history

  18. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    292c34f View commit details
    Browse the repository at this point in the history

  19. wip

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    c387d56 View commit details
    Browse the repository at this point in the history

  20. move

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    39382b7 View commit details
    Browse the repository at this point in the history

  21. move

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    f78325c View commit details
    Browse the repository at this point in the history

  22. move

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    5cafc12 View commit details
    Browse the repository at this point in the history

  23. name

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    3a5dcfb View commit details
    Browse the repository at this point in the history

  24. sequence test and docs

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    8e7ee97 View commit details
    Browse the repository at this point in the history

  25. docs

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    e5e334f View commit details
    Browse the repository at this point in the history

  26. lint

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    2d27c57 View commit details
    Browse the repository at this point in the history

  27. typo

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    3c61a52 View commit details
    Browse the repository at this point in the history

  28. Merge remote-tracking branch 'upstream/main' into draft-target-worker

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    be66076 View commit details
    Browse the repository at this point in the history

  29. lint

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    b165a73 View commit details
    Browse the repository at this point in the history

  30. fix test

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    17725fb View commit details
    Browse the repository at this point in the history

  31. Merge remote-tracking branch 'upstream/main' into draft-target-worker

    @cadedaniel
    cadedaniel committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    364a415 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2024

  1. pr feedback

    @cadedaniel
    cadedaniel committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    11b6f39 View commit details
    Browse the repository at this point in the history

  2. better comment

    @cadedaniel
    cadedaniel committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    ab00fcf View commit details
    Browse the repository at this point in the history