Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Serving Benchmark Refactoring #2433

Merged
merged 40 commits into from
Feb 13, 2024
Merged

Serving Benchmark Refactoring #2433

merged 40 commits into from
Feb 13, 2024

Commits on Jan 13, 2024

  1. initial refactor

    @ywang96
    ywang96 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    15cf77e View commit details
    Browse the repository at this point in the history

  2. iterate

    @ywang96
    ywang96 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    1a29d37 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2024

  1. iterate - add openai completions

    @ywang96
    ywang96 committed Jan 14, 2024
    Configuration menu
    Copy the full SHA
    5962f8a View commit details
    Browse the repository at this point in the history

  2. iterate

    @ywang96
    ywang96 committed Jan 14, 2024
    Configuration menu
    Copy the full SHA
    b3f41cb View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. add deepspeed-mii

    @ywang96
    ywang96 committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    1f31236 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. add trt-llm and cleanup

    @ywang96
    ywang96 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    fb871f4 View commit details
    Browse the repository at this point in the history

  2. fix top_p for TGI

    @ywang96
    ywang96 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    c36ee7f View commit details
    Browse the repository at this point in the history

  3. add endpoint arg

    @ywang96
    ywang96 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    8d44415 View commit details
    Browse the repository at this point in the history

  4. fix backend options

    @ywang96
    ywang96 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    e302f24 View commit details
    Browse the repository at this point in the history

  5. rename & format

    @ywang96
    ywang96 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    3610e29 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. dynamic backend choices

    @ywang96
    ywang96 committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    ebb7742 View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. changes from PR #2532

    @ywang96
    ywang96 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    4c11279 View commit details
    Browse the repository at this point in the history

  2. add streaming & remove openai dependency

    @ywang96
    ywang96 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    c3fa3a8 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. clean up and add note for deepspeed mii

    @ywang96
    ywang96 committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    941b51a View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. add ttfts to outputs

    @ywang96
    ywang96 committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    a09bd8b View commit details
    Browse the repository at this point in the history

  2. minor changes on commend args

    @ywang96
    ywang96 committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    95b206f View commit details
    Browse the repository at this point in the history

  3. typo

    @ywang96
    ywang96 committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    2dd2e93 View commit details
    Browse the repository at this point in the history

  4. minor edit on args

    @ywang96
    ywang96 committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    150e23e View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. fix mii payload & adding catch

    @ywang96
    ywang96 committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ae3d7c3 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2024

  1. convert metrics to dataclass

    @ywang96
    ywang96 committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    8a6dc51 View commit details
    Browse the repository at this point in the history

  2. refactor

    @ywang96
    ywang96 committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    d9838dd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into benchmark-refactor

    @ywang96
    ywang96 committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    7fff37c View commit details
    Browse the repository at this point in the history

  4. fix dataclasses

    @ywang96
    ywang96 committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    14c05fb View commit details
    Browse the repository at this point in the history

  5. fix import

    @ywang96
    ywang96 committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    b05a838 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. adding progressbar

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    59975d4 View commit details
    Browse the repository at this point in the history

  2. option to disable tqdm

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    a0f7971 View commit details
    Browse the repository at this point in the history

  3. add benchmark to ci

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    1c83ef3 View commit details
    Browse the repository at this point in the history

  4. add wget

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    8d51ed2 View commit details
    Browse the repository at this point in the history

  5. fix wget

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    a325bca View commit details
    Browse the repository at this point in the history

  6. replace wget with curl

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    f691f72 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into benchmark-refactor

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    693f282 View commit details
    Browse the repository at this point in the history

  8. ypaf

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    4ec4bc5 View commit details
    Browse the repository at this point in the history

  9. yapf

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    80574d8 View commit details
    Browse the repository at this point in the history

  10. fix CI

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    e42eb3e View commit details
    Browse the repository at this point in the history

  11. comments

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    af5be05 View commit details
    Browse the repository at this point in the history

  12. move files back to top-level

    @ywang96
    ywang96 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    5ce50df View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. inline common metrics

    @simon-mo
    simon-mo committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    1b7a2e9 View commit details
    Browse the repository at this point in the history

  2. add artifact upload

    @simon-mo
    simon-mo committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    43692d5 View commit details
    Browse the repository at this point in the history

  3. fix flag

    @simon-mo
    simon-mo committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    71984b0 View commit details
    Browse the repository at this point in the history

  4. Apply suggestions from code review

    @simon-mo
    simon-mo authored Feb 13, 2024
    Configuration menu
    Copy the full SHA
    78526b9 View commit details
    Browse the repository at this point in the history