Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Surpport kv cache int8/int4 for triton backend #1644

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

Surpport kv cache int8/int4 for triton backend #1644

wants to merge 12 commits into from
+3,258 −66

Commits on Oct 12, 2024

  1. surpport kv cache int8/int4 for triton backend

    @yuguo-Jack
    yuguo-Jack committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    c885e1f View commit details
    Browse the repository at this point in the history

  2. fix code style

    @yuguo-Jack
    yuguo-Jack committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    6bb1035 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into fork

    @yuguo-Jack
    yuguo-Jack authored Oct 12, 2024
    Configuration menu
    Copy the full SHA
    f7ccfe1 View commit details
    Browse the repository at this point in the history

  4. fix

    @yuguo-Jack
    yuguo-Jack committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    9ef8a84 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. fix mem_pool

    @yuguo-Jack
    yuguo-Jack committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    e5e46c2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/sgl-project/sglang into fork

    @yuguo-Jack
    yuguo-Jack committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    3cbee66 View commit details
    Browse the repository at this point in the history

  3. fix code style

    @yuguo-Jack
    yuguo-Jack committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    42c27ef View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into fork

    @yuguo-Jack
    yuguo-Jack authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    fe6d8c8 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Merge branch 'main' into fork

    @yuguo-Jack
    yuguo-Jack authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    8418289 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Merge branch 'main' of https://github.com/sgl-project/sglang into fork

    @yuguo-Jack
    yuguo-Jack committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    6b9067b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'fork' of https://github.com/yuguo-Jack/sglang into fork

    @yuguo-Jack
    yuguo-Jack committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    af88ae6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/sgl-project/sglang into fork

    @yuguo-Jack
    yuguo-Jack committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    8cf4a33 View commit details
    Browse the repository at this point in the history