Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[inference] Support wint4 groupwise with cutlass gemm #60422

Merged
merged 25 commits into from
Jan 4, 2024
Merged

[inference] Support wint4 groupwise with cutlass gemm #60422

merged 25 commits into from
Jan 4, 2024

Commits on Dec 20, 2023

  1. support gemv-groupwise func && weightQuanter-groupwise && weightDeQua… 

    …nter-groupwise
    @freeliuzc
    freeliuzc committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    972b7f5 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2023

  1. fix build bug

    @freeliuzc
    freeliuzc committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    3f4d1ee View commit details
    Browse the repository at this point in the history

  2. add unit_test && fix bug

    @freeliuzc
    freeliuzc committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    d6ab5a8 View commit details
    Browse the repository at this point in the history

  3. delete useless code

    @freeliuzc
    freeliuzc committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    022249c View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2023

  1. fix ci build bug

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    191dab9 View commit details
    Browse the repository at this point in the history

  2. fix ci && optimize

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    b4e1a24 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into support_wint4_groupwise

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    f8a3ae4 View commit details
    Browse the repository at this point in the history

  4. fix merge conflict

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    a7fd55d View commit details
    Browse the repository at this point in the history

  5. add op change info

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    54d4bf3 View commit details
    Browse the repository at this point in the history

  6. fix weight_only_linear_pass

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    97e9192 View commit details
    Browse the repository at this point in the history

  7. fix format

    @freeliuzc
    freeliuzc committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    00df552 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. Merge branch 'develop' into support_wint4_groupwise

    @freeliuzc
    freeliuzc committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    d78abf8 View commit details
    Browse the repository at this point in the history

  2. solve ci unit_test

    @freeliuzc
    freeliuzc committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    ca7a061 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2023

  1. init

    @freeliuzc
    freeliuzc committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    84c1e03 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into support_cutlass_gemm_groupwise

    @freeliuzc
    freeliuzc committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    93fb4ea View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. support cutlass gemm with groupwise

    @freeliuzc
    freeliuzc committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    1ab1c5e View commit details
    Browse the repository at this point in the history

  2. add unit test

    @freeliuzc
    freeliuzc committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    2d8b37f View commit details
    Browse the repository at this point in the history

  3. fix strange bug

    @freeliuzc
    freeliuzc committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    ee05cca View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2023

  1. delete random bug

    @freeliuzc
    freeliuzc committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    99576fe View commit details
    Browse the repository at this point in the history

  2. fix sm70 build bug

    @freeliuzc
    freeliuzc committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    6a35aa7 View commit details
    Browse the repository at this point in the history

  3. try to fix ci build bug

    @freeliuzc
    freeliuzc committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    15dce6a View commit details
    Browse the repository at this point in the history

  4. fix bug

    @freeliuzc
    freeliuzc committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    ed29434 View commit details
    Browse the repository at this point in the history

  5. fix volta build bug

    @freeliuzc
    freeliuzc committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    8f5cd6b View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. skip sm70 in groupwise mode

    @freeliuzc
    freeliuzc committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    ececa85 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. change cutlass branch

    @freeliuzc
    freeliuzc committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    8d5f154 View commit details
    Browse the repository at this point in the history