Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dev attention[SiliconFlow] #236

Open
wants to merge 12 commits into
base: master
Choose a base branch
from
Open

Dev attention[SiliconFlow] #236

wants to merge 12 commits into from

Commits on Oct 16, 2024

  1. init attention

    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    173576f View commit details
    Browse the repository at this point in the history

  2. triton 2.3.0 cannot use make blockptr like turtial, change to use ori… 

    …gin tl.load
    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    4dca5a9 View commit details
    Browse the repository at this point in the history

  3. fix some name and add gqa support

    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    2b316c0 View commit details
    Browse the repository at this point in the history

  4. support query, kv different seqlen

    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    75e1c39 View commit details
    Browse the repository at this point in the history

  5. support attn bias

    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    21742be View commit details
    Browse the repository at this point in the history

  6. add mask to prevent illegal mem access, add unittest

    @MARD1NO
    MARD1NO committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    de380d2 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. add perf script

    @MARD1NO
    MARD1NO committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    1f453d3 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. add coverage test for attention

    @MARD1NO
    MARD1NO committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    60d6ecf View commit details
    Browse the repository at this point in the history

  2. refine test script

    @MARD1NO
    MARD1NO committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    3b05813 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. fix perf script

    @MARD1NO
    MARD1NO committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    934650c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into dev_attention

    @MARD1NO
    MARD1NO committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    5f99222 View commit details
    Browse the repository at this point in the history

  3. fix unittest. remove writing M

    @MARD1NO
    MARD1NO committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    bf85f9d View commit details
    Browse the repository at this point in the history