Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add fused attention op backward and python layer. #36498

Merged
merged 62 commits into from
Oct 26, 2021
Merged

Add fused attention op backward and python layer. #36498

merged 62 commits into from
Oct 26, 2021

Commits on Sep 22, 2021

  1. Add fused_attention_op: add impl wrappers.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    f5eee9f View commit details
    Browse the repository at this point in the history

  2. Add fused_attention_op: forward.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    e16e3b3 View commit details
    Browse the repository at this point in the history

  3. Add fused_attention_op: forward impl.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    42f0372 View commit details
    Browse the repository at this point in the history

  4. Remove useless code.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    c6aebef View commit details
    Browse the repository at this point in the history

  5. Remove useless code.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    2c0ab6c View commit details
    Browse the repository at this point in the history

  6. Remove docs.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    ece3c08 View commit details
    Browse the repository at this point in the history

  7. Minors.

    @limin2021
    limin2021 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    b18b405 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2021

  1. Minors.

    @limin2021
    limin2021 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    b939159 View commit details
    Browse the repository at this point in the history

  2. Update test_fused_attention_op.py

    @limin2021
    limin2021 authored Sep 23, 2021
    Configuration menu
    Copy the full SHA
    07fd753 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'PaddlePaddle:develop' into fused_attention_op_2_fw

    @limin2021
    limin2021 authored Sep 23, 2021
    Configuration menu
    Copy the full SHA
    ef89a94 View commit details
    Browse the repository at this point in the history

  4. Remove static construction of python api.

    @limin2021
    limin2021 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    b44d882 View commit details
    Browse the repository at this point in the history

  5. Modifications accordding to reviews.

    @limin2021
    limin2021 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    ff3df46 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2021

  1. Modifications accordding to Xreki's review.

    @limin2021
    limin2021 committed Sep 26, 2021
    Configuration menu
    Copy the full SHA
    8a4c2a8 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2021

  1. Modifications unittest/cmakefile.txt.

    @limin2021
    limin2021 committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    739d9ca View commit details
    Browse the repository at this point in the history

  2. Fetch new fused_dropout_helper.h from PaddlePaddle#35843.

    @limin2021
    limin2021 committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    1d9e125 View commit details
    Browse the repository at this point in the history

  3. Remove include fused_attention_op.h.

    @limin2021
    limin2021 committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    4dd4260 View commit details
    Browse the repository at this point in the history

  4. Polish names of variants.

    @limin2021
    limin2021 committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    2e3f4f2 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2021

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fused_attention_op_2_fw
    @limin2021
    limin2021 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    f17c444 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2021

  1. Revert "Polish names of variants." 

    This reverts commit 2e3f4f2.
    @limin2021
    limin2021 committed Oct 13, 2021
    Configuration menu
    Copy the full SHA
    13d4ff3 View commit details
    Browse the repository at this point in the history

  2. Revert "Modifications accordding to Xreki's review." 

    This reverts commit 8a4c2a8.
    @limin2021
    limin2021 committed Oct 13, 2021
    Configuration menu
    Copy the full SHA
    300ec35 View commit details
    Browse the repository at this point in the history

  3. Move fused_multi_head_attention from common.py.

    @limin2021
    limin2021 committed Oct 13, 2021
    Configuration menu
    Copy the full SHA
    7b28f7c View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2021

  1. Modify copyright and names with number.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    30fef54 View commit details
    Browse the repository at this point in the history

  2. Remove HIP and use OpTest and remove print.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    766ef85 View commit details
    Browse the repository at this point in the history

  3. Minors.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    0bc03a6 View commit details
    Browse the repository at this point in the history

  4. Polish functional.fused_attention_op.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    99e36f9 View commit details
    Browse the repository at this point in the history

  5. Minors.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    2d9f727 View commit details
    Browse the repository at this point in the history

  6. Remove commits of tools/__pycache__/.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    f35b3c7 View commit details
    Browse the repository at this point in the history

  7. Minors.

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    1433ba6 View commit details
    Browse the repository at this point in the history

  8. Add english doc for functional.fused_multi_head_attention

    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    cf7be13 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fused_attention_op_2_fw
    @limin2021
    limin2021 committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    ae875ca View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2021

  1. Add fused_attention bw and layer defs.

    @limin2021
    limin2021 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    af08e6d View commit details
    Browse the repository at this point in the history

  2. Minors.

    @limin2021
    limin2021 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    eefe50a View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2021

  1. Add "#require gpu" for sample code in english doc.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    10687a6 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/fused_attention_op_2_fw' into fu… 

    …sed_attention_bw
    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    7a4c5ca View commit details
    Browse the repository at this point in the history

  3. Add "require gpu" for layer's sample code.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    56709c0 View commit details
    Browse the repository at this point in the history

  4. Remove skip in unittest.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    ea15676 View commit details
    Browse the repository at this point in the history

  5. Improve format of sample code.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    13d25cd View commit details
    Browse the repository at this point in the history

  6. Improve format of sample code.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    0f93775 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/fused_attention_op_2_fw' into fu… 

    …sed_attention_bw
    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    b5e01db View commit details
    Browse the repository at this point in the history

  8. Add assert for unsupported parameters.

    @limin2021
    limin2021 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    92672c4 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2021

  1. Minors.

    @limin2021
    limin2021 committed Oct 22, 2021
    Configuration menu
    Copy the full SHA
    3c4ce92 View commit details
    Browse the repository at this point in the history

  2. Add assert for qkv_weight's shape and dim.

    @limin2021
    limin2021 committed Oct 22, 2021
    Configuration menu
    Copy the full SHA
    647ad38 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into fused_attention_bw

    @limin2021
    limin2021 authored Oct 22, 2021
    Configuration menu
    Copy the full SHA
    99e210b View commit details
    Browse the repository at this point in the history

  4. Recover cmakefiles for typos.

    @limin2021
    limin2021 committed Oct 22, 2021
    Configuration menu
    Copy the full SHA
    b8a802e View commit details
    Browse the repository at this point in the history

  5. Minors.

    @limin2021
    limin2021 committed Oct 22, 2021
    Configuration menu
    Copy the full SHA
    74338f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2021

  1. Improve english doc.

    @limin2021
    limin2021 committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    6a79464 View commit details
    Browse the repository at this point in the history

  2. Fix bugs in english doc.

    @limin2021
    limin2021 committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    8500174 View commit details
    Browse the repository at this point in the history

  3. Expose FusedMultiHeadAttention api in paddle.nn

    @limin2021
    limin2021 committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    3cff8fe View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2021

  1. Add api to all[] and polish english docs.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    c1ce0c2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into fused_attention_bw

    @limin2021
    limin2021 authored Oct 25, 2021
    Configuration menu
    Copy the full SHA
    ffa11b5 View commit details
    Browse the repository at this point in the history

  3. Minors.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    c65617c View commit details
    Browse the repository at this point in the history

  4. Minors.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    43666eb View commit details
    Browse the repository at this point in the history

  5. Move fused_attention function api path to incubate.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    1f94fba View commit details
    Browse the repository at this point in the history

  6. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … modify_fused_attention_functional_api_path
    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    abc2d20 View commit details
    Browse the repository at this point in the history

  7. Move fused_feedforward functional api path to incubate.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    da2e6e8 View commit details
    Browse the repository at this point in the history

  8. Remove functional api in incubate/__init__.py.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    6680652 View commit details
    Browse the repository at this point in the history

  9. rm incubate/layer/fused_transformer.py.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    617a647 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'modify_fused_attention_functional_api_path' of https://… 

    …github.com/limin2021/Paddle into fused_attention_bw
    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    3be3a8e View commit details
    Browse the repository at this point in the history

  11. Modify functional api path in sample code.

    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    753abc5 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'modify_fused_attention_functional_api_path' of https://… 

    …github.com/limin2021/Paddle into fused_attention_bw
    @limin2021
    limin2021 committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    dd16512 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2021

  1. Add FusedMultiHeadAttention api in incubate/nn/__init__.py

    @limin2021
    limin2021 committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    2b3c379 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fused_attention_bw
    @limin2021
    limin2021 committed Oct 26, 2021
    1 Configuration menu
    Copy the full SHA
    5f54a0f View commit details
    Browse the repository at this point in the history