Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DRR] Add FusedLinearGeluPattern and FusedLinearReluPattern in fused_gemm_e… #58897

Merged
merged 6 commits into from
Nov 15, 2023

Conversation

gongshaotian
Copy link
Contributor

@gongshaotian gongshaotian commented Nov 10, 2023

PR types

Bug fixes

PR changes

Others

Description

  1. 在 DRR 实现的 fused_gemm_epoligue_pass 中添加 FusedLinearGeluPattern 和 FusedLinearReluPattern
  2. 利用 FusedLinearReluPattern 重写 fused_gemm_epoligue_pass 中的 FusedLinearReluGradPattern

Pcard-67164

@gongshaotian gongshaotian force-pushed the fix_fusegemm branch 2 times, most recently from fccd5ee to 981ca69 Compare November 14, 2023 08:39
@zyfncg zyfncg merged commit c94c599 into PaddlePaddle:develop Nov 15, 2023
@gongshaotian gongshaotian deleted the fix_fusegemm branch November 20, 2023 10:57
SecretXV pushed a commit to SecretXV/Paddle that referenced this pull request Nov 28, 2023
…gemm_e… (PaddlePaddle#58897)

* add FusedLinearGeluPattern and FusedLinearReluPattern in fused_gemm_epilogue_pass

* update gpt_with_pir.py

* fix bug

* fix FusedLinearReluGradPattern match bug

* Explicitly declare the output tensor reserve_space
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants