New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

enable dual gemm glu #481

Merged

hjchen2 merged 1 commit into main from dev_optimize_dual_gemm

Jan 3, 2024

Contributor

chengzeyi commented Jan 2, 2024 •

edited

Loading

4090

With Dual GEMM	Without Dual GEMM
28.57s	31.5s

A100 40GB

With Dual GEMM	Without Dual GEMM
32.69s	33.9s

Requires: https://github.com/siliconflow/oneflow/pull/77


          enable dual gemm glu

618942f

hjchen2 approved these changes

View reviewed changes

hjchen2 merged commit 59f55de into main

0 of 4 checks passed

hjchen2 deleted the dev_optimize_dual_gemm branch

January 3, 2024 03:31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet