Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU] Extend gemm to fuse broadcast and reshape layers #23513

Merged
merged 7 commits into from
Mar 25, 2024
Merged

[GPU] Extend gemm to fuse broadcast and reshape layers #23513

merged 7 commits into from
Mar 25, 2024

Commits on Mar 21, 2024

  1. Implement extended gemm to fuse broadcast 

    - Update required attributes for extended gemm primitive
- Update shape inference for extended gemm
- Update kernel selector for broadcasted input
- Update gemm ref kernel for broadcasted input
- Update gemm tile opt kernel for broadcasted input
- Add test case for extended gemm

Signed-off-by: Andrew Park <andrew.park@intel.com>
    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    6a87f3f View commit details
    Browse the repository at this point in the history

  2. Implement extended gemm to fuse broadcast+reshape 

    - Update required attributes for extended gemm primitive
- Update shape inference for extended gemm
- Fix issue during canonicalize_shapes for reshaped input
- Update gemm ocl impl to apply fused op's input shape for fused reshape
- Update test case for extended gemm

Signed-off-by: Andrew Park <andrew.park@intel.com>
    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    7f1d40c View commit details
    Browse the repository at this point in the history

  3. Implement BroadcastMatmulFusion pass 

    - Implement BroadcastMatmulFusion pass which fuse broadcast/reshape to gemm
- Update internal gemm op

Signed-off-by: Andrew Park <andrew.park@intel.com>
    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    44b288f View commit details
    Browse the repository at this point in the history

  4. Fix gemm_tiled_opt sa kernel perf regression

    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    b50156d View commit details
    Browse the repository at this point in the history

  5. Update BroadcastReshapeMatmulFusion pass to reduce target pattern's s… 

    …cope
    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ba2dae7 View commit details
    Browse the repository at this point in the history

  6. Add test case for BroadcastReshapeMatmulFusion pass

    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    a2ed0ae View commit details
    Browse the repository at this point in the history

  7. Apply comments 

    Signed-off-by: Andrew Park <andrew.park@intel.com>
    @andrew-k-park
    andrew-k-park committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    3aff660 View commit details
    Browse the repository at this point in the history