Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Mosaic TPU] Support packed type matmul with arbitrary shapes. #25068

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

[Mosaic TPU] Support packed type matmul with arbitrary shapes. #25068

wants to merge 1 commit into from
+76 −87

Commits on Nov 22, 2024

  1. [Mosaic TPU] Support packed type matmul with arbitrary shapes. 

    We only need to mask out subelement on contracting dim. Instead of unpacking data and applying masks, we create a VREG-sized i32 "mask" which contains subelement mask info to logical and with target vreg. Through this way, in order to mask sub-elements, each target vreg only needs to apply 1 op (logical_and) instead of 3 ops (unpacking + select + packing).

PiperOrigin-RevId: 697806355
    @bythew3i @Google-ML-Automation
    bythew3i authored and Google-ML-Automation committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    93b0c41 View commit details
    Browse the repository at this point in the history