Commit 35db973
authored
[SYCL] [MATRIX] Enable joint_matrix_load, joint_matrix_store, and joint_matrix_mad for AMX (#3503)
We provide new interfaces for matrix muliply in this patch:
1. A new class called joint_matrix is introduced, and the user needs to
specify the type of the elements, sizes, and the memory layout.
2. joint_matrix_load is used for loading data from main memory to tiles of
AMX or kernel's local memory.
3. joint_matrix_store is used for storing data tiles of AMX or kernel's
local memory to main memory.
4. joint_matrix_mad is used for the matrix multiply and add function.
It performs the multiply operation on the matrices A and B, accumulates the
result with C and returns the result.
With this patch, the following operation can be realized:
C = A*B+C
1. All cases where A(int8, any-size, row_major), B(int8, any-size, packed_b), C(int32, any-size, row_major)
2. All cases where A(bf16, any-size, row_major), B(bf16, any-size, packed_b), C(float, any-size, row_major)1 parent d163d2c commit 35db973
File tree
5 files changed
+819
-0
lines changed- sycl
- include/CL
- sycl/ONEAPI/intel_matrix
- test/on-device/extensions
5 files changed
+819
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| |||
0 commit comments