Skip to content

Conversation

@andrej
Copy link
Collaborator

@andrej andrej commented Nov 13, 2025

Added

  • Continuous integration testing for new PRs
  • Benchmarking results automatically committed to branch ci on every push to main

PR Merge Checklist

  1. The PR is rebased on the latest devel commit and pointing to devel.
  2. Your PR has been reviewed and approved.
  3. All checks are passing.

@andrej andrej changed the title Add ci Add CI testing and benchmarking Nov 13, 2025
@github-actions
Copy link

📊 Test Results for Small Benchmark/Test Suite

1593b62 (2025_11_13_02_34_35)

IRONCLAD

Tested on 2025_11_13_02_34_35 at commit 1593b62.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 149.20 0.08 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 180.60 0.07 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 170.40 0.07 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 193.80 0.06 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 169.80 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 177.40 0.03 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 177.20 0.03 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 179.60 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 164.60 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 166.00 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 194.60 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 219.20 0.02 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 139.40 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 131.60 0.09 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 122.20 0.10 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 147.80 0.08 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 164.40 0.07 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 175.60 0.07 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 184.20 0.06 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 202.60 0.06 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 138.20 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 191.60 0.05 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 120.20 0.07 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 150.20 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 167.80 0.05 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 178.40 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 158.20 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 185.40 0.04 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6459.60 3.64 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 165.20 0.08 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 159.80 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 160.00 0.08 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 164.80 0.08 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 166.00 0.07 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 160.20 0.08 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 214.80 0.06 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 176.60 0.07 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 741.80 0.04 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3293.00 10.24 10.23
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2036.80 16.51 16.50
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1840.60 18.41 18.39
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2072.00 16.27 16.26
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3166.20 10.64 10.63
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2014.20 16.72 16.71
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1739.80 19.32 19.31
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 1903.60 17.71 17.70
mem_copy_1_cols_1_channels_2048_tile_2048 ✅ 5/5 140.60 0.06 n/a
mem_copy_1_cols_2_channels_2048_tile_1024 ✅ 5/5 159.40 0.05 n/a
mem_copy_2_cols_1_channels_2048_tile_1024 ✅ 5/5 128.60 0.06 n/a
mem_copy_2_cols_2_channels_2048_tile_512 ✅ 5/5 165.60 0.05 n/a
mem_copy_4_cols_1_channels_2048_tile_512 ✅ 5/5 156.60 0.05 n/a
mem_copy_4_cols_2_channels_2048_tile_256 ✅ 5/5 235.40 0.03 n/a
mem_copy_8_cols_1_channels_2048_tile_256 ✅ 5/5 208.60 0.04 n/a
mem_copy_8_cols_2_channels_2048_tile_128 ✅ 5/5 203.00 0.04 n/a
mha ✅ 5/5 n/a 0.09 66.08
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 160.00 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 143.00 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 189.80 0.04 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 162.80 0.05 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 164.20 0.07 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 202.40 0.06 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 140.20 0.08 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 164.60 0.07 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 158.40 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 167.40 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 172.80 0.07 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 197.00 0.06 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 150.80 0.15 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 147.00 0.16 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 170.40 0.13 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 179.20 0.13 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 165.20 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 173.40 0.05 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 131.40 0.06 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 167.80 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 157.40 0.15 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 139.00 0.17 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 144.20 0.16 n/a
swiglu ✅ 5/5 n/a n/a n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 176.40 2.78 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 170.80 2.91 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 160.60 0.07 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 159.20 0.07 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 185.80 0.07 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 181.20 0.06 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

1593b62 (2025_11_13_02_34_35)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49149.20 (-33.63%)0.08 (+47.49%)150.00 (-36.71%)0.08 (+58.00%)0.06 (+34.47%)0.02 (+11.76%)0.11 (+31.07%)206.00 (-25.63%)33.49 (-37.22%)103.00 (-23.70%)
8b49b59 — 2025-11-13 02:16:06224.80 (+38.42%)0.05 (-23.73%)237.00 (+45.40%)0.05 (-31.22%)0.04 (-33.94%)0.02 (+65.00%)0.08 (-5.19%)277.00 (+51.37%)53.34 (+164.50%)135.00 (+5.47%)
1508e59 — 2025-11-13 02:08:28162.40 (n/a)0.07 (n/a)163.00 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)0.09 (n/a)183.00 (n/a)20.17 (n/a)128.00 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49180.60 (+17.73%)0.07 (-14.10%)162.00 (-2.99%)0.07 (+3.09%)0.05 (-20.34%)0.01 (-8.13%)0.09 (-15.27%)236.00 (+25.53%)40.67 (+41.65%)131.00 (+18.02%)
8b49b59 — 2025-11-13 02:16:06153.40 (+12.13%)0.08 (-9.64%)167.00 (+28.46%)0.07 (-22.16%)0.06 (-6.91%)0.02 (+19.50%)0.10 (-0.90%)188.00 (+7.43%)28.71 (+27.21%)111.00 (+0.91%)
1508e59 — 2025-11-13 02:08:28136.80 (n/a)0.09 (n/a)130.00 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)0.10 (n/a)175.00 (n/a)22.57 (n/a)110.00 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49170.40 (+2.65%)0.07 (-8.28%)177.00 (+17.22%)0.06 (-14.69%)0.06 (+30.41%)0.01 (-45.92%)0.09 (-10.94%)194.00 (-23.32%)22.42 (-55.16%)128.00 (+12.28%)
8b49b59 — 2025-11-13 02:16:06166.00 (-10.66%)0.07 (+10.47%)151.00 (-3.21%)0.08 (+3.31%)0.05 (+28.06%)0.02 (+21.19%)0.10 (+27.19%)253.00 (-21.91%)50.00 (-27.82%)114.00 (-21.38%)
1508e59 — 2025-11-13 02:08:28185.80 (n/a)0.07 (n/a)156.00 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)0.08 (n/a)324.00 (n/a)69.26 (n/a)145.00 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49193.80 (+17.88%)0.06 (-17.05%)193.00 (+23.72%)0.06 (-19.17%)0.06 (+3.40%)0.00 (-76.95%)0.06 (-27.47%)206.00 (-3.29%)8.01 (-70.04%)182.00 (+37.88%)
8b49b59 — 2025-11-13 02:16:06164.40 (-2.26%)0.07 (+0.18%)156.00 (-1.27%)0.07 (+1.28%)0.05 (+8.92%)0.01 (-28.22%)0.09 (-8.33%)213.00 (-8.19%)26.73 (-27.30%)132.00 (+9.09%)
1508e59 — 2025-11-13 02:08:28168.20 (n/a)0.07 (n/a)158.00 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)0.09 (n/a)232.00 (n/a)36.77 (n/a)121.00 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49169.80 (n/a)0.03 (n/a)178.00 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)0.04 (n/a)186.00 (n/a)20.50 (n/a)131.00 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49177.40 (n/a)0.03 (n/a)177.00 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.04 (n/a)246.00 (n/a)38.05 (n/a)139.00 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49177.20 (n/a)0.03 (n/a)171.00 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)0.03 (n/a)208.00 (n/a)18.83 (n/a)151.00 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49179.60 (n/a)0.03 (n/a)165.00 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.03 (n/a)248.00 (n/a)37.36 (n/a)147.00 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49164.60 (n/a)0.03 (n/a)141.00 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.05 (n/a)294.00 (n/a)67.01 (n/a)99.00 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49166.00 (n/a)0.03 (n/a)168.00 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.04 (n/a)215.00 (n/a)36.20 (n/a)109.00 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49194.60 (n/a)0.03 (n/a)171.00 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.03 (n/a)284.00 (n/a)47.89 (n/a)156.00 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49219.20 (n/a)0.02 (n/a)198.00 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.03 (n/a)356.00 (n/a)70.98 (n/a)158.00 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49139.40 (n/a)0.08 (n/a)138.00 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)0.10 (n/a)168.00 (n/a)18.23 (n/a)115.00 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49131.60 (n/a)0.09 (n/a)142.00 (n/a)0.08 (n/a)0.08 (n/a)0.01 (n/a)0.11 (n/a)152.00 (n/a)18.90 (n/a)105.00 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49122.20 (n/a)0.10 (n/a)118.00 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)0.11 (n/a)150.00 (n/a)16.55 (n/a)100.00 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49147.80 (n/a)0.08 (n/a)148.00 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)0.08 (n/a)159.00 (n/a)7.63 (n/a)135.00 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49164.40 (n/a)0.07 (n/a)158.00 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)0.09 (n/a)230.00 (n/a)35.02 (n/a)125.00 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49175.60 (n/a)0.07 (n/a)155.00 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)0.08 (n/a)270.00 (n/a)47.85 (n/a)143.00 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49184.20 (n/a)0.06 (n/a)174.00 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)237.00 (n/a)27.74 (n/a)160.00 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49202.60 (n/a)0.06 (n/a)194.00 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)0.07 (n/a)258.00 (n/a)29.23 (n/a)172.00 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49138.20 (n/a)0.06 (n/a)139.00 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)163.00 (n/a)14.52 (n/a)119.00 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49191.60 (n/a)0.05 (n/a)185.00 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)0.08 (n/a)283.00 (n/a)64.30 (n/a)97.00 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49120.20 (n/a)0.07 (n/a)118.00 (n/a)0.07 (n/a)0.07 (n/a)0.00 (n/a)0.07 (n/a)125.00 (n/a)3.54 (n/a)117.00 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49150.20 (n/a)0.06 (n/a)158.00 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)173.00 (n/a)19.53 (n/a)117.00 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49167.80 (n/a)0.05 (n/a)162.00 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)0.07 (n/a)232.00 (n/a)35.95 (n/a)121.00 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49178.40 (n/a)0.05 (n/a)177.00 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)0.05 (n/a)196.00 (n/a)15.83 (n/a)156.00 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49158.20 (n/a)0.05 (n/a)164.00 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)0.06 (n/a)169.00 (n/a)11.20 (n/a)141.00 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49185.40 (n/a)0.04 (n/a)175.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.05 (n/a)235.00 (n/a)24.94 (n/a)168.00 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:496459.60 (n/a)3.64 (n/a)6374.00 (n/a)3.68 (n/a)3.42 (n/a)0.17 (n/a)3.83 (n/a)6860.00 (n/a)299.14 (n/a)6125.00 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49165.20 (n/a)0.08 (n/a)148.00 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)0.11 (n/a)231.00 (n/a)44.07 (n/a)116.00 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49159.80 (n/a)0.08 (n/a)152.00 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)0.10 (n/a)213.00 (n/a)29.11 (n/a)124.00 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49160.00 (n/a)0.08 (n/a)149.00 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)0.10 (n/a)229.00 (n/a)36.63 (n/a)124.00 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49164.80 (n/a)0.08 (n/a)166.00 (n/a)0.07 (n/a)0.06 (n/a)0.02 (n/a)0.10 (n/a)221.00 (n/a)33.61 (n/a)124.00 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49166.00 (n/a)0.07 (n/a)168.00 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)0.09 (n/a)186.00 (n/a)18.46 (n/a)142.00 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49160.20 (n/a)0.08 (n/a)166.00 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)0.09 (n/a)194.00 (n/a)21.48 (n/a)135.00 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49214.80 (n/a)0.06 (n/a)189.00 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)0.09 (n/a)331.00 (n/a)68.69 (n/a)131.00 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49176.60 (n/a)0.07 (n/a)176.00 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)0.08 (n/a)194.00 (n/a)14.22 (n/a)153.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49741.80 (n/a)0.04 (n/a)750.00 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)0.04 (n/a)0.04 (n/a)0.05 (n/a)783.00 (n/a)0.04 (n/a)36.05 (n/a)0.00 (n/a)690.00 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:493293.00 (n/a)10.24 (n/a)3193.00 (n/a)10.52 (n/a)10.92 (n/a)9.37 (n/a)0.65 (n/a)9.36 (n/a)10.51 (n/a)10.92 (n/a)3584.00 (n/a)10.23 (n/a)213.11 (n/a)0.65 (n/a)3074.00 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:492036.80 (n/a)16.51 (n/a)2037.00 (n/a)16.48 (n/a)17.18 (n/a)15.39 (n/a)0.66 (n/a)15.38 (n/a)16.47 (n/a)17.19 (n/a)2182.00 (n/a)16.50 (n/a)83.67 (n/a)0.66 (n/a)1953.00 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:491840.60 (n/a)18.41 (n/a)1793.00 (n/a)18.73 (n/a)20.57 (n/a)15.47 (n/a)1.68 (n/a)15.46 (n/a)18.71 (n/a)20.59 (n/a)2171.00 (n/a)18.39 (n/a)180.47 (n/a)1.68 (n/a)1631.00 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:492072.00 (n/a)16.27 (n/a)2141.00 (n/a)15.68 (n/a)18.42 (n/a)15.47 (n/a)1.10 (n/a)15.46 (n/a)15.67 (n/a)18.43 (n/a)2170.00 (n/a)16.26 (n/a)128.01 (n/a)1.10 (n/a)1822.00 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:493166.20 (n/a)10.64 (n/a)3083.00 (n/a)10.89 (n/a)11.09 (n/a)9.52 (n/a)0.57 (n/a)9.52 (n/a)10.88 (n/a)11.10 (n/a)3526.00 (n/a)10.63 (n/a)182.48 (n/a)0.57 (n/a)3026.00 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:492014.20 (n/a)16.72 (n/a)2051.00 (n/a)16.37 (n/a)18.03 (n/a)15.63 (n/a)0.89 (n/a)15.62 (n/a)16.36 (n/a)18.04 (n/a)2148.00 (n/a)16.71 (n/a)105.68 (n/a)0.89 (n/a)1861.00 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:491739.80 (n/a)19.32 (n/a)1740.00 (n/a)19.30 (n/a)20.51 (n/a)18.59 (n/a)0.70 (n/a)18.58 (n/a)19.28 (n/a)20.52 (n/a)1806.00 (n/a)19.31 (n/a)61.61 (n/a)0.70 (n/a)1636.00 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)Latency (max)GFLOP/s (mean)Latency (stddev)GFLOP/s (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:491903.60 (n/a)17.71 (n/a)1855.00 (n/a)18.10 (n/a)18.86 (n/a)16.15 (n/a)1.13 (n/a)16.14 (n/a)18.09 (n/a)18.87 (n/a)2079.00 (n/a)17.70 (n/a)124.27 (n/a)1.13 (n/a)1779.00 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49140.60 (n/a)0.06 (n/a)137.00 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)0.08 (n/a)198.00 (n/a)33.76 (n/a)98.00 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49159.40 (n/a)0.05 (n/a)142.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.06 (n/a)258.00 (n/a)50.01 (n/a)124.00 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49128.60 (n/a)0.06 (n/a)136.00 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)144.00 (n/a)13.76 (n/a)105.00 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49165.60 (n/a)0.05 (n/a)158.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.06 (n/a)246.00 (n/a)45.40 (n/a)122.00 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49156.60 (n/a)0.05 (n/a)152.00 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)0.06 (n/a)196.00 (n/a)21.40 (n/a)135.00 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49235.40 (n/a)0.03 (n/a)201.00 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)0.05 (n/a)314.00 (n/a)59.60 (n/a)165.00 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49208.60 (n/a)0.04 (n/a)172.00 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)0.05 (n/a)354.00 (n/a)79.71 (n/a)141.00 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49203.00 (n/a)0.04 (n/a)163.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.05 (n/a)300.00 (n/a)59.16 (n/a)152.00 (n/a)

mha

Commit/Date Bandwidth (mean)Bandwidth (median)GFLOP/s (max)Bandwidth (min)Bandwidth (stddev)GFLOP/s (min)GFLOP/s (median)Bandwidth (max)GFLOP/s (mean)GFLOP/s (stddev)
1593b62 — 2025-11-13 02:33:490.09 (n/a)0.09 (n/a)74.35 (n/a)0.09 (n/a)0.01 (n/a)63.52 (n/a)64.31 (n/a)0.10 (n/a)66.08 (n/a)4.15 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49160.00 (n/a)0.05 (n/a)140.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.06 (n/a)238.00 (n/a)41.23 (n/a)127.00 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49143.00 (n/a)0.05 (n/a)153.00 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)169.00 (n/a)22.41 (n/a)112.00 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49189.80 (n/a)0.04 (n/a)154.00 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)0.05 (n/a)271.00 (n/a)49.77 (n/a)146.00 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49162.80 (n/a)0.05 (n/a)162.00 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)0.06 (n/a)210.00 (n/a)31.73 (n/a)123.00 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49164.20 (n/a)0.07 (n/a)159.00 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)0.08 (n/a)210.00 (n/a)25.45 (n/a)136.00 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49202.40 (n/a)0.06 (n/a)186.00 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)0.07 (n/a)285.00 (n/a)41.83 (n/a)169.00 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49140.20 (n/a)0.08 (n/a)124.00 (n/a)0.09 (n/a)0.06 (n/a)0.01 (n/a)0.10 (n/a)187.00 (n/a)26.90 (n/a)113.00 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49164.60 (n/a)0.07 (n/a)166.00 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)0.08 (n/a)198.00 (n/a)22.20 (n/a)139.00 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49158.40 (n/a)0.08 (n/a)149.00 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)0.09 (n/a)228.00 (n/a)36.36 (n/a)121.00 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49167.40 (n/a)0.07 (n/a)164.00 (n/a)0.07 (n/a)0.05 (n/a)0.02 (n/a)0.10 (n/a)238.00 (n/a)41.23 (n/a)112.00 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49172.80 (n/a)0.07 (n/a)182.00 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)0.08 (n/a)212.00 (n/a)28.32 (n/a)136.00 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49197.00 (n/a)0.06 (n/a)184.00 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)0.07 (n/a)245.00 (n/a)28.67 (n/a)163.00 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49150.80 (n/a)0.15 (n/a)153.00 (n/a)0.15 (n/a)0.14 (n/a)0.01 (n/a)0.17 (n/a)160.00 (n/a)7.63 (n/a)137.00 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49147.00 (n/a)0.16 (n/a)144.00 (n/a)0.16 (n/a)0.13 (n/a)0.01 (n/a)0.17 (n/a)171.00 (n/a)13.42 (n/a)132.00 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49170.40 (n/a)0.13 (n/a)174.00 (n/a)0.13 (n/a)0.13 (n/a)0.01 (n/a)0.15 (n/a)181.00 (n/a)10.91 (n/a)153.00 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49179.20 (n/a)0.13 (n/a)181.00 (n/a)0.13 (n/a)0.11 (n/a)0.01 (n/a)0.15 (n/a)203.00 (n/a)18.76 (n/a)156.00 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49165.20 (n/a)0.05 (n/a)171.00 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)0.06 (n/a)218.00 (n/a)33.81 (n/a)120.00 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49173.40 (n/a)0.05 (n/a)160.00 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)0.06 (n/a)216.00 (n/a)31.78 (n/a)136.00 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49131.40 (n/a)0.06 (n/a)124.00 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)0.06 (n/a)155.00 (n/a)13.54 (n/a)119.00 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49167.80 (n/a)0.05 (n/a)176.00 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)0.05 (n/a)185.00 (n/a)15.30 (n/a)147.00 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49157.40 (n/a)0.15 (n/a)141.00 (n/a)0.16 (n/a)0.10 (n/a)0.03 (n/a)0.18 (n/a)237.00 (n/a)40.11 (n/a)128.00 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49139.00 (n/a)0.17 (n/a)148.00 (n/a)0.15 (n/a)0.15 (n/a)0.02 (n/a)0.20 (n/a)151.00 (n/a)14.04 (n/a)115.00 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49144.20 (n/a)0.16 (n/a)144.00 (n/a)0.16 (n/a)0.14 (n/a)0.01 (n/a)0.18 (n/a)165.00 (n/a)12.78 (n/a)126.00 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49176.40 (n/a)2.78 (n/a)170.00 (n/a)2.87 (n/a)2.56 (n/a)0.18 (n/a)2.96 (n/a)191.00 (n/a)11.64 (n/a)165.00 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49170.80 (n/a)2.91 (n/a)170.00 (n/a)2.87 (n/a)2.45 (n/a)0.41 (n/a)3.64 (n/a)199.00 (n/a)22.18 (n/a)134.00 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49160.60 (n/a)0.07 (n/a)159.00 (n/a)0.07 (n/a)0.07 (n/a)0.00 (n/a)0.08 (n/a)174.00 (n/a)9.26 (n/a)147.00 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49159.20 (n/a)0.07 (n/a)154.00 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)0.08 (n/a)192.00 (n/a)21.08 (n/a)137.00 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49185.80 (n/a)0.07 (n/a)155.00 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)0.08 (n/a)310.00 (n/a)63.75 (n/a)141.00 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Latency (mean)Bandwidth (mean)Latency (median)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Bandwidth (max)Latency (max)Latency (stddev)Latency (min)
1593b62 — 2025-11-13 02:33:49181.20 (n/a)0.06 (n/a)177.00 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)0.07 (n/a)202.00 (n/a)14.55 (n/a)164.00 (n/a)

@amd amd deleted a comment from github-actions bot Nov 13, 2025
@amd amd deleted a comment from github-actions bot Nov 13, 2025
@amd amd deleted a comment from github-actions bot Nov 13, 2025
@github-actions
Copy link

📊 Test Results for Small Benchmark/Test Suite

fbf1591 (2025_11_13_03_40_08)

IRONCLAD

Tested on 2025_11_13_03_40_08 at commit fbf1591.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 141.00 0.08 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 180.60 0.07 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 154.80 0.08 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 181.60 0.06 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 207.20 0.02 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 138.60 0.04 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 145.80 0.03 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 179.20 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 147.80 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 160.40 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 162.60 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 241.60 0.02 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 150.00 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 120.40 0.10 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 139.40 0.08 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 138.00 0.08 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 141.60 0.08 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 142.00 0.08 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 148.00 0.08 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 169.20 0.07 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 178.00 0.05 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 145.20 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 141.80 0.06 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 140.80 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 179.60 0.05 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 154.00 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 176.20 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 168.00 0.05 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6442.40 3.64 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 169.00 0.07 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 164.80 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 171.20 0.07 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 195.40 0.06 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 216.20 0.06 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 219.00 0.06 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 170.80 0.08 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 199.40 0.06 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 782.60 0.04 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3096.20 10.86 10.85
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2085.20 16.11 16.10
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1766.20 19.04 19.03
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2040.20 16.78 16.77
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3148.60 10.69 10.68
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2106.60 15.99 15.98
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1755.20 19.15 19.13
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 1880.40 17.90 17.89
mem_copy_1_cols_1_channels_2048_tile_2048 ✅ 5/5 160.00 0.05 n/a
mem_copy_1_cols_2_channels_2048_tile_1024 ✅ 5/5 141.20 0.05 n/a
mem_copy_2_cols_1_channels_2048_tile_1024 ✅ 5/5 137.60 0.06 n/a
mem_copy_2_cols_2_channels_2048_tile_512 ✅ 5/5 173.20 0.05 n/a
mem_copy_4_cols_1_channels_2048_tile_512 ✅ 5/5 134.60 0.06 n/a
mem_copy_4_cols_2_channels_2048_tile_256 ✅ 5/5 200.80 0.04 n/a
mem_copy_8_cols_1_channels_2048_tile_256 ✅ 5/5 171.40 0.04 n/a
mem_copy_8_cols_2_channels_2048_tile_128 ✅ 5/5 199.40 0.04 n/a
mha ✅ 5/5 n/a 0.09 64.33
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 159.60 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 142.20 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 208.60 0.04 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 159.00 0.05 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 144.80 0.08 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 167.80 0.07 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 159.40 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 162.60 0.08 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 144.60 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 168.80 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 156.40 0.07 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 231.80 0.05 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 193.80 0.12 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 142.20 0.16 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 152.20 0.16 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 205.60 0.11 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 166.60 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 161.60 0.05 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 150.40 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 183.20 0.04 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 148.80 0.16 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 145.60 0.16 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 184.20 0.13 n/a
swiglu ✅ 5/5 n/a n/a n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 218.80 2.31 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 156.60 3.21 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 133.20 0.09 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 136.60 0.08 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 132.60 0.09 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 192.40 0.06 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

fbf1591 (2025_11_13_03_40_08)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.00 (n/a)0.08 (n/a)148.00 (n/a)141.00 (n/a)0.08 (n/a)135.00 (n/a)4.24 (n/a)141.00 (n/a)0.08 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.02 (n/a)0.07 (n/a)280.00 (n/a)164.00 (n/a)0.04 (n/a)110.00 (n/a)55.64 (n/a)180.60 (n/a)0.10 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)212.00 (n/a)145.00 (n/a)0.05 (n/a)125.00 (n/a)29.87 (n/a)154.80 (n/a)0.09 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)217.00 (n/a)187.00 (n/a)0.05 (n/a)138.00 (n/a)28.24 (n/a)181.60 (n/a)0.08 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.00 (n/a)0.02 (n/a)296.00 (n/a)192.00 (n/a)0.02 (n/a)171.00 (n/a)45.59 (n/a)207.20 (n/a)0.03 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.01 (n/a)0.04 (n/a)169.00 (n/a)146.00 (n/a)0.03 (n/a)98.00 (n/a)23.80 (n/a)138.60 (n/a)0.05 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.00 (n/a)0.03 (n/a)158.00 (n/a)148.00 (n/a)0.03 (n/a)125.00 (n/a)11.46 (n/a)145.80 (n/a)0.04 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.00 (n/a)0.03 (n/a)209.00 (n/a)184.00 (n/a)0.02 (n/a)135.00 (n/a)27.24 (n/a)179.20 (n/a)0.04 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.01 (n/a)0.03 (n/a)217.00 (n/a)132.00 (n/a)0.02 (n/a)109.00 (n/a)37.76 (n/a)147.80 (n/a)0.04 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.01 (n/a)0.03 (n/a)194.00 (n/a)165.00 (n/a)0.03 (n/a)119.00 (n/a)27.39 (n/a)160.40 (n/a)0.04 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.00 (n/a)0.03 (n/a)186.00 (n/a)161.00 (n/a)0.03 (n/a)147.00 (n/a)14.68 (n/a)162.60 (n/a)0.03 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.02 (n/a)0.01 (n/a)0.02 (n/a)339.00 (n/a)220.00 (n/a)0.01 (n/a)163.00 (n/a)59.50 (n/a)241.60 (n/a)0.03 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.00 (n/a)0.08 (n/a)155.00 (n/a)150.00 (n/a)0.07 (n/a)146.00 (n/a)3.03 (n/a)150.00 (n/a)0.08 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.01 (n/a)0.10 (n/a)141.00 (n/a)112.00 (n/a)0.08 (n/a)111.00 (n/a)11.96 (n/a)120.40 (n/a)0.10 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)170.00 (n/a)136.00 (n/a)0.07 (n/a)120.00 (n/a)16.54 (n/a)139.40 (n/a)0.10 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.01 (n/a)0.08 (n/a)163.00 (n/a)132.00 (n/a)0.07 (n/a)113.00 (n/a)19.06 (n/a)138.00 (n/a)0.10 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)159.00 (n/a)143.00 (n/a)0.07 (n/a)124.00 (n/a)12.47 (n/a)141.60 (n/a)0.09 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)166.00 (n/a)139.00 (n/a)0.07 (n/a)122.00 (n/a)14.32 (n/a)142.00 (n/a)0.09 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)200.00 (n/a)144.00 (n/a)0.06 (n/a)113.00 (n/a)29.47 (n/a)148.00 (n/a)0.10 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.07 (n/a)214.00 (n/a)171.00 (n/a)0.05 (n/a)139.00 (n/a)28.07 (n/a)169.20 (n/a)0.08 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)235.00 (n/a)181.00 (n/a)0.03 (n/a)127.00 (n/a)40.36 (n/a)178.00 (n/a)0.06 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)198.00 (n/a)137.00 (n/a)0.04 (n/a)116.00 (n/a)28.31 (n/a)145.20 (n/a)0.07 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)207.00 (n/a)137.00 (n/a)0.04 (n/a)109.00 (n/a)34.44 (n/a)141.80 (n/a)0.08 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)168.00 (n/a)136.00 (n/a)0.05 (n/a)129.00 (n/a)14.44 (n/a)140.80 (n/a)0.06 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)224.00 (n/a)161.00 (n/a)0.04 (n/a)153.00 (n/a)27.66 (n/a)179.60 (n/a)0.05 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)182.00 (n/a)162.00 (n/a)0.05 (n/a)112.00 (n/a)23.97 (n/a)154.00 (n/a)0.07 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)227.00 (n/a)175.00 (n/a)0.04 (n/a)139.00 (n/a)29.00 (n/a)176.20 (n/a)0.06 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)200.00 (n/a)160.00 (n/a)0.04 (n/a)150.00 (n/a)19.09 (n/a)168.00 (n/a)0.05 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:223.67 (n/a)0.07 (n/a)3.64 (n/a)6703.00 (n/a)6390.00 (n/a)3.50 (n/a)6351.00 (n/a)132.58 (n/a)6442.40 (n/a)3.69 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.07 (n/a)198.00 (n/a)169.00 (n/a)0.06 (n/a)124.00 (n/a)26.24 (n/a)169.00 (n/a)0.10 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.08 (n/a)209.00 (n/a)167.00 (n/a)0.06 (n/a)131.00 (n/a)26.25 (n/a)164.80 (n/a)0.09 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.07 (n/a)219.00 (n/a)167.00 (n/a)0.06 (n/a)125.00 (n/a)30.83 (n/a)171.20 (n/a)0.10 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)243.00 (n/a)193.00 (n/a)0.05 (n/a)148.00 (n/a)30.79 (n/a)195.40 (n/a)0.08 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)276.00 (n/a)221.00 (n/a)0.04 (n/a)155.00 (n/a)40.28 (n/a)216.20 (n/a)0.08 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.06 (n/a)292.00 (n/a)229.00 (n/a)0.04 (n/a)152.00 (n/a)51.78 (n/a)219.00 (n/a)0.08 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.02 (n/a)0.08 (n/a)264.00 (n/a)153.00 (n/a)0.05 (n/a)116.00 (n/a)51.27 (n/a)170.80 (n/a)0.11 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)250.00 (n/a)192.00 (n/a)0.05 (n/a)170.00 (n/a)30.00 (n/a)199.40 (n/a)0.07 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.00 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)832.00 (n/a)0.04 (n/a)797.00 (n/a)0.04 (n/a)0.04 (n/a)720.00 (n/a)37.63 (n/a)0.00 (n/a)782.60 (n/a)0.05 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2210.80 (n/a)0.36 (n/a)11.38 (n/a)10.27 (n/a)10.86 (n/a)3268.00 (n/a)10.79 (n/a)3110.00 (n/a)10.85 (n/a)10.27 (n/a)2948.00 (n/a)104.38 (n/a)0.36 (n/a)3096.20 (n/a)11.39 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2216.06 (n/a)0.32 (n/a)16.59 (n/a)15.62 (n/a)16.11 (n/a)2148.00 (n/a)16.05 (n/a)2090.00 (n/a)16.10 (n/a)15.63 (n/a)2023.00 (n/a)41.69 (n/a)0.32 (n/a)2085.20 (n/a)16.60 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2218.75 (n/a)0.83 (n/a)20.62 (n/a)18.38 (n/a)19.04 (n/a)1826.00 (n/a)18.73 (n/a)1791.00 (n/a)19.03 (n/a)18.39 (n/a)1627.00 (n/a)73.21 (n/a)0.83 (n/a)1766.20 (n/a)20.64 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2216.00 (n/a)2.29 (n/a)19.43 (n/a)13.47 (n/a)16.78 (n/a)2491.00 (n/a)15.99 (n/a)2099.00 (n/a)16.77 (n/a)13.48 (n/a)1727.00 (n/a)285.41 (n/a)2.29 (n/a)2040.20 (n/a)19.44 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2210.79 (n/a)0.53 (n/a)11.30 (n/a)9.71 (n/a)10.69 (n/a)3457.00 (n/a)10.79 (n/a)3111.00 (n/a)10.68 (n/a)9.71 (n/a)2970.00 (n/a)165.20 (n/a)0.53 (n/a)3148.60 (n/a)11.30 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2215.84 (n/a)0.94 (n/a)17.21 (n/a)14.45 (n/a)15.99 (n/a)2322.00 (n/a)15.83 (n/a)2120.00 (n/a)15.98 (n/a)14.46 (n/a)1950.00 (n/a)127.11 (n/a)0.94 (n/a)2106.60 (n/a)17.22 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2219.10 (n/a)0.58 (n/a)20.07 (n/a)18.33 (n/a)19.15 (n/a)1831.00 (n/a)19.09 (n/a)1758.00 (n/a)19.13 (n/a)18.34 (n/a)1672.00 (n/a)53.09 (n/a)0.58 (n/a)1755.20 (n/a)20.08 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)Latency (max)GFLOP/s (median)Latency (median)GFLOP/s (mean)Bandwidth (min)Latency (min)Latency (stddev)GFLOP/s (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:2218.04 (n/a)0.86 (n/a)18.70 (n/a)16.24 (n/a)17.90 (n/a)2066.00 (n/a)18.03 (n/a)1861.00 (n/a)17.89 (n/a)16.25 (n/a)1794.00 (n/a)96.42 (n/a)0.86 (n/a)1880.40 (n/a)18.72 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)207.00 (n/a)142.00 (n/a)0.04 (n/a)134.00 (n/a)27.66 (n/a)160.00 (n/a)0.06 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.00 (n/a)0.05 (n/a)148.00 (n/a)146.00 (n/a)0.05 (n/a)121.00 (n/a)10.26 (n/a)141.20 (n/a)0.06 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.00 (n/a)0.06 (n/a)151.00 (n/a)135.00 (n/a)0.05 (n/a)124.00 (n/a)10.37 (n/a)137.60 (n/a)0.06 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.01 (n/a)0.05 (n/a)239.00 (n/a)184.00 (n/a)0.03 (n/a)123.00 (n/a)41.89 (n/a)173.20 (n/a)0.06 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)164.00 (n/a)131.00 (n/a)0.05 (n/a)114.00 (n/a)16.81 (n/a)134.60 (n/a)0.07 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.00 (n/a)0.04 (n/a)254.00 (n/a)191.00 (n/a)0.03 (n/a)178.00 (n/a)27.58 (n/a)200.80 (n/a)0.04 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.00 (n/a)0.04 (n/a)202.00 (n/a)161.00 (n/a)0.04 (n/a)158.00 (n/a)17.01 (n/a)171.40 (n/a)0.05 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.00 (n/a)0.04 (n/a)215.00 (n/a)209.00 (n/a)0.04 (n/a)158.00 (n/a)21.08 (n/a)199.40 (n/a)0.05 (n/a)

mha

Commit/Date Bandwidth (median)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (min)Bandwidth (mean)GFLOP/s (median)GFLOP/s (mean)Bandwidth (min)GFLOP/s (stddev)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.00 (n/a)66.76 (n/a)62.87 (n/a)0.09 (n/a)63.75 (n/a)64.33 (n/a)0.09 (n/a)1.35 (n/a)0.09 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)205.00 (n/a)157.00 (n/a)0.04 (n/a)133.00 (n/a)26.53 (n/a)159.60 (n/a)0.06 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.00 (n/a)0.05 (n/a)163.00 (n/a)141.00 (n/a)0.05 (n/a)128.00 (n/a)11.92 (n/a)142.20 (n/a)0.06 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.04 (n/a)307.00 (n/a)164.00 (n/a)0.02 (n/a)135.00 (n/a)72.66 (n/a)208.60 (n/a)0.06 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.00 (n/a)0.05 (n/a)170.00 (n/a)160.00 (n/a)0.04 (n/a)137.00 (n/a)11.88 (n/a)159.00 (n/a)0.06 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)174.00 (n/a)137.00 (n/a)0.07 (n/a)128.00 (n/a)16.65 (n/a)144.80 (n/a)0.09 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.07 (n/a)250.00 (n/a)154.00 (n/a)0.05 (n/a)128.00 (n/a)43.02 (n/a)167.80 (n/a)0.09 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.01 (n/a)0.07 (n/a)170.00 (n/a)168.00 (n/a)0.07 (n/a)139.00 (n/a)12.09 (n/a)159.40 (n/a)0.08 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.02 (n/a)0.08 (n/a)241.00 (n/a)160.00 (n/a)0.05 (n/a)105.00 (n/a)44.50 (n/a)162.60 (n/a)0.11 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.08 (n/a)169.00 (n/a)144.00 (n/a)0.07 (n/a)122.00 (n/a)18.36 (n/a)144.60 (n/a)0.09 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.07 (n/a)253.00 (n/a)152.00 (n/a)0.05 (n/a)139.00 (n/a)42.65 (n/a)168.80 (n/a)0.08 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.07 (n/a)171.00 (n/a)152.00 (n/a)0.07 (n/a)139.00 (n/a)12.03 (n/a)156.40 (n/a)0.08 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.05 (n/a)332.00 (n/a)206.00 (n/a)0.03 (n/a)153.00 (n/a)64.77 (n/a)231.80 (n/a)0.07 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.13 (n/a)0.03 (n/a)0.12 (n/a)259.00 (n/a)175.00 (n/a)0.09 (n/a)139.00 (n/a)44.62 (n/a)193.80 (n/a)0.16 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.15 (n/a)0.02 (n/a)0.16 (n/a)161.00 (n/a)149.00 (n/a)0.14 (n/a)115.00 (n/a)17.84 (n/a)142.20 (n/a)0.20 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.17 (n/a)0.03 (n/a)0.16 (n/a)219.00 (n/a)137.00 (n/a)0.10 (n/a)123.00 (n/a)34.14 (n/a)152.20 (n/a)0.19 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.01 (n/a)0.11 (n/a)237.00 (n/a)205.00 (n/a)0.10 (n/a)180.00 (n/a)18.73 (n/a)205.60 (n/a)0.13 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)209.00 (n/a)164.00 (n/a)0.04 (n/a)139.00 (n/a)23.92 (n/a)166.60 (n/a)0.05 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.05 (n/a)229.00 (n/a)148.00 (n/a)0.03 (n/a)136.00 (n/a)34.33 (n/a)161.60 (n/a)0.06 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.00 (n/a)0.05 (n/a)172.00 (n/a)143.00 (n/a)0.04 (n/a)136.00 (n/a)13.22 (n/a)150.40 (n/a)0.06 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.01 (n/a)0.04 (n/a)272.00 (n/a)168.00 (n/a)0.03 (n/a)144.00 (n/a)45.48 (n/a)183.20 (n/a)0.05 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.15 (n/a)0.02 (n/a)0.16 (n/a)169.00 (n/a)148.00 (n/a)0.14 (n/a)119.00 (n/a)17.02 (n/a)148.80 (n/a)0.19 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.17 (n/a)0.02 (n/a)0.16 (n/a)170.00 (n/a)136.00 (n/a)0.13 (n/a)124.00 (n/a)17.41 (n/a)145.60 (n/a)0.18 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.13 (n/a)0.03 (n/a)0.13 (n/a)275.00 (n/a)170.00 (n/a)0.08 (n/a)150.00 (n/a)46.48 (n/a)184.20 (n/a)0.15 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:222.22 (n/a)0.44 (n/a)2.31 (n/a)278.00 (n/a)220.00 (n/a)1.76 (n/a)164.00 (n/a)40.51 (n/a)218.80 (n/a)2.98 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:223.00 (n/a)0.56 (n/a)3.21 (n/a)196.00 (n/a)163.00 (n/a)2.49 (n/a)119.00 (n/a)26.31 (n/a)156.60 (n/a)4.10 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.01 (n/a)0.09 (n/a)149.00 (n/a)138.00 (n/a)0.08 (n/a)113.00 (n/a)12.72 (n/a)133.20 (n/a)0.10 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.01 (n/a)0.08 (n/a)148.00 (n/a)134.00 (n/a)0.08 (n/a)123.00 (n/a)9.60 (n/a)136.60 (n/a)0.09 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.00 (n/a)0.09 (n/a)140.00 (n/a)136.00 (n/a)0.08 (n/a)122.00 (n/a)6.62 (n/a)132.60 (n/a)0.09 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (median)Bandwidth (stddev)Bandwidth (mean)Latency (max)Latency (median)Bandwidth (min)Latency (min)Latency (stddev)Latency (mean)Bandwidth (max)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.01 (n/a)0.06 (n/a)247.00 (n/a)188.00 (n/a)0.05 (n/a)160.00 (n/a)29.76 (n/a)192.40 (n/a)0.07 (n/a)

@github-actions
Copy link

📊 Test Results for Small Benchmark/Test Suite

469e14c (2025_11_13_15_02_25)

IRONCLAD

Tested on 2025_11_13_15_02_25 at commit 469e14c.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 171.00 0.07 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 144.80 0.08 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 160.20 0.07 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 190.20 0.06 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 196.00 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 172.00 0.03 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 205.00 0.02 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 153.20 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 177.80 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 177.00 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 164.20 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 174.80 0.03 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 138.20 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 133.20 0.09 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 175.40 0.07 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 186.00 0.07 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 161.80 0.07 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 163.40 0.07 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 157.60 0.07 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 144.40 0.08 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 142.80 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 138.80 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 148.60 0.06 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 140.00 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 163.20 0.05 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 170.80 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 146.80 0.06 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 186.40 0.04 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6467.80 3.64 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 158.80 0.08 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 154.00 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 152.00 0.08 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 130.00 0.09 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 171.00 0.08 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 184.00 0.07 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 169.80 0.08 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 220.20 0.06 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 801.40 0.04 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3255.60 10.35 10.34
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2112.40 15.91 15.90
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1803.60 18.90 18.89
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2032.40 16.57 16.56
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3174.00 10.60 10.59
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2159.20 15.62 15.61
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1686.60 19.94 19.93
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 2184.80 15.45 15.44
mem_copy_1_cols_1_channels_2048_tile_2048 ✅ 5/5 164.20 0.05 n/a
mem_copy_1_cols_2_channels_2048_tile_1024 ✅ 5/5 172.00 0.05 n/a
mem_copy_2_cols_1_channels_2048_tile_1024 ✅ 5/5 160.40 0.05 n/a
mem_copy_2_cols_2_channels_2048_tile_512 ✅ 5/5 151.00 0.05 n/a
mem_copy_4_cols_1_channels_2048_tile_512 ✅ 5/5 146.00 0.05 n/a
mem_copy_4_cols_2_channels_2048_tile_256 ✅ 5/5 152.60 0.05 n/a
mem_copy_8_cols_1_channels_2048_tile_256 ✅ 5/5 209.00 0.04 n/a
mem_copy_8_cols_2_channels_2048_tile_128 ✅ 5/5 211.60 0.04 n/a
mha ✅ 5/5 n/a 0.09 63.64
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 160.00 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 151.80 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 149.40 0.05 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 187.40 0.04 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 138.00 0.08 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 134.20 0.09 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 151.80 0.08 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 135.60 0.09 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 143.20 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 159.60 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 193.20 0.06 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 159.20 0.07 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 131.80 0.18 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 193.60 0.13 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 121.40 0.19 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 155.20 0.15 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 148.00 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 142.80 0.06 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 137.20 0.06 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 158.60 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 140.40 0.17 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 128.40 0.18 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 145.20 0.16 n/a
swiglu ✅ 5/5 n/a n/a n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 165.40 2.97 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 183.20 2.77 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 128.20 0.09 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 167.20 0.07 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 166.40 0.07 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 164.80 0.07 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

469e14c (2025_11_13_15_02_25)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (+4.65%)0.07 (-14.95%)0.06 (-23.37%)0.06 (-27.45%)0.01 (+425.16%)204.00 (+37.84%)171.00 (+21.28%)184.00 (+30.50%)129.00 (-4.44%)29.26 (+589.61%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)148.00 (n/a)141.00 (n/a)141.00 (n/a)135.00 (n/a)4.24 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.13 (+25.00%)0.08 (+21.31%)0.08 (+12.33%)0.07 (+59.09%)0.02 (+16.35%)176.00 (-37.14%)144.80 (-19.82%)146.00 (-10.98%)88.00 (-20.00%)31.10 (-44.10%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)280.00 (n/a)180.60 (n/a)164.00 (n/a)110.00 (n/a)55.64 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (+6.84%)0.07 (-3.88%)0.07 (-11.04%)0.06 (+14.59%)0.01 (+3.97%)185.00 (-12.74%)160.20 (+3.49%)163.00 (+12.41%)117.00 (-6.40%)23.71 (-20.62%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)212.00 (n/a)154.80 (n/a)145.00 (n/a)125.00 (n/a)29.87 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (-16.36%)0.06 (-6.25%)0.06 (-0.53%)0.05 (-0.46%)0.01 (-50.40%)218.00 (+0.46%)190.20 (+4.74%)188.00 (+0.53%)165.00 (+19.57%)16.92 (-40.10%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)217.00 (n/a)181.60 (n/a)187.00 (n/a)138.00 (n/a)28.24 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.03 (+11.04%)0.03 (+4.13%)0.02 (-4.48%)0.02 (+27.04%)0.00 (-6.25%)233.00 (-21.28%)196.00 (-5.41%)201.00 (+4.69%)154.00 (-9.94%)29.36 (-35.60%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)296.00 (n/a)207.20 (n/a)192.00 (n/a)171.00 (n/a)45.59 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (-27.41%)0.03 (-20.79%)0.03 (-16.57%)0.02 (-16.34%)0.00 (-45.46%)202.00 (+19.53%)172.00 (+24.10%)175.00 (+19.86%)135.00 (+37.76%)21.42 (-9.99%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)169.00 (n/a)138.60 (n/a)146.00 (n/a)98.00 (n/a)23.80 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.03 (-17.76%)0.02 (-26.80%)0.02 (-26.00%)0.02 (-42.34%)0.00 (+59.67%)274.00 (+73.42%)205.00 (+40.60%)200.00 (+35.14%)152.00 (+21.60%)39.50 (+244.61%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)158.00 (n/a)145.80 (n/a)148.00 (n/a)125.00 (n/a)11.46 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (+5.47%)0.03 (+15.65%)0.03 (+23.49%)0.03 (+13.59%)0.00 (-18.73%)184.00 (-11.96%)153.20 (-14.51%)149.00 (-19.02%)128.00 (-5.19%)18.52 (-32.02%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)209.00 (n/a)179.20 (n/a)184.00 (n/a)135.00 (n/a)27.24 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (-19.85%)0.03 (-19.53%)0.03 (-26.26%)0.02 (+4.33%)0.00 (-41.00%)208.00 (-4.15%)177.80 (+20.30%)179.00 (+35.61%)136.00 (+24.77%)25.93 (-31.33%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)217.00 (n/a)147.80 (n/a)132.00 (n/a)109.00 (n/a)37.76 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.03 (-20.13%)0.03 (-9.31%)0.03 (+5.10%)0.02 (-18.83%)0.00 (-18.26%)239.00 (+23.20%)177.00 (+10.35%)157.00 (-4.85%)149.00 (+25.21%)34.20 (+24.86%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)194.00 (n/a)160.40 (n/a)165.00 (n/a)119.00 (n/a)27.39 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (+12.21%)0.03 (+0.39%)0.03 (+1.90%)0.02 (-9.71%)0.00 (+66.01%)206.00 (+10.75%)164.20 (+0.98%)158.00 (-1.86%)131.00 (-10.88%)24.57 (+67.41%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)186.00 (n/a)162.60 (n/a)161.00 (n/a)147.00 (n/a)14.68 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.03 (+7.95%)0.03 (+31.89%)0.03 (+30.95%)0.02 (+65.37%)0.00 (-39.20%)205.00 (-39.53%)174.80 (-27.65%)168.00 (-23.64%)151.00 (-7.36%)20.18 (-66.08%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)339.00 (n/a)241.60 (n/a)220.00 (n/a)163.00 (n/a)59.50 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (+16.80%)0.08 (+9.02%)0.08 (+11.11%)0.08 (+1.97%)0.01 (+276.14%)152.00 (-1.94%)138.20 (-7.87%)135.00 (-10.00%)125.00 (-14.38%)9.62 (+217.19%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)155.00 (n/a)150.00 (n/a)150.00 (n/a)146.00 (n/a)3.03 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.11 (+3.74%)0.09 (-9.04%)0.08 (-18.84%)0.07 (-9.03%)0.01 (+26.49%)155.00 (+9.93%)133.20 (+10.63%)138.00 (+23.21%)107.00 (-3.60%)16.02 (+33.93%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)141.00 (n/a)120.40 (n/a)112.00 (n/a)111.00 (n/a)11.96 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-3.23%)0.07 (-18.63%)0.07 (-22.73%)0.05 (-20.19%)0.01 (+51.36%)213.00 (+25.29%)175.40 (+25.82%)176.00 (+29.41%)124.00 (+3.33%)31.44 (+90.15%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)139.40 (n/a)136.00 (n/a)120.00 (n/a)16.54 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-11.02%)0.07 (-17.68%)0.07 (-19.02%)0.03 (-51.49%)0.02 (+72.63%)336.00 (+106.13%)186.00 (+34.78%)163.00 (+23.48%)127.00 (+12.39%)77.08 (+304.44%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)163.00 (n/a)138.00 (n/a)132.00 (n/a)113.00 (n/a)19.06 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-3.13%)0.07 (-8.94%)0.07 (-7.74%)0.05 (-32.63%)0.01 (+99.80%)236.00 (+48.43%)161.80 (+14.27%)155.00 (+8.39%)128.00 (+3.23%)38.98 (+212.64%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)159.00 (n/a)141.60 (n/a)143.00 (n/a)124.00 (n/a)12.47 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-2.40%)0.07 (-12.00%)0.07 (-16.77%)0.06 (-16.16%)0.01 (+38.75%)198.00 (+19.28%)163.40 (+15.07%)167.00 (+20.14%)125.00 (+2.46%)23.65 (+65.12%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)166.00 (n/a)142.00 (n/a)139.00 (n/a)122.00 (n/a)14.32 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (-20.42%)0.07 (-7.90%)0.08 (-3.36%)0.06 (-0.99%)0.01 (-40.27%)202.00 (+1.00%)157.60 (+6.49%)149.00 (+3.47%)142.00 (+25.66%)22.44 (-23.86%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)200.00 (n/a)148.00 (n/a)144.00 (n/a)113.00 (n/a)29.47 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (+1.46%)0.08 (+14.38%)0.08 (+18.75%)0.07 (+35.44%)0.00 (-64.51%)158.00 (-26.17%)144.40 (-14.66%)144.00 (-15.79%)137.00 (-1.44%)7.50 (-73.28%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)214.00 (n/a)169.20 (n/a)171.00 (n/a)139.00 (n/a)28.07 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-7.30%)0.06 (+18.39%)0.06 (+30.22%)0.05 (+52.60%)0.00 (-78.62%)154.00 (-34.47%)142.80 (-19.78%)139.00 (-23.20%)137.00 (+7.87%)6.21 (-84.61%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)235.00 (n/a)178.00 (n/a)181.00 (n/a)127.00 (n/a)40.36 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-12.78%)0.06 (+1.60%)0.06 (+1.48%)0.05 (+26.92%)0.00 (-65.01%)156.00 (-21.21%)138.80 (-4.41%)135.00 (-1.46%)133.00 (+14.66%)8.73 (-69.17%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)198.00 (n/a)145.20 (n/a)137.00 (n/a)116.00 (n/a)28.31 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-14.84%)0.06 (-8.08%)0.06 (-4.86%)0.05 (+19.65%)0.01 (-51.36%)173.00 (-16.43%)148.60 (+4.80%)144.00 (+5.11%)128.00 (+17.43%)16.02 (-53.49%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)141.80 (n/a)137.00 (n/a)109.00 (n/a)34.44 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+1.57%)0.06 (+0.58%)0.06 (+3.82%)0.05 (+6.33%)0.01 (+4.19%)158.00 (-5.95%)140.00 (-0.57%)131.00 (-3.68%)127.00 (-1.55%)13.96 (-3.36%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.00 (n/a)140.80 (n/a)136.00 (n/a)129.00 (n/a)14.44 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+18.60%)0.05 (+12.77%)0.06 (+11.81%)0.03 (-5.08%)0.01 (+53.72%)236.00 (+5.36%)163.20 (-9.13%)144.00 (-10.56%)129.00 (-15.69%)38.75 (+40.09%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)224.00 (n/a)179.60 (n/a)161.00 (n/a)153.00 (n/a)27.66 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-24.32%)0.05 (-11.30%)0.05 (-9.50%)0.04 (-7.14%)0.01 (-46.19%)196.00 (+7.69%)170.80 (+10.91%)179.00 (+10.49%)148.00 (+32.14%)18.43 (-23.09%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)182.00 (n/a)154.00 (n/a)162.00 (n/a)112.00 (n/a)23.97 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+1.46%)0.06 (+17.20%)0.06 (+18.24%)0.05 (+46.45%)0.00 (-68.47%)155.00 (-31.72%)146.80 (-16.69%)148.00 (-15.43%)137.00 (-1.44%)6.05 (-79.15%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)227.00 (n/a)176.20 (n/a)175.00 (n/a)139.00 (n/a)29.00 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.05 (-10.71%)0.04 (-10.70%)0.04 (-14.89%)0.04 (+1.52%)0.00 (-53.07%)197.00 (-1.50%)186.40 (+10.95%)188.00 (+17.50%)168.00 (+12.00%)9.85 (-48.40%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)168.00 (n/a)160.00 (n/a)150.00 (n/a)19.09 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:393.83 (+3.81%)3.64 (-0.08%)3.77 (+2.82%)3.36 (-3.82%)0.21 (+192.29%)6969.00 (+3.97%)6467.80 (+0.39%)6215.00 (-2.74%)6118.00 (-3.67%)387.48 (+192.28%)
fbf1591 — 2025-11-13 03:39:223.69 (n/a)3.64 (n/a)3.67 (n/a)3.50 (n/a)0.07 (n/a)6703.00 (n/a)6442.40 (n/a)6390.00 (n/a)6351.00 (n/a)132.58 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (-0.80%)0.08 (+10.52%)0.10 (+34.13%)0.05 (-14.29%)0.02 (+46.05%)231.00 (+16.67%)158.80 (-6.04%)126.00 (-25.44%)125.00 (+0.81%)43.29 (+64.93%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)198.00 (n/a)169.00 (n/a)169.00 (n/a)124.00 (n/a)26.24 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (+6.50%)0.08 (+7.63%)0.09 (+19.29%)0.06 (+10.00%)0.01 (+18.52%)190.00 (-9.09%)154.00 (-6.55%)140.00 (-16.17%)123.00 (-6.11%)27.18 (+3.55%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)209.00 (n/a)164.80 (n/a)167.00 (n/a)131.00 (n/a)26.25 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (-2.34%)0.08 (+10.11%)0.08 (+10.60%)0.07 (+24.43%)0.01 (-37.68%)176.00 (-19.63%)152.00 (-11.21%)151.00 (-9.58%)128.00 (+2.40%)15.91 (-48.39%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)219.00 (n/a)171.20 (n/a)167.00 (n/a)125.00 (n/a)30.83 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (+20.33%)0.09 (+46.83%)0.10 (+50.78%)0.09 (+73.57%)0.00 (-56.03%)140.00 (-42.39%)130.00 (-33.47%)128.00 (-33.68%)123.00 (-16.89%)6.54 (-78.75%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)243.00 (n/a)195.40 (n/a)193.00 (n/a)148.00 (n/a)30.79 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.11 (+34.78%)0.08 (+29.28%)0.06 (+15.10%)0.06 (+32.69%)0.02 (+65.69%)208.00 (-24.64%)171.00 (-20.91%)192.00 (-13.12%)115.00 (-25.81%)38.83 (-3.58%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)276.00 (n/a)216.20 (n/a)221.00 (n/a)155.00 (n/a)40.28 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (-15.08%)0.07 (+12.23%)0.07 (+25.14%)0.07 (+54.50%)0.00 (-91.14%)189.00 (-35.27%)184.00 (-15.98%)183.00 (-20.09%)179.00 (+17.76%)3.58 (-93.09%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)292.00 (n/a)219.00 (n/a)229.00 (n/a)152.00 (n/a)51.78 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-12.12%)0.08 (-2.62%)0.08 (+0.66%)0.05 (+8.20%)0.01 (-27.10%)244.00 (-7.58%)169.80 (-0.59%)152.00 (-0.65%)132.00 (+13.79%)39.47 (-23.02%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)264.00 (n/a)170.80 (n/a)153.00 (n/a)116.00 (n/a)51.27 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (+9.68%)0.06 (-6.78%)0.06 (-8.13%)0.04 (-19.87%)0.01 (+44.74%)312.00 (+24.80%)220.20 (+10.43%)209.00 (+8.85%)155.00 (-8.82%)51.27 (+70.91%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)199.40 (n/a)192.00 (n/a)170.00 (n/a)30.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (-7.10%)0.04 (-2.49%)0.04 (-0.25%)0.04 (-1.19%)0.00 (-40.11%)0.04 (-7.10%)0.04 (-2.49%)0.04 (-0.25%)0.04 (-1.19%)0.00 (-40.11%)842.00 (+1.20%)801.40 (+2.40%)799.00 (+0.25%)775.00 (+7.64%)24.63 (-34.54%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)832.00 (n/a)782.60 (n/a)797.00 (n/a)720.00 (n/a)37.63 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3910.85 (-4.75%)10.35 (-4.66%)10.56 (-2.14%)9.20 (-10.42%)0.60 (+64.34%)10.84 (-4.75%)10.34 (-4.66%)10.56 (-2.14%)9.20 (-10.42%)0.60 (+64.35%)3648.00 (+11.63%)3255.60 (+5.15%)3178.00 (+2.19%)3095.00 (+4.99%)202.37 (+93.87%)
fbf1591 — 2025-11-13 03:39:2211.39 (n/a)10.86 (n/a)10.80 (n/a)10.27 (n/a)0.36 (n/a)11.38 (n/a)10.85 (n/a)10.79 (n/a)10.27 (n/a)0.36 (n/a)3268.00 (n/a)3096.20 (n/a)3110.00 (n/a)2948.00 (n/a)104.38 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3916.69 (+0.55%)15.91 (-1.25%)15.97 (-0.57%)15.37 (-1.69%)0.46 (+42.45%)16.68 (+0.55%)15.90 (-1.25%)15.96 (-0.57%)15.36 (-1.69%)0.46 (+42.45%)2185.00 (+1.72%)2112.40 (+1.30%)2102.00 (+0.57%)2012.00 (-0.54%)60.08 (+44.11%)
fbf1591 — 2025-11-13 03:39:2216.60 (n/a)16.11 (n/a)16.06 (n/a)15.63 (n/a)0.32 (n/a)16.59 (n/a)16.10 (n/a)16.05 (n/a)15.62 (n/a)0.32 (n/a)2148.00 (n/a)2085.20 (n/a)2090.00 (n/a)2023.00 (n/a)41.69 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3921.61 (+4.70%)18.90 (-0.74%)19.23 (+2.58%)15.37 (-16.39%)2.27 (+173.49%)21.59 (+4.70%)18.89 (-0.74%)19.22 (+2.58%)15.36 (-16.39%)2.27 (+173.49%)2184.00 (+19.61%)1803.60 (+2.12%)1746.00 (-2.51%)1554.00 (-4.49%)229.04 (+212.85%)
fbf1591 — 2025-11-13 03:39:2220.64 (n/a)19.04 (n/a)18.75 (n/a)18.39 (n/a)0.83 (n/a)20.62 (n/a)19.03 (n/a)18.73 (n/a)18.38 (n/a)0.83 (n/a)1826.00 (n/a)1766.20 (n/a)1791.00 (n/a)1627.00 (n/a)73.21 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3917.62 (-9.34%)16.57 (-1.22%)16.97 (+6.06%)15.25 (+13.12%)0.91 (-60.13%)17.61 (-9.34%)16.56 (-1.22%)16.96 (+6.06%)15.24 (+13.12%)0.91 (-60.13%)2202.00 (-11.60%)2032.40 (-0.38%)1979.00 (-5.72%)1905.00 (+10.31%)114.53 (-59.87%)
fbf1591 — 2025-11-13 03:39:2219.44 (n/a)16.78 (n/a)16.00 (n/a)13.48 (n/a)2.29 (n/a)19.43 (n/a)16.77 (n/a)15.99 (n/a)13.47 (n/a)2.29 (n/a)2491.00 (n/a)2040.20 (n/a)2099.00 (n/a)1727.00 (n/a)285.41 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3910.94 (-3.19%)10.60 (-0.86%)10.79 (-0.06%)9.69 (-0.20%)0.46 (-14.36%)10.94 (-3.19%)10.59 (-0.86%)10.78 (-0.06%)9.69 (-0.20%)0.46 (-14.36%)3464.00 (+0.20%)3174.00 (+0.81%)3113.00 (+0.06%)3068.00 (+3.30%)146.04 (-11.60%)
fbf1591 — 2025-11-13 03:39:2211.30 (n/a)10.69 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)11.30 (n/a)10.68 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)3457.00 (n/a)3148.60 (n/a)3111.00 (n/a)2970.00 (n/a)165.20 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3916.78 (-2.55%)15.62 (-2.37%)15.73 (-0.66%)13.81 (-4.52%)0.98 (+4.51%)16.77 (-2.55%)15.61 (-2.37%)15.72 (-0.66%)13.80 (-4.52%)0.98 (+4.51%)2432.00 (+4.74%)2159.20 (+2.50%)2134.00 (+0.66%)2001.00 (+2.62%)144.86 (+13.96%)
fbf1591 — 2025-11-13 03:39:2217.22 (n/a)15.99 (n/a)15.84 (n/a)14.46 (n/a)0.94 (n/a)17.21 (n/a)15.98 (n/a)15.83 (n/a)14.45 (n/a)0.94 (n/a)2322.00 (n/a)2106.60 (n/a)2120.00 (n/a)1950.00 (n/a)127.11 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3921.30 (+6.09%)19.94 (+4.15%)19.73 (+3.29%)18.88 (+2.98%)0.83 (+42.22%)21.29 (+6.09%)19.93 (+4.15%)19.71 (+3.29%)18.87 (+2.98%)0.83 (+42.22%)1778.00 (-2.89%)1686.60 (-3.91%)1702.00 (-3.19%)1576.00 (-5.74%)68.99 (+29.95%)
fbf1591 — 2025-11-13 03:39:2220.08 (n/a)19.15 (n/a)19.10 (n/a)18.34 (n/a)0.58 (n/a)20.07 (n/a)19.13 (n/a)19.09 (n/a)18.33 (n/a)0.58 (n/a)1831.00 (n/a)1755.20 (n/a)1758.00 (n/a)1672.00 (n/a)53.09 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:3917.68 (-5.53%)15.45 (-13.67%)14.89 (-17.47%)14.35 (-11.71%)1.20 (+38.18%)17.67 (-5.53%)15.44 (-13.67%)14.88 (-17.47%)14.34 (-11.71%)1.19 (+38.18%)2340.00 (+13.26%)2184.80 (+16.19%)2255.00 (+21.17%)1899.00 (+5.85%)156.77 (+62.59%)
fbf1591 — 2025-11-13 03:39:2218.72 (n/a)17.90 (n/a)18.04 (n/a)16.25 (n/a)0.86 (n/a)18.70 (n/a)17.89 (n/a)18.03 (n/a)16.24 (n/a)0.86 (n/a)2066.00 (n/a)1880.40 (n/a)1861.00 (n/a)1794.00 (n/a)96.42 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.05 (-10.67%)0.05 (-4.68%)0.04 (-17.92%)0.04 (+18.97%)0.00 (-55.46%)174.00 (-15.94%)164.20 (+2.62%)173.00 (+21.83%)150.00 (+11.94%)11.60 (-58.07%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)160.00 (n/a)142.00 (n/a)134.00 (n/a)27.66 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-10.37%)0.05 (-16.18%)0.05 (-13.61%)0.03 (-33.93%)0.01 (+64.02%)224.00 (+51.35%)172.00 (+21.81%)169.00 (+15.75%)135.00 (+11.57%)29.16 (+184.10%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)148.00 (n/a)141.20 (n/a)146.00 (n/a)121.00 (n/a)10.26 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-10.14%)0.05 (-13.50%)0.05 (-13.46%)0.04 (-20.53%)0.01 (+34.03%)190.00 (+25.83%)160.40 (+16.57%)156.00 (+15.56%)138.00 (+11.29%)19.24 (+85.63%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)151.00 (n/a)137.60 (n/a)135.00 (n/a)124.00 (n/a)10.37 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-7.52%)0.05 (+8.75%)0.05 (+20.26%)0.05 (+43.11%)0.00 (-66.11%)167.00 (-30.13%)151.00 (-12.82%)153.00 (-16.85%)133.00 (+8.13%)10.97 (-73.80%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)239.00 (n/a)173.20 (n/a)184.00 (n/a)123.00 (n/a)41.89 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (-8.80%)0.05 (-7.88%)0.05 (-11.49%)0.04 (-4.09%)0.01 (-7.98%)171.00 (+4.27%)146.00 (+8.47%)148.00 (+12.98%)125.00 (+9.65%)17.20 (+2.34%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.00 (n/a)134.60 (n/a)131.00 (n/a)114.00 (n/a)16.81 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+31.85%)0.05 (+30.39%)0.05 (+29.05%)0.05 (+51.19%)0.00 (-6.78%)168.00 (-33.86%)152.60 (-24.00%)148.00 (-22.51%)135.00 (-24.16%)12.91 (-53.19%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)254.00 (n/a)200.80 (n/a)191.00 (n/a)178.00 (n/a)27.58 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.05 (-5.95%)0.04 (-16.41%)0.04 (-16.15%)0.03 (-26.55%)0.01 (+45.37%)275.00 (+36.14%)209.00 (+21.94%)192.00 (+19.25%)168.00 (+6.33%)36.90 (+116.89%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)202.00 (n/a)171.40 (n/a)161.00 (n/a)158.00 (n/a)17.01 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (-13.19%)0.04 (-5.63%)0.04 (-2.79%)0.03 (-12.96%)0.00 (-8.14%)247.00 (+14.88%)211.60 (+6.12%)215.00 (+2.87%)182.00 (+15.19%)25.46 (+20.80%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)215.00 (n/a)199.40 (n/a)209.00 (n/a)158.00 (n/a)21.08 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
469e14c — 2025-11-13 15:01:390.09 (-2.96%)0.09 (-1.08%)0.09 (-0.41%)0.09 (-0.91%)0.00 (-27.62%)64.78 (-2.96%)63.64 (-1.08%)63.49 (-0.41%)62.30 (-0.91%)0.98 (-27.63%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.09 (n/a)0.09 (n/a)0.00 (n/a)66.76 (n/a)64.33 (n/a)63.75 (n/a)62.87 (n/a)1.35 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+7.26%)0.05 (+0.05%)0.04 (-7.65%)0.04 (+9.63%)0.01 (+12.71%)187.00 (-8.78%)160.00 (+0.25%)170.00 (+8.28%)124.00 (-6.77%)26.18 (-1.33%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)205.00 (n/a)159.60 (n/a)157.00 (n/a)133.00 (n/a)26.53 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (+16.36%)0.05 (+0.38%)0.05 (-0.70%)0.03 (-31.22%)0.01 (+210.65%)237.00 (+45.40%)151.80 (+6.75%)142.00 (+0.71%)110.00 (-14.06%)45.93 (+285.24%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)163.00 (n/a)142.20 (n/a)141.00 (n/a)128.00 (n/a)11.92 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (+19.47%)0.05 (+33.50%)0.06 (+32.26%)0.03 (+32.33%)0.01 (-1.29%)232.00 (-24.43%)149.40 (-28.38%)124.00 (-24.39%)113.00 (-16.30%)44.12 (-39.28%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)307.00 (n/a)208.60 (n/a)164.00 (n/a)135.00 (n/a)72.66 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.04 (-22.16%)0.04 (-15.35%)0.04 (-11.60%)0.04 (-15.84%)0.00 (-36.57%)202.00 (+18.82%)187.40 (+17.86%)181.00 (+13.12%)176.00 (+28.47%)11.64 (-2.06%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)170.00 (n/a)159.00 (n/a)160.00 (n/a)137.00 (n/a)11.88 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (+17.43%)0.08 (+5.85%)0.08 (+0.00%)0.07 (+6.10%)0.01 (+46.86%)164.00 (-5.75%)138.00 (-4.70%)137.00 (+0.00%)109.00 (-14.84%)19.59 (+17.60%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)174.00 (n/a)144.80 (n/a)137.00 (n/a)128.00 (n/a)16.65 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.12 (+31.96%)0.09 (+22.85%)0.08 (+14.07%)0.07 (+44.51%)0.02 (+15.74%)173.00 (-30.80%)134.20 (-20.02%)135.00 (-12.34%)97.00 (-24.22%)24.72 (-42.54%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)167.80 (n/a)154.00 (n/a)128.00 (n/a)43.02 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.11 (+28.70%)0.08 (+10.27%)0.08 (+13.51%)0.05 (-20.93%)0.02 (+209.96%)215.00 (+26.47%)151.80 (-4.77%)148.00 (-11.90%)108.00 (-22.30%)36.80 (+204.30%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)159.40 (n/a)168.00 (n/a)139.00 (n/a)12.09 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-14.63%)0.09 (+12.80%)0.09 (+26.98%)0.07 (+51.57%)0.01 (-58.15%)159.00 (-34.02%)135.60 (-16.61%)126.00 (-21.25%)123.00 (+17.14%)14.14 (-68.23%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.07 (n/a)0.05 (n/a)0.02 (n/a)241.00 (n/a)162.60 (n/a)160.00 (n/a)105.00 (n/a)44.50 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.09 (-2.40%)0.08 (+0.23%)0.08 (+1.41%)0.07 (+1.20%)0.01 (-27.18%)167.00 (-1.18%)143.20 (-0.97%)142.00 (-1.39%)125.00 (+2.46%)13.72 (-25.28%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)169.00 (n/a)144.60 (n/a)144.00 (n/a)122.00 (n/a)18.36 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (+1.46%)0.07 (+2.23%)0.08 (+0.66%)0.06 (+33.86%)0.01 (-35.86%)189.00 (-25.30%)159.60 (-5.45%)151.00 (-0.66%)137.00 (-1.44%)19.65 (-53.92%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)253.00 (n/a)168.80 (n/a)152.00 (n/a)139.00 (n/a)42.65 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (-1.42%)0.06 (-17.54%)0.06 (-26.92%)0.05 (-20.47%)0.01 (+83.08%)215.00 (+25.73%)193.20 (+23.53%)208.00 (+36.84%)141.00 (+1.44%)27.21 (+126.27%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.00 (n/a)156.40 (n/a)152.00 (n/a)139.00 (n/a)12.03 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (+2.00%)0.07 (+35.12%)0.07 (+27.95%)0.07 (+98.80%)0.00 (-80.77%)167.00 (-49.70%)159.20 (-31.32%)161.00 (-21.84%)150.00 (-1.96%)6.01 (-90.72%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)332.00 (n/a)231.80 (n/a)206.00 (n/a)153.00 (n/a)64.77 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.22 (+34.95%)0.18 (+42.63%)0.17 (+30.60%)0.15 (+66.03%)0.03 (-3.38%)156.00 (-39.77%)131.80 (-31.99%)134.00 (-23.43%)103.00 (-25.90%)18.77 (-57.94%)
fbf1591 — 2025-11-13 03:39:220.16 (n/a)0.12 (n/a)0.13 (n/a)0.09 (n/a)0.03 (n/a)259.00 (n/a)193.80 (n/a)175.00 (n/a)139.00 (n/a)44.62 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.18 (-8.00%)0.13 (-20.32%)0.13 (-13.37%)0.08 (-40.59%)0.04 (+80.22%)271.00 (+68.32%)193.60 (+36.15%)172.00 (+15.44%)125.00 (+8.70%)60.74 (+240.51%)
fbf1591 — 2025-11-13 03:39:220.20 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)161.00 (n/a)142.20 (n/a)149.00 (n/a)115.00 (n/a)17.84 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.21 (+10.81%)0.19 (+21.32%)0.20 (+18.10%)0.16 (+56.43%)0.02 (-43.72%)140.00 (-36.07%)121.40 (-20.24%)116.00 (-15.33%)111.00 (-9.76%)10.58 (-69.03%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.17 (n/a)0.10 (n/a)0.03 (n/a)219.00 (n/a)152.20 (n/a)137.00 (n/a)123.00 (n/a)34.14 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.19 (+48.76%)0.15 (+34.59%)0.15 (+33.12%)0.12 (+20.30%)0.02 (+132.17%)197.00 (-16.88%)155.20 (-24.51%)154.00 (-24.88%)121.00 (-32.78%)24.32 (+29.87%)
fbf1591 — 2025-11-13 03:39:220.13 (n/a)0.11 (n/a)0.11 (n/a)0.10 (n/a)0.01 (n/a)237.00 (n/a)205.60 (n/a)205.00 (n/a)180.00 (n/a)18.73 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+14.88%)0.05 (+15.38%)0.06 (+26.15%)0.04 (-1.88%)0.01 (+61.97%)213.00 (+1.91%)148.00 (-11.16%)130.00 (-20.73%)121.00 (-12.95%)34.26 (+43.23%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)209.00 (n/a)166.60 (n/a)164.00 (n/a)139.00 (n/a)23.92 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (+23.64%)0.06 (+13.52%)0.06 (+8.82%)0.04 (+16.24%)0.01 (+26.36%)197.00 (-13.97%)142.80 (-11.63%)136.00 (-8.11%)110.00 (-19.12%)29.93 (-12.82%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)229.00 (n/a)161.60 (n/a)148.00 (n/a)136.00 (n/a)34.33 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.07 (+24.77%)0.06 (+13.01%)0.06 (+15.32%)0.04 (-9.95%)0.01 (+140.14%)191.00 (+11.05%)137.20 (-8.78%)124.00 (-13.29%)109.00 (-19.85%)28.92 (+118.87%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)172.00 (n/a)150.40 (n/a)143.00 (n/a)136.00 (n/a)13.22 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.06 (+5.88%)0.05 (+12.14%)0.05 (+12.00%)0.04 (+42.41%)0.01 (-22.26%)191.00 (-29.78%)158.60 (-13.43%)150.00 (-10.71%)136.00 (-5.56%)22.07 (-51.48%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)272.00 (n/a)183.20 (n/a)168.00 (n/a)144.00 (n/a)45.48 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.22 (+12.26%)0.17 (+11.63%)0.19 (+20.33%)0.10 (-24.21%)0.04 (+92.87%)223.00 (+31.95%)140.40 (-5.65%)123.00 (-16.89%)106.00 (-10.92%)41.96 (+146.47%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)169.00 (n/a)148.80 (n/a)148.00 (n/a)119.00 (n/a)17.02 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.20 (+8.77%)0.18 (+12.96%)0.18 (+9.68%)0.15 (+11.11%)0.02 (-6.37%)153.00 (-10.00%)128.40 (-11.81%)124.00 (-8.82%)114.00 (-8.06%)13.48 (-22.54%)
fbf1591 — 2025-11-13 03:39:220.18 (n/a)0.16 (n/a)0.17 (n/a)0.13 (n/a)0.02 (n/a)170.00 (n/a)145.60 (n/a)136.00 (n/a)124.00 (n/a)17.41 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.18 (+20.97%)0.16 (+24.53%)0.18 (+30.77%)0.12 (+38.89%)0.03 (+2.96%)198.00 (-28.00%)145.20 (-21.17%)130.00 (-23.53%)124.00 (-17.33%)27.90 (-39.99%)
fbf1591 — 2025-11-13 03:39:220.15 (n/a)0.13 (n/a)0.13 (n/a)0.08 (n/a)0.03 (n/a)275.00 (n/a)184.20 (n/a)170.00 (n/a)150.00 (n/a)46.48 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:393.21 (+7.90%)2.97 (+28.50%)2.98 (+34.15%)2.60 (+47.87%)0.23 (-48.09%)188.00 (-32.37%)165.40 (-24.41%)164.00 (-25.45%)152.00 (-7.32%)13.17 (-67.49%)
fbf1591 — 2025-11-13 03:39:222.98 (n/a)2.31 (n/a)2.22 (n/a)1.76 (n/a)0.44 (n/a)278.00 (n/a)218.80 (n/a)220.00 (n/a)164.00 (n/a)40.51 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:393.51 (-14.39%)2.77 (-13.79%)2.96 (-1.21%)2.00 (-19.67%)0.52 (-6.76%)244.00 (+24.49%)183.20 (+16.99%)165.00 (+1.23%)139.00 (+16.81%)36.62 (+39.18%)
fbf1591 — 2025-11-13 03:39:224.10 (n/a)3.21 (n/a)3.00 (n/a)2.49 (n/a)0.56 (n/a)196.00 (n/a)156.60 (n/a)163.00 (n/a)119.00 (n/a)26.31 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.10 (+1.80%)0.09 (+3.77%)0.09 (+9.52%)0.08 (+5.67%)0.01 (-4.85%)141.00 (-5.37%)128.20 (-3.75%)126.00 (-8.70%)111.00 (-1.77%)11.55 (-9.20%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.01 (n/a)149.00 (n/a)133.20 (n/a)138.00 (n/a)113.00 (n/a)12.72 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (-10.87%)0.07 (-16.71%)0.07 (-18.79%)0.06 (-27.09%)0.01 (+81.93%)203.00 (+37.16%)167.20 (+22.40%)165.00 (+23.13%)138.00 (+12.20%)26.07 (+171.47%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)148.00 (n/a)136.60 (n/a)134.00 (n/a)123.00 (n/a)9.60 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (-18.12%)0.07 (-19.93%)0.07 (-19.53%)0.06 (-23.08%)0.01 (+34.65%)182.00 (+30.00%)166.40 (+25.49%)169.00 (+24.26%)149.00 (+22.13%)14.16 (+113.93%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)140.00 (n/a)132.60 (n/a)136.00 (n/a)122.00 (n/a)6.62 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
469e14c — 2025-11-13 15:01:390.08 (+16.79%)0.07 (+16.46%)0.07 (+10.59%)0.06 (+27.32%)0.01 (+16.54%)194.00 (-21.46%)164.80 (-14.35%)170.00 (-9.57%)137.00 (-14.37%)22.43 (-24.65%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)247.00 (n/a)192.40 (n/a)188.00 (n/a)160.00 (n/a)29.76 (n/a)

@github-actions
Copy link

📊 Test Results for Small Benchmark/Test Suite

c3de77d (2025_11_13_16_08_30)

IRONCLAD

Tested on 2025_11_13_16_08_30 at commit c3de77d.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 186.20 0.07 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 213.00 0.06 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 156.80 0.07 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 187.60 0.06 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 179.20 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 157.00 0.03 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 157.80 0.03 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 164.40 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 171.00 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 165.80 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 168.40 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 197.00 0.03 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 135.20 0.09 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 138.60 0.08 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 166.00 0.07 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 196.60 0.06 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 164.80 0.07 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 155.20 0.08 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 162.40 0.07 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 139.80 0.08 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 139.60 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 145.40 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 186.60 0.04 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 210.40 0.04 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 241.80 0.03 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 206.60 0.04 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 155.80 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 164.00 0.05 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6505.20 3.61 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 168.20 0.07 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 193.80 0.07 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 146.20 0.08 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 160.20 0.08 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 178.00 0.07 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 209.20 0.07 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 166.60 0.08 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 155.80 0.08 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 686.00 0.05 0.05
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3203.00 10.54 10.53
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2000.20 16.80 16.79
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1733.40 19.48 19.47
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 1821.40 18.46 18.45
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3132.60 10.74 10.74
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2035.40 16.54 16.53
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1560.00 21.55 21.54
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 1838.20 18.42 18.41
mem_copy_1_cols_1_channels_2048_tile_2048 ✅ 5/5 136.40 0.06 n/a
mem_copy_1_cols_2_channels_2048_tile_1024 ✅ 5/5 163.20 0.05 n/a
mem_copy_2_cols_1_channels_2048_tile_1024 ✅ 5/5 156.40 0.05 n/a
mem_copy_2_cols_2_channels_2048_tile_512 ✅ 5/5 126.40 0.06 n/a
mem_copy_4_cols_1_channels_2048_tile_512 ✅ 5/5 134.40 0.06 n/a
mem_copy_4_cols_2_channels_2048_tile_256 ✅ 5/5 151.00 0.05 n/a
mem_copy_8_cols_1_channels_2048_tile_256 ✅ 5/5 151.20 0.05 n/a
mem_copy_8_cols_2_channels_2048_tile_128 ✅ 5/5 147.80 0.05 n/a
mha ✅ 5/5 n/a 0.09 63.09
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 129.60 0.06 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 135.20 0.06 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 151.60 0.05 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 191.00 0.04 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 128.60 0.09 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 147.40 0.08 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 156.20 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 132.80 0.09 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 159.00 0.07 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 173.80 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 174.20 0.07 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 163.20 0.07 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 133.80 0.17 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 130.20 0.18 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 144.20 0.16 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 165.80 0.14 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 128.00 0.06 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 147.00 0.05 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 160.00 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 139.80 0.06 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 124.20 0.19 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 135.00 0.18 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 144.60 0.16 n/a
swiglu ✅ 5/5 n/a n/a n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 194.80 2.54 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 168.00 3.02 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 149.80 0.08 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 131.60 0.09 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 130.20 0.09 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 163.60 0.07 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

c3de77d (2025_11_13_16_08_30)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (+16.38%)0.07 (-17.77%)0.05 (-33.49%)0.05 (-36.48%)0.02 (+736.31%)233.00 (+57.43%)186.20 (+32.06%)212.00 (+50.35%)116.00 (-14.07%)49.41 (+1064.51%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)148.00 (n/a)141.00 (n/a)141.00 (n/a)135.00 (n/a)4.24 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (-26.67%)0.06 (-16.66%)0.05 (-21.90%)0.04 (-3.11%)0.02 (-24.70%)289.00 (+3.21%)213.00 (+17.94%)210.00 (+28.05%)150.00 (+36.36%)56.31 (+1.20%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)280.00 (n/a)180.60 (n/a)164.00 (n/a)110.00 (n/a)55.64 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (-8.09%)0.07 (-3.49%)0.07 (-8.81%)0.06 (+18.44%)0.01 (-44.23%)179.00 (-15.57%)156.80 (+1.29%)159.00 (+9.66%)136.00 (+8.80%)14.59 (-51.14%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)212.00 (n/a)154.80 (n/a)145.00 (n/a)125.00 (n/a)29.87 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (-18.82%)0.06 (-5.46%)0.06 (-2.09%)0.06 (+10.15%)0.00 (-70.42%)197.00 (-9.22%)187.60 (+3.30%)191.00 (+2.14%)170.00 (+23.19%)9.26 (-67.19%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)217.00 (n/a)181.60 (n/a)187.00 (n/a)138.00 (n/a)28.24 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.03 (+8.23%)0.03 (+12.73%)0.03 (+10.98%)0.02 (+33.33%)0.00 (-30.13%)222.00 (-25.00%)179.20 (-13.51%)173.00 (-9.90%)158.00 (-7.60%)22.10 (-51.51%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)296.00 (n/a)207.20 (n/a)192.00 (n/a)171.00 (n/a)45.59 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.04 (-28.47%)0.03 (-14.10%)0.03 (-7.01%)0.03 (-1.74%)0.00 (-63.56%)172.00 (+1.78%)157.00 (+13.28%)157.00 (+7.53%)137.00 (+39.80%)12.79 (-46.25%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)169.00 (n/a)138.60 (n/a)146.00 (n/a)98.00 (n/a)23.80 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.04 (-3.10%)0.03 (-7.27%)0.03 (-9.76%)0.03 (-7.06%)0.00 (+17.82%)170.00 (+7.59%)157.80 (+8.23%)164.00 (+10.81%)129.00 (+3.20%)14.97 (+30.63%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)158.00 (n/a)145.80 (n/a)148.00 (n/a)125.00 (n/a)11.46 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.04 (+1.50%)0.03 (+9.18%)0.03 (+15.72%)0.02 (-2.34%)0.00 (+2.74%)214.00 (+2.39%)164.40 (-8.26%)159.00 (-13.59%)133.00 (-1.48%)28.31 (+3.92%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)209.00 (n/a)179.20 (n/a)184.00 (n/a)135.00 (n/a)27.24 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.04 (-10.66%)0.03 (-14.81%)0.03 (-22.35%)0.02 (-3.12%)0.01 (-18.82%)224.00 (+3.23%)171.00 (+15.70%)170.00 (+28.79%)122.00 (+11.93%)34.14 (-9.60%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)217.00 (n/a)147.80 (n/a)132.00 (n/a)109.00 (n/a)37.76 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.03 (-22.73%)0.03 (-5.94%)0.03 (+1.85%)0.03 (+6.01%)0.00 (-70.23%)183.00 (-5.67%)165.80 (+3.37%)162.00 (-1.82%)154.00 (+29.41%)10.01 (-63.46%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)194.00 (n/a)160.40 (n/a)165.00 (n/a)119.00 (n/a)27.39 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.03 (+5.00%)0.03 (-3.14%)0.03 (-9.04%)0.03 (+1.09%)0.00 (+20.51%)184.00 (-1.08%)168.40 (+3.57%)177.00 (+9.94%)140.00 (-4.76%)17.00 (+15.83%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)186.00 (n/a)162.60 (n/a)161.00 (n/a)147.00 (n/a)14.68 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.03 (+0.62%)0.03 (+16.70%)0.02 (+9.45%)0.02 (+54.79%)0.00 (-48.91%)219.00 (-35.40%)197.00 (-18.46%)201.00 (-8.64%)162.00 (-0.61%)18.81 (-68.38%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)339.00 (n/a)241.60 (n/a)220.00 (n/a)163.00 (n/a)59.50 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+17.74%)0.09 (+11.57%)0.09 (+11.94%)0.07 (+0.00%)0.01 (+317.63%)155.00 (+0.00%)135.20 (-9.87%)134.00 (-10.67%)124.00 (-15.07%)10.83 (+257.16%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)155.00 (n/a)150.00 (n/a)150.00 (n/a)146.00 (n/a)3.03 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-9.76%)0.08 (-13.06%)0.08 (-17.65%)0.07 (-15.06%)0.01 (-10.09%)166.00 (+17.73%)138.60 (+15.12%)136.00 (+21.43%)123.00 (+10.81%)14.57 (+21.81%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)141.00 (n/a)120.40 (n/a)112.00 (n/a)111.00 (n/a)11.96 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-9.77%)0.07 (-13.83%)0.07 (-11.69%)0.05 (-28.27%)0.01 (+38.45%)237.00 (+39.41%)166.00 (+19.08%)154.00 (+13.24%)133.00 (+10.83%)36.41 (+120.21%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)139.40 (n/a)136.00 (n/a)120.00 (n/a)16.54 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (-33.92%)0.06 (-28.50%)0.06 (-25.42%)0.04 (-42.40%)0.01 (-13.10%)283.00 (+73.62%)196.60 (+42.46%)177.00 (+34.09%)171.00 (+51.33%)43.37 (+127.55%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)163.00 (n/a)138.00 (n/a)132.00 (n/a)113.00 (n/a)19.06 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+0.00%)0.07 (-8.89%)0.08 (-4.67%)0.04 (-38.61%)0.02 (+127.19%)259.00 (+62.89%)164.80 (+16.38%)150.00 (+4.90%)124.00 (+0.00%)48.51 (+289.10%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)159.00 (n/a)141.60 (n/a)143.00 (n/a)124.00 (n/a)12.47 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+0.83%)0.08 (-6.23%)0.08 (+0.72%)0.06 (-15.31%)0.01 (+71.35%)196.00 (+18.07%)155.20 (+9.30%)138.00 (-0.72%)121.00 (-0.82%)29.29 (+104.50%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)166.00 (n/a)142.00 (n/a)139.00 (n/a)122.00 (n/a)14.32 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-13.08%)0.07 (-11.01%)0.07 (-12.73%)0.06 (+12.36%)0.01 (-41.47%)178.00 (-11.00%)162.40 (+9.73%)165.00 (+14.58%)130.00 (+15.04%)17.10 (-41.99%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)200.00 (n/a)148.00 (n/a)144.00 (n/a)113.00 (n/a)29.47 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+14.88%)0.08 (+19.81%)0.09 (+29.55%)0.06 (+20.90%)0.01 (-10.51%)177.00 (-17.29%)139.80 (-17.38%)132.00 (-22.81%)121.00 (-12.95%)19.32 (-31.16%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)214.00 (n/a)169.20 (n/a)171.00 (n/a)139.00 (n/a)28.07 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+7.63%)0.06 (+22.37%)0.06 (+24.83%)0.05 (+49.68%)0.01 (-40.64%)157.00 (-33.19%)139.60 (-21.57%)145.00 (-19.89%)118.00 (-7.09%)15.08 (-62.63%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)235.00 (n/a)178.00 (n/a)181.00 (n/a)127.00 (n/a)40.36 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+33.33%)0.06 (+2.92%)0.05 (-14.37%)0.05 (+13.14%)0.02 (+77.71%)175.00 (-11.62%)145.40 (+0.14%)160.00 (+16.79%)87.00 (-25.00%)30.92 (+9.24%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)198.00 (n/a)145.20 (n/a)137.00 (n/a)116.00 (n/a)28.31 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (-33.94%)0.04 (-26.88%)0.04 (-25.95%)0.04 (-6.33%)0.00 (-63.86%)221.00 (+6.76%)186.60 (+31.59%)185.00 (+35.04%)165.00 (+51.38%)19.57 (-43.17%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)141.80 (n/a)137.00 (n/a)109.00 (n/a)34.44 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (-20.86%)0.04 (-29.91%)0.05 (-23.60%)0.03 (-44.74%)0.01 (+63.31%)304.00 (+80.95%)210.40 (+49.43%)178.00 (+30.88%)163.00 (+26.36%)53.41 (+269.86%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.00 (n/a)140.80 (n/a)136.00 (n/a)129.00 (n/a)14.44 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.04 (-21.54%)0.03 (-26.53%)0.03 (-35.86%)0.03 (-14.18%)0.00 (-41.15%)261.00 (+16.52%)241.80 (+34.63%)251.00 (+55.90%)195.00 (+27.45%)23.72 (-14.25%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)224.00 (n/a)179.60 (n/a)161.00 (n/a)153.00 (n/a)27.66 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (-33.73%)0.04 (-24.43%)0.04 (-14.74%)0.03 (-39.33%)0.01 (-24.90%)300.00 (+64.84%)206.60 (+34.16%)190.00 (+17.28%)169.00 (+50.89%)47.71 (+99.07%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)182.00 (n/a)154.00 (n/a)162.00 (n/a)112.00 (n/a)23.97 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (-0.71%)0.05 (+11.53%)0.06 (+19.86%)0.04 (+20.11%)0.01 (-26.85%)189.00 (-16.74%)155.80 (-11.58%)146.00 (-16.57%)140.00 (+0.72%)17.75 (-38.80%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)227.00 (n/a)176.20 (n/a)175.00 (n/a)139.00 (n/a)29.00 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+12.78%)0.05 (+3.22%)0.05 (-0.62%)0.04 (-2.44%)0.01 (+33.21%)205.00 (+2.50%)164.00 (-2.38%)161.00 (+0.62%)133.00 (-11.33%)23.61 (+23.70%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)168.00 (n/a)160.00 (n/a)150.00 (n/a)19.09 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:443.82 (+3.61%)3.61 (-0.79%)3.57 (-2.73%)3.41 (-2.47%)0.17 (+132.87%)6873.00 (+2.54%)6505.20 (+0.97%)6569.00 (+2.80%)6130.00 (-3.48%)303.48 (+128.91%)
fbf1591 — 2025-11-13 03:39:223.69 (n/a)3.64 (n/a)3.67 (n/a)3.50 (n/a)0.07 (n/a)6703.00 (n/a)6442.40 (n/a)6390.00 (n/a)6351.00 (n/a)132.58 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-8.82%)0.07 (-1.02%)0.07 (-2.31%)0.07 (+4.76%)0.01 (-33.93%)189.00 (-4.55%)168.20 (-0.47%)173.00 (+2.37%)136.00 (+9.68%)17.88 (-31.87%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)198.00 (n/a)169.00 (n/a)169.00 (n/a)124.00 (n/a)26.24 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (-13.82%)0.07 (-10.33%)0.08 (+7.74%)0.04 (-33.65%)0.02 (+36.74%)315.00 (+50.72%)193.80 (+17.60%)155.00 (-7.19%)152.00 (+16.03%)62.49 (+138.09%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)209.00 (n/a)164.80 (n/a)167.00 (n/a)131.00 (n/a)26.25 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-10.07%)0.08 (+13.37%)0.08 (+12.84%)0.08 (+42.21%)0.00 (-77.33%)154.00 (-29.68%)146.20 (-14.60%)148.00 (-11.38%)139.00 (+11.20%)5.49 (-82.19%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)219.00 (n/a)171.20 (n/a)167.00 (n/a)125.00 (n/a)30.83 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.11 (+27.59%)0.08 (+22.75%)0.07 (+10.92%)0.06 (+26.56%)0.02 (+41.65%)192.00 (-20.99%)160.20 (-18.01%)174.00 (-9.84%)116.00 (-21.62%)26.97 (-12.42%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)243.00 (n/a)195.40 (n/a)193.00 (n/a)148.00 (n/a)30.79 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (+6.16%)0.07 (+23.20%)0.08 (+43.51%)0.05 (+2.22%)0.01 (+19.11%)270.00 (-2.17%)178.00 (-17.67%)154.00 (-30.32%)146.00 (-5.81%)46.50 (+15.45%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)276.00 (n/a)216.20 (n/a)221.00 (n/a)155.00 (n/a)40.28 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+8.57%)0.07 (+10.88%)0.07 (+32.37%)0.04 (-11.25%)0.02 (+41.28%)329.00 (+12.67%)209.20 (-4.47%)173.00 (-24.45%)140.00 (-7.89%)74.83 (+44.50%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)292.00 (n/a)219.00 (n/a)229.00 (n/a)152.00 (n/a)51.78 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (-10.08%)0.08 (-3.28%)0.07 (-8.93%)0.06 (+33.33%)0.01 (-45.26%)198.00 (-25.00%)166.60 (-2.46%)168.00 (+9.80%)129.00 (+11.21%)22.11 (-56.87%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)264.00 (n/a)170.80 (n/a)153.00 (n/a)116.00 (n/a)51.27 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+22.30%)0.08 (+26.94%)0.08 (+28.86%)0.06 (+30.21%)0.01 (-3.53%)192.00 (-23.20%)155.80 (-21.87%)149.00 (-22.40%)139.00 (-18.24%)18.86 (-37.12%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)199.40 (n/a)192.00 (n/a)170.00 (n/a)30.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (+16.88%)0.05 (+14.81%)0.05 (+21.49%)0.04 (+2.59%)0.00 (+108.13%)0.05 (+16.88%)0.05 (+14.81%)0.05 (+21.49%)0.04 (+2.59%)0.00 (+108.13%)811.00 (-2.52%)686.00 (-12.34%)656.00 (-17.69%)616.00 (-14.44%)66.97 (+77.97%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)832.00 (n/a)782.60 (n/a)797.00 (n/a)720.00 (n/a)37.63 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4411.27 (-1.01%)10.54 (-2.96%)10.88 (+0.78%)9.63 (-6.28%)0.74 (+103.36%)11.27 (-1.01%)10.53 (-2.96%)10.87 (+0.78%)9.62 (-6.28%)0.74 (+103.36%)3487.00 (+6.70%)3203.00 (+3.45%)3086.00 (-0.77%)2978.00 (+1.02%)229.69 (+120.04%)
fbf1591 — 2025-11-13 03:39:2211.39 (n/a)10.86 (n/a)10.80 (n/a)10.27 (n/a)0.36 (n/a)11.38 (n/a)10.85 (n/a)10.79 (n/a)10.27 (n/a)0.36 (n/a)3268.00 (n/a)3096.20 (n/a)3110.00 (n/a)2948.00 (n/a)104.38 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4417.52 (+5.58%)16.80 (+4.29%)16.72 (+4.08%)16.05 (+2.68%)0.48 (+49.40%)17.51 (+5.58%)16.79 (+4.29%)16.71 (+4.08%)16.04 (+2.68%)0.48 (+49.39%)2092.00 (-2.61%)2000.20 (-4.08%)2008.00 (-3.92%)1916.00 (-5.29%)57.51 (+37.94%)
fbf1591 — 2025-11-13 03:39:2216.60 (n/a)16.11 (n/a)16.06 (n/a)15.63 (n/a)0.32 (n/a)16.59 (n/a)16.10 (n/a)16.05 (n/a)15.62 (n/a)0.32 (n/a)2148.00 (n/a)2085.20 (n/a)2090.00 (n/a)2023.00 (n/a)41.69 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4421.87 (+5.99%)19.48 (+2.28%)19.46 (+3.83%)17.28 (-6.02%)1.46 (+75.35%)21.86 (+5.99%)19.47 (+2.28%)19.45 (+3.83%)17.27 (-6.02%)1.46 (+75.35%)1943.00 (+6.41%)1733.40 (-1.86%)1725.00 (-3.69%)1535.00 (-5.65%)129.23 (+76.51%)
fbf1591 — 2025-11-13 03:39:2220.64 (n/a)19.04 (n/a)18.75 (n/a)18.39 (n/a)0.83 (n/a)20.62 (n/a)19.03 (n/a)18.73 (n/a)18.38 (n/a)0.83 (n/a)1826.00 (n/a)1766.20 (n/a)1791.00 (n/a)1627.00 (n/a)73.21 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4419.04 (-2.04%)18.46 (+10.04%)18.76 (+17.26%)17.14 (+27.16%)0.69 (-70.04%)19.03 (-2.04%)18.45 (+10.04%)18.75 (+17.26%)17.13 (+27.16%)0.69 (-70.04%)1959.00 (-21.36%)1821.40 (-10.72%)1790.00 (-14.72%)1763.00 (+2.08%)71.15 (-75.07%)
fbf1591 — 2025-11-13 03:39:2219.44 (n/a)16.78 (n/a)16.00 (n/a)13.48 (n/a)2.29 (n/a)19.43 (n/a)16.77 (n/a)15.99 (n/a)13.47 (n/a)2.29 (n/a)2491.00 (n/a)2040.20 (n/a)2099.00 (n/a)1727.00 (n/a)285.41 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4411.23 (-0.64%)10.74 (+0.48%)10.90 (+1.01%)9.79 (+0.79%)0.50 (-6.60%)11.23 (-0.64%)10.74 (+0.48%)10.89 (+1.01%)9.78 (+0.79%)0.50 (-6.60%)3430.00 (-0.78%)3132.60 (-0.51%)3080.00 (-1.00%)2989.00 (+0.64%)154.11 (-6.71%)
fbf1591 — 2025-11-13 03:39:2211.30 (n/a)10.69 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)11.30 (n/a)10.68 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)3457.00 (n/a)3148.60 (n/a)3111.00 (n/a)2970.00 (n/a)165.20 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4418.12 (+5.23%)16.54 (+3.41%)15.93 (+0.62%)15.84 (+9.53%)0.88 (-6.01%)18.11 (+5.23%)16.53 (+3.41%)15.93 (+0.62%)15.83 (+9.53%)0.88 (-6.01%)2120.00 (-8.70%)2035.40 (-3.38%)2107.00 (-0.61%)1853.00 (-4.97%)103.89 (-18.27%)
fbf1591 — 2025-11-13 03:39:2217.22 (n/a)15.99 (n/a)15.84 (n/a)14.46 (n/a)0.94 (n/a)17.21 (n/a)15.98 (n/a)15.83 (n/a)14.45 (n/a)0.94 (n/a)2322.00 (n/a)2106.60 (n/a)2120.00 (n/a)1950.00 (n/a)127.11 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4422.49 (+11.99%)21.55 (+12.57%)21.58 (+12.98%)20.42 (+11.37%)0.81 (+38.88%)22.47 (+11.99%)21.54 (+12.57%)21.56 (+12.98%)20.41 (+11.37%)0.81 (+38.88%)1644.00 (-10.21%)1560.00 (-11.12%)1556.00 (-11.49%)1493.00 (-10.71%)58.94 (+11.03%)
fbf1591 — 2025-11-13 03:39:2220.08 (n/a)19.15 (n/a)19.10 (n/a)18.34 (n/a)0.58 (n/a)20.07 (n/a)19.13 (n/a)19.09 (n/a)18.33 (n/a)0.58 (n/a)1831.00 (n/a)1755.20 (n/a)1758.00 (n/a)1672.00 (n/a)53.09 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:4420.37 (+8.86%)18.42 (+2.92%)19.28 (+6.89%)15.79 (-2.87%)1.67 (+92.52%)20.36 (+8.86%)18.41 (+2.92%)19.27 (+6.89%)15.78 (-2.87%)1.66 (+92.52%)2127.00 (+2.95%)1838.20 (-2.24%)1741.00 (-6.45%)1648.00 (-8.14%)174.69 (+81.17%)
fbf1591 — 2025-11-13 03:39:2218.72 (n/a)17.90 (n/a)18.04 (n/a)16.25 (n/a)0.86 (n/a)18.70 (n/a)17.89 (n/a)18.03 (n/a)16.24 (n/a)0.86 (n/a)2066.00 (n/a)1880.40 (n/a)1861.00 (n/a)1794.00 (n/a)96.42 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+21.82%)0.06 (+16.78%)0.06 (+7.58%)0.05 (+23.95%)0.01 (+11.89%)167.00 (-19.32%)136.40 (-14.75%)132.00 (-7.04%)110.00 (-17.91%)20.66 (-25.33%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)160.00 (n/a)142.00 (n/a)134.00 (n/a)27.66 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (-12.95%)0.05 (-10.79%)0.05 (-2.01%)0.03 (-36.48%)0.01 (+83.39%)233.00 (+57.43%)163.20 (+15.58%)149.00 (+2.05%)139.00 (+14.88%)35.25 (+243.42%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)148.00 (n/a)141.20 (n/a)146.00 (n/a)121.00 (n/a)10.26 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+1.64%)0.05 (-7.73%)0.05 (-4.26%)0.03 (-36.29%)0.01 (+145.31%)237.00 (+56.95%)156.40 (+13.66%)141.00 (+4.44%)122.00 (-1.61%)41.14 (+296.92%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)151.00 (n/a)137.60 (n/a)135.00 (n/a)124.00 (n/a)10.37 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+16.04%)0.06 (+30.91%)0.06 (+44.88%)0.05 (+63.70%)0.01 (-37.14%)146.00 (-38.91%)126.40 (-27.02%)127.00 (-30.98%)106.00 (-13.82%)14.29 (-65.88%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)239.00 (n/a)173.20 (n/a)184.00 (n/a)123.00 (n/a)41.89 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (-1.72%)0.06 (+1.52%)0.06 (+7.38%)0.04 (-10.87%)0.01 (+28.83%)184.00 (+12.20%)134.40 (-0.15%)122.00 (-6.87%)116.00 (+1.75%)25.14 (+49.56%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.00 (n/a)134.60 (n/a)131.00 (n/a)114.00 (n/a)16.81 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+53.45%)0.05 (+34.27%)0.05 (+28.19%)0.04 (+32.29%)0.01 (+83.14%)192.00 (-24.41%)151.00 (-24.80%)149.00 (-21.99%)116.00 (-34.83%)24.45 (-11.33%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)254.00 (n/a)200.80 (n/a)191.00 (n/a)178.00 (n/a)27.58 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (+11.27%)0.05 (+12.57%)0.05 (+5.23%)0.05 (+25.47%)0.00 (-43.77%)161.00 (-20.30%)151.20 (-11.79%)153.00 (-4.97%)142.00 (-10.13%)6.88 (-59.55%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)202.00 (n/a)171.40 (n/a)161.00 (n/a)158.00 (n/a)17.01 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+20.61%)0.05 (+34.35%)0.05 (+44.14%)0.05 (+29.52%)0.00 (+1.95%)166.00 (-22.79%)147.80 (-25.88%)145.00 (-30.62%)131.00 (-17.09%)14.05 (-33.35%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)215.00 (n/a)199.40 (n/a)209.00 (n/a)158.00 (n/a)21.08 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
c3de77d — 2025-11-13 16:07:440.09 (-2.11%)0.09 (-1.94%)0.09 (+0.01%)0.08 (-3.49%)0.00 (+35.74%)65.36 (-2.11%)63.09 (-1.94%)63.76 (+0.01%)60.68 (-3.49%)1.83 (+35.74%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.09 (n/a)0.09 (n/a)0.00 (n/a)66.76 (n/a)64.33 (n/a)63.75 (n/a)62.87 (n/a)1.35 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+51.14%)0.06 (+24.74%)0.06 (+17.16%)0.05 (+30.57%)0.01 (+75.17%)157.00 (-23.41%)129.60 (-18.80%)134.00 (-14.65%)88.00 (-33.83%)22.95 (-13.50%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)205.00 (n/a)159.60 (n/a)157.00 (n/a)133.00 (n/a)26.53 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+11.30%)0.06 (+6.34%)0.06 (+11.90%)0.05 (+1.24%)0.01 (+72.51%)161.00 (-1.23%)135.20 (-4.92%)126.00 (-10.64%)115.00 (-10.16%)18.31 (+53.59%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)163.00 (n/a)142.20 (n/a)141.00 (n/a)128.00 (n/a)11.92 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+8.87%)0.05 (+24.43%)0.05 (+10.07%)0.04 (+73.45%)0.01 (-52.09%)177.00 (-42.35%)151.60 (-27.33%)149.00 (-9.15%)124.00 (-8.15%)17.62 (-75.74%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)307.00 (n/a)208.60 (n/a)164.00 (n/a)135.00 (n/a)72.66 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.05 (-3.52%)0.04 (-14.86%)0.04 (-18.37%)0.03 (-26.41%)0.01 (+85.14%)231.00 (+35.88%)191.00 (+20.13%)196.00 (+22.50%)142.00 (+3.65%)30.84 (+159.55%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)170.00 (n/a)159.00 (n/a)160.00 (n/a)137.00 (n/a)11.88 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (+16.36%)0.09 (+12.78%)0.09 (+2.24%)0.08 (+16.00%)0.01 (+25.13%)150.00 (-13.79%)128.60 (-11.19%)134.00 (-2.19%)110.00 (-14.06%)15.04 (-9.68%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)174.00 (n/a)144.80 (n/a)137.00 (n/a)128.00 (n/a)16.65 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+0.00%)0.08 (+8.65%)0.08 (+3.36%)0.07 (+54.32%)0.01 (-56.40%)162.00 (-35.20%)147.40 (-12.16%)149.00 (-3.25%)128.00 (+0.00%)11.57 (-73.11%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)167.80 (n/a)154.00 (n/a)128.00 (n/a)43.02 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+7.75%)0.07 (+2.65%)0.07 (+4.35%)0.07 (-2.30%)0.01 (+44.21%)174.00 (+2.35%)156.20 (-2.01%)161.00 (-4.17%)129.00 (-7.19%)16.46 (+36.12%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)159.40 (n/a)168.00 (n/a)139.00 (n/a)12.09 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (-8.70%)0.09 (+15.51%)0.08 (+18.52%)0.07 (+51.57%)0.01 (-50.89%)159.00 (-34.02%)132.80 (-18.33%)135.00 (-15.62%)115.00 (+9.52%)15.55 (-65.06%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.07 (n/a)0.05 (n/a)0.02 (n/a)241.00 (n/a)162.60 (n/a)160.00 (n/a)105.00 (n/a)44.50 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (-10.29%)0.07 (-9.58%)0.07 (-13.25%)0.06 (-6.63%)0.01 (-26.62%)181.00 (+7.10%)159.00 (+9.96%)166.00 (+15.28%)136.00 (+11.48%)16.00 (-12.85%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)169.00 (n/a)144.60 (n/a)144.00 (n/a)122.00 (n/a)18.36 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (-6.08%)0.07 (-6.38%)0.07 (-13.14%)0.06 (+28.43%)0.01 (-45.62%)197.00 (-22.13%)173.80 (+2.96%)175.00 (+15.13%)148.00 (+6.47%)18.71 (-56.12%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)253.00 (n/a)168.80 (n/a)152.00 (n/a)139.00 (n/a)42.65 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.11 (+28.70%)0.07 (-1.94%)0.07 (-2.56%)0.04 (-35.47%)0.02 (+276.86%)265.00 (+54.97%)174.20 (+11.38%)156.00 (+2.63%)108.00 (-22.30%)54.59 (+353.92%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.00 (n/a)156.40 (n/a)152.00 (n/a)139.00 (n/a)12.03 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.09 (+22.40%)0.07 (+37.57%)0.07 (+34.64%)0.05 (+55.14%)0.01 (+4.62%)214.00 (-35.54%)163.20 (-29.59%)153.00 (-25.73%)125.00 (-18.30%)34.84 (-46.21%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)332.00 (n/a)231.80 (n/a)206.00 (n/a)153.00 (n/a)64.77 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.20 (+19.83%)0.17 (+38.89%)0.17 (+32.58%)0.15 (+68.18%)0.02 (-37.88%)154.00 (-40.54%)133.80 (-30.96%)132.00 (-24.57%)116.00 (-16.55%)13.48 (-69.79%)
fbf1591 — 2025-11-13 03:39:220.16 (n/a)0.12 (n/a)0.13 (n/a)0.09 (n/a)0.03 (n/a)259.00 (n/a)193.80 (n/a)175.00 (n/a)139.00 (n/a)44.62 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.21 (+5.50%)0.18 (+9.61%)0.18 (+15.50%)0.14 (-0.62%)0.02 (+13.93%)162.00 (+0.62%)130.20 (-8.44%)129.00 (-13.42%)109.00 (-5.22%)19.07 (+6.93%)
fbf1591 — 2025-11-13 03:39:220.20 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)161.00 (n/a)142.20 (n/a)149.00 (n/a)115.00 (n/a)17.84 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.23 (+21.78%)0.16 (+4.71%)0.15 (-8.05%)0.14 (+33.54%)0.03 (+17.37%)164.00 (-25.11%)144.20 (-5.26%)149.00 (+8.76%)101.00 (-17.89%)23.13 (-32.26%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.17 (n/a)0.10 (n/a)0.03 (n/a)219.00 (n/a)152.20 (n/a)137.00 (n/a)123.00 (n/a)34.14 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.16 (+24.14%)0.14 (+24.37%)0.14 (+21.30%)0.12 (+26.06%)0.01 (+47.28%)188.00 (-20.68%)165.80 (-19.36%)169.00 (-17.56%)145.00 (-19.44%)17.27 (-7.79%)
fbf1591 — 2025-11-13 03:39:220.13 (n/a)0.11 (n/a)0.11 (n/a)0.10 (n/a)0.01 (n/a)237.00 (n/a)205.60 (n/a)205.00 (n/a)180.00 (n/a)18.73 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.07 (+24.11%)0.06 (+29.21%)0.06 (+30.16%)0.05 (+37.50%)0.01 (+3.04%)152.00 (-27.27%)128.00 (-23.17%)126.00 (-23.17%)112.00 (-19.42%)14.25 (-40.41%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)209.00 (n/a)166.60 (n/a)164.00 (n/a)139.00 (n/a)23.92 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+7.94%)0.05 (+6.72%)0.05 (-1.33%)0.05 (+44.03%)0.00 (-47.13%)159.00 (-30.57%)147.00 (-9.03%)150.00 (+1.35%)126.00 (-7.35%)11.08 (-67.72%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)229.00 (n/a)161.60 (n/a)148.00 (n/a)136.00 (n/a)34.33 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+10.57%)0.05 (-4.33%)0.05 (-6.54%)0.04 (-13.13%)0.01 (+82.81%)198.00 (+15.12%)160.00 (+6.38%)153.00 (+6.99%)123.00 (-9.56%)24.99 (+89.09%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)172.00 (n/a)150.40 (n/a)143.00 (n/a)136.00 (n/a)13.22 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.06 (+20.00%)0.06 (+26.79%)0.05 (+18.31%)0.05 (+65.85%)0.01 (-18.50%)164.00 (-39.71%)139.80 (-23.69%)142.00 (-15.48%)120.00 (-16.67%)17.23 (-62.11%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)272.00 (n/a)183.20 (n/a)168.00 (n/a)144.00 (n/a)45.48 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.23 (+20.20%)0.19 (+20.23%)0.18 (+14.73%)0.16 (+19.86%)0.03 (+32.34%)141.00 (-16.57%)124.20 (-16.53%)129.00 (-12.84%)99.00 (-16.81%)16.03 (-5.83%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)169.00 (n/a)148.80 (n/a)148.00 (n/a)119.00 (n/a)17.02 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.23 (+26.53%)0.18 (+10.56%)0.18 (+7.94%)0.13 (-1.73%)0.04 (+88.46%)173.00 (+1.76%)135.00 (-7.28%)126.00 (-7.35%)98.00 (-20.97%)26.22 (+50.63%)
fbf1591 — 2025-11-13 03:39:220.18 (n/a)0.16 (n/a)0.17 (n/a)0.13 (n/a)0.02 (n/a)170.00 (n/a)145.60 (n/a)136.00 (n/a)124.00 (n/a)17.41 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.19 (+22.95%)0.16 (+23.19%)0.16 (+22.30%)0.13 (+52.78%)0.02 (-22.86%)180.00 (-34.55%)144.60 (-21.50%)139.00 (-18.24%)122.00 (-18.67%)19.18 (-58.74%)
fbf1591 — 2025-11-13 03:39:220.15 (n/a)0.13 (n/a)0.13 (n/a)0.08 (n/a)0.03 (n/a)275.00 (n/a)184.20 (n/a)170.00 (n/a)150.00 (n/a)46.48 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:442.82 (-5.20%)2.54 (+9.67%)2.64 (+18.92%)2.10 (+19.31%)0.26 (-40.66%)233.00 (-16.19%)194.80 (-10.97%)185.00 (-15.91%)173.00 (+5.49%)21.53 (-46.87%)
fbf1591 — 2025-11-13 03:39:222.98 (n/a)2.31 (n/a)2.22 (n/a)1.76 (n/a)0.44 (n/a)278.00 (n/a)218.80 (n/a)220.00 (n/a)164.00 (n/a)40.51 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:443.73 (-9.16%)3.02 (-5.99%)3.28 (+9.40%)2.34 (-6.22%)0.57 (+1.87%)209.00 (+6.63%)168.00 (+7.28%)149.00 (-8.59%)131.00 (+10.08%)33.19 (+26.15%)
fbf1591 — 2025-11-13 03:39:224.10 (n/a)3.21 (n/a)3.00 (n/a)2.49 (n/a)0.56 (n/a)196.00 (n/a)156.60 (n/a)163.00 (n/a)119.00 (n/a)26.31 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (+2.73%)0.08 (-7.83%)0.08 (-8.00%)0.06 (-28.37%)0.02 (+88.81%)208.00 (+39.60%)149.80 (+12.46%)150.00 (+8.70%)110.00 (-2.65%)33.19 (+160.98%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.01 (n/a)149.00 (n/a)133.20 (n/a)138.00 (n/a)113.00 (n/a)12.72 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (+2.50%)0.09 (+3.75%)0.08 (-2.90%)0.08 (+5.71%)0.01 (-0.20%)140.00 (-5.41%)131.60 (-3.66%)138.00 (+2.99%)120.00 (-2.44%)8.71 (-9.32%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)148.00 (n/a)136.60 (n/a)134.00 (n/a)123.00 (n/a)9.60 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.10 (+9.91%)0.09 (+3.28%)0.09 (+1.49%)0.07 (-9.68%)0.01 (+158.38%)155.00 (+10.71%)130.20 (-1.81%)134.00 (-1.47%)111.00 (-9.02%)16.77 (+153.34%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)140.00 (n/a)132.60 (n/a)136.00 (n/a)122.00 (n/a)6.62 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3de77d — 2025-11-13 16:07:440.08 (+15.11%)0.07 (+16.49%)0.07 (+17.50%)0.06 (+30.69%)0.01 (-8.07%)189.00 (-23.48%)163.60 (-14.97%)160.00 (-14.89%)139.00 (-13.12%)17.92 (-39.80%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)247.00 (n/a)192.40 (n/a)188.00 (n/a)160.00 (n/a)29.76 (n/a)

Victor-Jung
Victor-Jung previously approved these changes Nov 13, 2025
Copy link
Collaborator

@Victor-Jung Victor-Jung left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Only point is the .github folder structure, I just prefer to have .yml files with a meaningful name, whatever the approach (composable or reusable_workflow).

@github-actions
Copy link

📊 Test Results for Small Benchmark/Test Suite

56543a2 (2025_11_13_17_59_12)

IRONCLAD

Tested on 2025_11_13_17_59_12 at commit 56543a2.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 190.80 0.06 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 181.80 0.07 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 163.40 0.07 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 184.60 0.06 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 140.80 0.04 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 150.00 0.03 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 152.20 0.03 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 138.20 0.04 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 172.00 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 139.80 0.04 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 171.00 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 218.00 0.02 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 138.80 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 143.80 0.08 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 178.20 0.07 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 164.80 0.07 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 165.40 0.07 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 158.80 0.08 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 154.20 0.08 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 153.60 0.08 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 136.80 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 146.80 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 169.20 0.05 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 165.60 0.05 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 143.40 0.06 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 173.60 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 141.80 0.06 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 187.60 0.04 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6654.80 3.53 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 188.20 0.07 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 149.20 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 143.80 0.09 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 149.60 0.08 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 198.40 0.07 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 149.00 0.08 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 162.00 0.08 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 165.20 0.08 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 757.80 0.04 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3044.20 11.03 11.02
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 1942.40 17.29 17.28
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1604.00 21.00 20.99
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2149.00 15.64 15.63
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3031.80 11.08 11.08
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 1987.20 16.91 16.90
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1672.20 20.13 20.11
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 1938.80 17.52 17.51
mem_copy_1_cols_1_channels_2048_tile_2048 ✅ 5/5 169.20 0.05 n/a
mem_copy_1_cols_2_channels_2048_tile_1024 ✅ 5/5 180.80 0.05 n/a
mem_copy_2_cols_1_channels_2048_tile_1024 ✅ 5/5 182.00 0.04 n/a
mem_copy_2_cols_2_channels_2048_tile_512 ✅ 5/5 161.00 0.05 n/a
mem_copy_4_cols_1_channels_2048_tile_512 ✅ 5/5 190.20 0.04 n/a
mem_copy_4_cols_2_channels_2048_tile_256 ✅ 5/5 151.00 0.05 n/a
mem_copy_8_cols_1_channels_2048_tile_256 ✅ 5/5 211.40 0.04 n/a
mem_copy_8_cols_2_channels_2048_tile_128 ✅ 5/5 195.00 0.04 n/a
mha ✅ 5/5 n/a 0.09 62.44
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 154.40 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 194.80 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 178.80 0.04 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 161.00 0.05 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 183.20 0.06 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 181.80 0.07 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 185.20 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 164.20 0.07 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 145.20 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 159.20 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 177.80 0.07 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 186.60 0.06 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 159.60 0.15 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 168.20 0.14 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 149.80 0.16 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 159.80 0.14 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 134.60 0.06 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 159.20 0.05 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 205.80 0.04 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 217.80 0.04 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 138.60 0.17 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 139.20 0.17 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 137.60 0.17 n/a
swiglu ✅ 5/5 n/a n/a n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 176.80 2.77 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 151.20 3.24 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 162.40 0.07 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 145.40 0.08 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 139.40 0.08 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 143.00 0.08 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

56543a2 (2025_11_13_17_59_12)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-10.00%)0.06 (-24.11%)0.06 (-27.69%)0.05 (-33.93%)0.01 (+326.57%)224.00 (+51.35%)190.80 (+35.32%)195.00 (+38.30%)150.00 (+11.11%)30.90 (+628.38%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)148.00 (n/a)141.00 (n/a)141.00 (n/a)135.00 (n/a)4.24 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-27.63%)0.07 (-5.81%)0.07 (+1.23%)0.04 (+9.37%)0.01 (-45.90%)256.00 (-8.57%)181.80 (+0.66%)162.00 (-1.22%)152.00 (+38.18%)38.35 (-31.08%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)280.00 (n/a)180.60 (n/a)164.00 (n/a)110.00 (n/a)55.64 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-5.30%)0.07 (-5.46%)0.08 (-3.97%)0.05 (-3.20%)0.01 (-6.87%)219.00 (+3.30%)163.40 (+5.56%)151.00 (+4.14%)132.00 (+5.60%)29.94 (+0.23%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)212.00 (n/a)154.80 (n/a)145.00 (n/a)125.00 (n/a)29.87 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-2.82%)0.06 (-0.04%)0.07 (+11.31%)0.05 (-13.89%)0.01 (+15.98%)252.00 (+16.13%)184.60 (+1.65%)168.00 (-10.16%)142.00 (+2.90%)39.67 (+40.47%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)217.00 (n/a)181.60 (n/a)187.00 (n/a)138.00 (n/a)28.24 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (+42.50%)0.04 (+43.19%)0.04 (+40.15%)0.03 (+82.72%)0.00 (-12.34%)162.00 (-45.27%)140.80 (-32.05%)137.00 (-28.65%)120.00 (-29.82%)14.99 (-67.13%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)296.00 (n/a)207.20 (n/a)192.00 (n/a)171.00 (n/a)45.59 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (-26.32%)0.03 (-10.02%)0.03 (-3.31%)0.03 (+0.60%)0.00 (-60.23%)168.00 (-0.59%)150.00 (+8.23%)151.00 (+3.42%)133.00 (+35.71%)13.10 (-44.95%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)169.00 (n/a)138.60 (n/a)146.00 (n/a)98.00 (n/a)23.80 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (-1.57%)0.03 (-3.52%)0.03 (-3.27%)0.03 (-12.22%)0.00 (+33.33%)180.00 (+13.92%)152.20 (+4.39%)153.00 (+3.38%)127.00 (+1.60%)17.86 (+55.82%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)158.00 (n/a)145.80 (n/a)148.00 (n/a)125.00 (n/a)11.46 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (+14.41%)0.04 (+27.38%)0.03 (+30.50%)0.03 (+34.84%)0.00 (-31.14%)155.00 (-25.84%)138.20 (-22.88%)141.00 (-23.37%)118.00 (-12.59%)11.92 (-56.23%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)209.00 (n/a)179.20 (n/a)184.00 (n/a)135.00 (n/a)27.24 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.03 (-22.70%)0.03 (-17.59%)0.03 (-21.43%)0.02 (+9.05%)0.00 (-54.19%)199.00 (-8.29%)172.00 (+16.37%)168.00 (+27.27%)141.00 (+29.36%)19.90 (-47.31%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)217.00 (n/a)147.80 (n/a)132.00 (n/a)109.00 (n/a)37.76 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (-6.30%)0.04 (+11.75%)0.03 (+11.49%)0.03 (+31.08%)0.00 (-55.07%)148.00 (-23.71%)139.80 (-12.84%)148.00 (-10.30%)127.00 (+6.72%)10.05 (-63.32%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)194.00 (n/a)160.40 (n/a)165.00 (n/a)119.00 (n/a)27.39 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.03 (-3.92%)0.03 (-5.03%)0.03 (-5.29%)0.02 (-5.10%)0.00 (-13.26%)196.00 (+5.38%)171.00 (+5.17%)170.00 (+5.59%)153.00 (+4.08%)14.27 (-2.79%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)186.00 (n/a)162.60 (n/a)161.00 (n/a)147.00 (n/a)14.68 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (+18.12%)0.02 (+15.34%)0.03 (+17.02%)0.02 (+5.28%)0.01 (+43.68%)322.00 (-5.01%)218.00 (-9.77%)188.00 (-14.55%)138.00 (-15.34%)69.87 (+17.41%)
fbf1591 — 2025-11-13 03:39:220.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)339.00 (n/a)241.60 (n/a)220.00 (n/a)163.00 (n/a)59.50 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+33.95%)0.08 (+9.81%)0.08 (+0.67%)0.08 (+1.97%)0.01 (+644.82%)152.00 (-1.94%)138.80 (-7.47%)149.00 (-0.67%)109.00 (-25.34%)16.65 (+449.07%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)155.00 (n/a)150.00 (n/a)150.00 (n/a)146.00 (n/a)3.03 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-9.76%)0.08 (-15.93%)0.08 (-26.32%)0.07 (-14.02%)0.01 (+6.20%)164.00 (+16.31%)143.80 (+19.44%)152.00 (+35.71%)123.00 (+10.81%)16.30 (+36.31%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)141.00 (n/a)120.40 (n/a)112.00 (n/a)111.00 (n/a)11.96 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (-21.57%)0.07 (-19.72%)0.07 (-14.47%)0.04 (-33.85%)0.01 (+26.16%)257.00 (+51.18%)178.20 (+27.83%)159.00 (+16.91%)153.00 (+27.50%)39.83 (+140.88%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)139.40 (n/a)136.00 (n/a)120.00 (n/a)16.54 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-23.13%)0.07 (-17.16%)0.07 (-20.96%)0.06 (-12.37%)0.01 (-45.14%)186.00 (+14.11%)164.80 (+19.42%)167.00 (+26.52%)147.00 (+30.09%)15.00 (-21.30%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)163.00 (n/a)138.00 (n/a)132.00 (n/a)113.00 (n/a)19.06 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-7.46%)0.07 (-12.15%)0.07 (-10.06%)0.05 (-30.57%)0.01 (+64.40%)229.00 (+44.03%)165.40 (+16.81%)159.00 (+11.19%)134.00 (+8.06%)33.22 (+166.44%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)159.00 (n/a)141.60 (n/a)143.00 (n/a)124.00 (n/a)12.47 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-0.81%)0.08 (-6.49%)0.09 (+6.92%)0.05 (-21.33%)0.02 (+108.45%)211.00 (+27.11%)158.80 (+11.83%)130.00 (-6.47%)123.00 (+0.82%)38.37 (+167.88%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)166.00 (n/a)142.00 (n/a)139.00 (n/a)122.00 (n/a)14.32 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-15.67%)0.08 (-6.16%)0.08 (-2.70%)0.06 (+9.29%)0.01 (-40.77%)183.00 (-8.50%)154.20 (+4.19%)148.00 (+2.78%)134.00 (+18.58%)18.59 (-36.90%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)200.00 (n/a)148.00 (n/a)144.00 (n/a)113.00 (n/a)29.47 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+9.45%)0.08 (+8.73%)0.07 (+8.23%)0.06 (+18.23%)0.01 (-19.92%)181.00 (-15.42%)153.60 (-9.22%)158.00 (-7.60%)127.00 (-8.63%)17.83 (-36.48%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)214.00 (n/a)169.20 (n/a)171.00 (n/a)139.00 (n/a)28.07 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (+15.45%)0.06 (+25.50%)0.06 (+29.29%)0.05 (+49.68%)0.01 (-27.06%)157.00 (-33.19%)136.80 (-23.15%)140.00 (-22.65%)110.00 (-13.39%)17.36 (-56.99%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)235.00 (n/a)178.00 (n/a)181.00 (n/a)127.00 (n/a)40.36 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (-4.92%)0.06 (-2.65%)0.06 (-7.43%)0.05 (+13.79%)0.01 (-24.47%)174.00 (-12.12%)146.80 (+1.10%)148.00 (+8.03%)122.00 (+5.17%)19.04 (-32.74%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)198.00 (n/a)145.20 (n/a)137.00 (n/a)116.00 (n/a)28.31 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-26.35%)0.05 (-19.58%)0.05 (-18.45%)0.04 (+7.25%)0.00 (-64.91%)193.00 (-6.76%)169.20 (+19.32%)168.00 (+22.63%)148.00 (+35.78%)14.85 (-56.88%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)141.80 (n/a)137.00 (n/a)109.00 (n/a)34.44 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-5.84%)0.05 (-13.77%)0.05 (-17.07%)0.04 (-19.23%)0.01 (+39.35%)208.00 (+23.81%)165.60 (+17.61%)164.00 (+20.59%)137.00 (+6.20%)25.99 (+79.96%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.00 (n/a)140.80 (n/a)136.00 (n/a)129.00 (n/a)14.44 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (+25.41%)0.06 (+23.45%)0.06 (+8.78%)0.05 (+45.45%)0.01 (-21.16%)154.00 (-31.25%)143.40 (-20.16%)148.00 (-8.07%)122.00 (-20.26%)12.03 (-56.52%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)224.00 (n/a)179.60 (n/a)161.00 (n/a)153.00 (n/a)27.66 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-25.83%)0.05 (-13.11%)0.05 (-7.43%)0.04 (-5.21%)0.00 (-57.70%)192.00 (+5.49%)173.60 (+12.73%)175.00 (+8.02%)151.00 (+34.82%)14.81 (-38.19%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)182.00 (n/a)154.00 (n/a)162.00 (n/a)112.00 (n/a)23.97 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (+5.30%)0.06 (+21.41%)0.06 (+22.38%)0.05 (+51.33%)0.00 (-61.70%)150.00 (-33.92%)141.80 (-19.52%)143.00 (-18.29%)132.00 (-5.04%)6.88 (-76.27%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)227.00 (n/a)176.20 (n/a)175.00 (n/a)139.00 (n/a)29.00 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-5.06%)0.04 (-10.17%)0.04 (-13.98%)0.04 (-7.41%)0.01 (+4.19%)216.00 (+8.00%)187.60 (+11.67%)186.00 (+16.25%)158.00 (+5.33%)23.05 (+20.76%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)168.00 (n/a)160.00 (n/a)150.00 (n/a)19.09 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:263.77 (+2.22%)3.53 (-3.06%)3.48 (-5.12%)3.36 (-4.04%)0.15 (+107.06%)6985.00 (+4.21%)6654.80 (+3.30%)6735.00 (+5.40%)6213.00 (-2.17%)278.98 (+110.43%)
fbf1591 — 2025-11-13 03:39:223.69 (n/a)3.64 (n/a)3.67 (n/a)3.50 (n/a)0.07 (n/a)6703.00 (n/a)6442.40 (n/a)6390.00 (n/a)6351.00 (n/a)132.58 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (-3.13%)0.07 (-7.16%)0.07 (-2.87%)0.05 (-23.55%)0.02 (+28.47%)259.00 (+30.81%)188.20 (+11.36%)174.00 (+2.96%)128.00 (+3.23%)46.40 (+76.81%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)198.00 (n/a)169.00 (n/a)169.00 (n/a)124.00 (n/a)26.24 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+3.15%)0.08 (+8.61%)0.08 (+11.33%)0.08 (+28.22%)0.01 (-36.11%)163.00 (-22.01%)149.20 (-9.47%)150.00 (-10.18%)127.00 (-3.05%)12.53 (-52.27%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)209.00 (n/a)164.80 (n/a)167.00 (n/a)131.00 (n/a)26.25 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+1.63%)0.09 (+15.86%)0.08 (+15.17%)0.08 (+40.38%)0.01 (-47.86%)156.00 (-28.77%)143.80 (-16.00%)145.00 (-13.17%)123.00 (-1.60%)11.16 (-63.80%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)219.00 (n/a)171.20 (n/a)167.00 (n/a)125.00 (n/a)30.83 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+11.28%)0.08 (+28.70%)0.09 (+34.03%)0.07 (+38.86%)0.01 (-19.65%)175.00 (-27.98%)149.60 (-23.44%)144.00 (-25.39%)133.00 (-10.14%)16.09 (-47.73%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)243.00 (n/a)195.40 (n/a)193.00 (n/a)148.00 (n/a)30.79 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+18.32%)0.07 (+13.65%)0.06 (+13.33%)0.05 (+3.37%)0.02 (+60.65%)267.00 (-3.26%)198.40 (-8.23%)195.00 (-11.76%)131.00 (-15.48%)54.36 (+34.97%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)276.00 (n/a)216.20 (n/a)221.00 (n/a)155.00 (n/a)40.28 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.11 (+36.94%)0.08 (+42.78%)0.08 (+43.12%)0.07 (+66.86%)0.02 (+5.29%)175.00 (-40.07%)149.00 (-31.96%)160.00 (-30.13%)111.00 (-26.97%)24.50 (-52.68%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)292.00 (n/a)219.00 (n/a)229.00 (n/a)152.00 (n/a)51.78 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (-10.08%)0.08 (-0.73%)0.07 (-9.47%)0.07 (+43.48%)0.01 (-47.20%)184.00 (-30.30%)162.00 (-5.15%)169.00 (+10.46%)129.00 (+11.21%)20.40 (-60.22%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)264.00 (n/a)170.80 (n/a)153.00 (n/a)116.00 (n/a)51.27 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (+16.44%)0.08 (+19.83%)0.08 (+21.52%)0.06 (+22.55%)0.01 (-4.89%)204.00 (-18.40%)165.20 (-17.15%)158.00 (-17.71%)146.00 (-14.12%)20.64 (-31.18%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)199.40 (n/a)192.00 (n/a)170.00 (n/a)30.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (+0.14%)0.04 (+3.27%)0.05 (+7.85%)0.04 (+3.61%)0.00 (+0.84%)0.05 (+0.14%)0.04 (+3.27%)0.04 (+7.85%)0.04 (+3.61%)0.00 (+0.84%)803.00 (-3.49%)757.80 (-3.17%)739.00 (-7.28%)719.00 (-0.14%)37.06 (-1.51%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)832.00 (n/a)782.60 (n/a)797.00 (n/a)720.00 (n/a)37.63 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2611.27 (-1.04%)11.03 (+1.61%)11.00 (+1.93%)10.86 (+5.69%)0.13 (-62.94%)11.26 (-1.04%)11.02 (+1.61%)11.00 (+1.93%)10.85 (+5.69%)0.13 (-62.93%)3092.00 (-5.39%)3044.20 (-1.68%)3051.00 (-1.90%)2979.00 (+1.05%)36.83 (-64.72%)
fbf1591 — 2025-11-13 03:39:2211.39 (n/a)10.86 (n/a)10.80 (n/a)10.27 (n/a)0.36 (n/a)11.38 (n/a)10.85 (n/a)10.79 (n/a)10.27 (n/a)0.36 (n/a)3268.00 (n/a)3096.20 (n/a)3110.00 (n/a)2948.00 (n/a)104.38 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2617.83 (+7.43%)17.29 (+7.36%)17.25 (+7.40%)16.79 (+7.40%)0.39 (+21.73%)17.82 (+7.43%)17.28 (+7.36%)17.24 (+7.40%)16.78 (+7.40%)0.39 (+21.73%)2000.00 (-6.89%)1942.40 (-6.85%)1946.00 (-6.89%)1883.00 (-6.92%)43.98 (+5.50%)
fbf1591 — 2025-11-13 03:39:2216.60 (n/a)16.11 (n/a)16.06 (n/a)15.63 (n/a)0.32 (n/a)16.59 (n/a)16.10 (n/a)16.05 (n/a)15.62 (n/a)0.32 (n/a)2148.00 (n/a)2085.20 (n/a)2090.00 (n/a)2023.00 (n/a)41.69 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2622.15 (+7.32%)21.00 (+10.27%)21.49 (+14.66%)18.86 (+2.58%)1.17 (+40.49%)22.13 (+7.32%)20.99 (+10.27%)21.48 (+14.66%)18.85 (+2.58%)1.17 (+40.49%)1780.00 (-2.52%)1604.00 (-9.18%)1562.00 (-12.79%)1516.00 (-6.82%)94.43 (+28.98%)
fbf1591 — 2025-11-13 03:39:2220.64 (n/a)19.04 (n/a)18.75 (n/a)18.39 (n/a)0.83 (n/a)20.62 (n/a)19.03 (n/a)18.73 (n/a)18.38 (n/a)0.83 (n/a)1826.00 (n/a)1766.20 (n/a)1791.00 (n/a)1627.00 (n/a)73.21 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2616.35 (-15.92%)15.64 (-6.75%)15.86 (-0.85%)14.93 (+10.76%)0.56 (-75.68%)16.34 (-15.92%)15.63 (-6.75%)15.85 (-0.85%)14.92 (+10.76%)0.56 (-75.68%)2249.00 (-9.71%)2149.00 (+5.33%)2117.00 (+0.86%)2054.00 (+18.93%)77.20 (-72.95%)
fbf1591 — 2025-11-13 03:39:2219.44 (n/a)16.78 (n/a)16.00 (n/a)13.48 (n/a)2.29 (n/a)19.43 (n/a)16.77 (n/a)15.99 (n/a)13.47 (n/a)2.29 (n/a)2491.00 (n/a)2040.20 (n/a)2099.00 (n/a)1727.00 (n/a)285.41 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2611.55 (+2.20%)11.08 (+3.65%)11.03 (+2.20%)10.67 (+9.82%)0.29 (-45.61%)11.55 (+2.20%)11.08 (+3.65%)11.02 (+2.20%)10.66 (+9.82%)0.29 (-45.61%)3148.00 (-8.94%)3031.80 (-3.71%)3044.00 (-2.15%)2906.00 (-2.15%)79.02 (-52.17%)
fbf1591 — 2025-11-13 03:39:2211.30 (n/a)10.69 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)11.30 (n/a)10.68 (n/a)10.79 (n/a)9.71 (n/a)0.53 (n/a)3457.00 (n/a)3148.60 (n/a)3111.00 (n/a)2970.00 (n/a)165.20 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2617.46 (+1.40%)16.91 (+5.71%)16.81 (+6.16%)16.22 (+12.17%)0.45 (-51.77%)17.45 (+1.40%)16.90 (+5.71%)16.80 (+6.16%)16.21 (+12.17%)0.45 (-51.77%)2070.00 (-10.85%)1987.20 (-5.67%)1997.00 (-5.80%)1923.00 (-1.38%)53.60 (-57.83%)
fbf1591 — 2025-11-13 03:39:2217.22 (n/a)15.99 (n/a)15.84 (n/a)14.46 (n/a)0.94 (n/a)17.21 (n/a)15.98 (n/a)15.83 (n/a)14.45 (n/a)0.94 (n/a)2322.00 (n/a)2106.60 (n/a)2120.00 (n/a)1950.00 (n/a)127.11 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2621.51 (+7.11%)20.13 (+5.11%)20.37 (+6.67%)18.54 (+1.10%)0.96 (+65.43%)21.50 (+7.11%)20.11 (+5.11%)20.36 (+6.67%)18.53 (+1.10%)0.96 (+65.43%)1811.00 (-1.09%)1672.20 (-4.73%)1648.00 (-6.26%)1561.00 (-6.64%)81.64 (+53.79%)
fbf1591 — 2025-11-13 03:39:2220.08 (n/a)19.15 (n/a)19.10 (n/a)18.34 (n/a)0.58 (n/a)20.07 (n/a)19.13 (n/a)19.09 (n/a)18.33 (n/a)0.58 (n/a)1831.00 (n/a)1755.20 (n/a)1758.00 (n/a)1672.00 (n/a)53.09 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:2619.66 (+5.03%)17.52 (-2.14%)18.24 (+1.09%)15.28 (-6.01%)1.84 (+113.13%)19.65 (+5.04%)17.51 (-2.14%)18.23 (+1.09%)15.27 (-6.01%)1.84 (+113.14%)2198.00 (+6.39%)1938.80 (+3.11%)1841.00 (-1.07%)1708.00 (-4.79%)209.86 (+117.65%)
fbf1591 — 2025-11-13 03:39:2218.72 (n/a)17.90 (n/a)18.04 (n/a)16.25 (n/a)0.86 (n/a)18.70 (n/a)17.89 (n/a)18.03 (n/a)16.24 (n/a)0.86 (n/a)2066.00 (n/a)1880.40 (n/a)1861.00 (n/a)1794.00 (n/a)96.42 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-1.47%)0.05 (-2.61%)0.05 (-0.70%)0.03 (-20.08%)0.01 (+27.75%)259.00 (+25.12%)169.20 (+5.75%)143.00 (+0.70%)136.00 (+1.49%)46.05 (+66.47%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)207.00 (n/a)160.00 (n/a)142.00 (n/a)134.00 (n/a)27.66 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-14.79%)0.05 (-17.02%)0.05 (-5.19%)0.03 (-48.43%)0.01 (+122.60%)287.00 (+93.92%)180.80 (+28.05%)154.00 (+5.48%)142.00 (+17.36%)54.11 (+427.14%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)148.00 (n/a)141.20 (n/a)146.00 (n/a)121.00 (n/a)10.26 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-7.46%)0.04 (-20.61%)0.05 (-16.67%)0.03 (-41.92%)0.01 (+131.37%)260.00 (+72.19%)182.00 (+32.27%)162.00 (+20.00%)134.00 (+8.06%)44.92 (+333.35%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)151.00 (n/a)137.60 (n/a)135.00 (n/a)124.00 (n/a)10.37 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-7.52%)0.05 (+2.98%)0.05 (+11.52%)0.04 (+30.60%)0.01 (-46.40%)183.00 (-23.43%)161.00 (-7.04%)165.00 (-10.33%)133.00 (+8.13%)19.31 (-53.90%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)239.00 (n/a)173.20 (n/a)184.00 (n/a)123.00 (n/a)41.89 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (-6.56%)0.04 (-25.18%)0.04 (-24.28%)0.03 (-37.40%)0.01 (+71.63%)262.00 (+59.76%)190.20 (+41.31%)173.00 (+32.06%)122.00 (+7.02%)49.23 (+192.81%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.00 (n/a)134.60 (n/a)131.00 (n/a)114.00 (n/a)16.81 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (+44.72%)0.05 (+34.91%)0.05 (+31.72%)0.04 (+23.30%)0.01 (+82.90%)206.00 (-18.90%)151.00 (-24.80%)145.00 (-24.08%)123.00 (-30.90%)28.81 (+4.47%)
fbf1591 — 2025-11-13 03:39:220.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)254.00 (n/a)200.80 (n/a)191.00 (n/a)178.00 (n/a)27.58 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (+7.48%)0.04 (-11.37%)0.05 (-3.01%)0.02 (-37.85%)0.01 (+176.30%)325.00 (+60.89%)211.40 (+23.34%)166.00 (+3.11%)147.00 (-6.96%)70.19 (+312.57%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)202.00 (n/a)171.40 (n/a)161.00 (n/a)158.00 (n/a)17.01 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.04 (-7.60%)0.04 (+1.47%)0.04 (+5.56%)0.04 (+0.94%)0.00 (-37.87%)213.00 (-0.93%)195.00 (-2.21%)198.00 (-5.26%)171.00 (+8.23%)14.13 (-32.97%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)215.00 (n/a)199.40 (n/a)209.00 (n/a)158.00 (n/a)21.08 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-3.71%)0.09 (-2.95%)0.09 (-1.11%)0.08 (-6.03%)0.00 (+30.44%)64.29 (-3.71%)62.44 (-2.95%)63.04 (-1.11%)59.08 (-6.03%)1.76 (+30.44%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.09 (n/a)0.09 (n/a)0.00 (n/a)66.76 (n/a)64.33 (n/a)63.75 (n/a)62.87 (n/a)1.35 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (+13.68%)0.05 (+5.30%)0.05 (+5.37%)0.04 (+3.02%)0.01 (+41.31%)199.00 (-2.93%)154.40 (-3.26%)149.00 (-5.10%)117.00 (-12.03%)32.49 (+22.48%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)205.00 (n/a)159.60 (n/a)157.00 (n/a)133.00 (n/a)26.53 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (+24.27%)0.05 (-16.42%)0.04 (-28.06%)0.03 (-40.51%)0.02 (+308.30%)274.00 (+68.10%)194.80 (+36.99%)196.00 (+39.01%)103.00 (-19.53%)67.95 (+469.91%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)163.00 (n/a)142.20 (n/a)141.00 (n/a)128.00 (n/a)11.92 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-17.18%)0.04 (+4.46%)0.04 (-8.89%)0.04 (+56.63%)0.00 (-78.58%)196.00 (-36.16%)178.80 (-14.29%)180.00 (+9.76%)163.00 (+20.74%)11.51 (-84.15%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)307.00 (n/a)208.60 (n/a)164.00 (n/a)135.00 (n/a)72.66 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.06 (+13.22%)0.05 (+1.44%)0.04 (-11.11%)0.04 (-8.60%)0.01 (+135.26%)186.00 (+9.41%)161.00 (+1.26%)180.00 (+12.50%)121.00 (-11.68%)27.73 (+133.34%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)170.00 (n/a)159.00 (n/a)160.00 (n/a)137.00 (n/a)11.88 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+0.00%)0.06 (-19.25%)0.06 (-30.10%)0.05 (-19.44%)0.01 (+52.62%)216.00 (+24.14%)183.20 (+26.52%)196.00 (+43.07%)128.00 (+0.00%)30.40 (+82.54%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)174.00 (n/a)144.80 (n/a)137.00 (n/a)128.00 (n/a)16.65 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+4.92%)0.07 (-7.76%)0.07 (-9.41%)0.05 (+6.84%)0.02 (+7.16%)234.00 (-6.40%)181.80 (+8.34%)170.00 (+10.39%)122.00 (-4.69%)39.82 (-7.43%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)250.00 (n/a)167.80 (n/a)154.00 (n/a)128.00 (n/a)43.02 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (+12.10%)0.07 (-5.37%)0.07 (+0.00%)0.04 (-46.03%)0.02 (+221.11%)315.00 (+85.29%)185.20 (+16.19%)168.00 (+0.00%)124.00 (-10.79%)67.46 (+457.85%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)159.40 (n/a)168.00 (n/a)139.00 (n/a)12.09 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-18.60%)0.07 (-4.82%)0.07 (+0.00%)0.06 (+19.31%)0.01 (-36.15%)202.00 (-16.18%)164.20 (+0.98%)160.00 (+0.00%)129.00 (+22.86%)29.17 (-34.45%)
fbf1591 — 2025-11-13 03:39:220.11 (n/a)0.08 (n/a)0.07 (n/a)0.05 (n/a)0.02 (n/a)241.00 (n/a)162.60 (n/a)160.00 (n/a)105.00 (n/a)44.50 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+6.09%)0.08 (+0.13%)0.08 (+1.41%)0.07 (-1.74%)0.01 (+17.31%)172.00 (+1.78%)145.20 (+0.41%)142.00 (-1.39%)115.00 (-5.74%)21.01 (+14.43%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)169.00 (n/a)144.60 (n/a)144.00 (n/a)122.00 (n/a)18.36 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-0.71%)0.07 (+2.24%)0.07 (-2.56%)0.06 (+30.41%)0.01 (-43.22%)194.00 (-23.32%)159.20 (-5.69%)156.00 (+2.63%)140.00 (+0.72%)18.53 (-56.55%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)253.00 (n/a)168.80 (n/a)152.00 (n/a)139.00 (n/a)42.65 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.08 (-7.33%)0.07 (-11.07%)0.07 (-11.63%)0.05 (-22.97%)0.01 (+42.42%)222.00 (+29.82%)177.80 (+13.68%)172.00 (+13.16%)150.00 (+7.91%)24.20 (+101.24%)
fbf1591 — 2025-11-13 03:39:220.08 (n/a)0.07 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.00 (n/a)156.40 (n/a)152.00 (n/a)139.00 (n/a)12.03 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (-0.65%)0.06 (+17.20%)0.07 (+17.71%)0.05 (+46.90%)0.01 (-42.39%)226.00 (-31.93%)186.60 (-19.50%)175.00 (-15.05%)154.00 (+0.65%)25.34 (-60.87%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.05 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)332.00 (n/a)231.80 (n/a)206.00 (n/a)153.00 (n/a)64.77 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.18 (+12.10%)0.15 (+23.60%)0.17 (+33.59%)0.09 (+2.78%)0.03 (+25.48%)252.00 (-2.70%)159.60 (-17.65%)131.00 (-25.14%)124.00 (-10.79%)48.09 (+7.79%)
fbf1591 — 2025-11-13 03:39:220.16 (n/a)0.12 (n/a)0.13 (n/a)0.09 (n/a)0.03 (n/a)259.00 (n/a)193.80 (n/a)175.00 (n/a)139.00 (n/a)44.62 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.15 (-25.81%)0.14 (-16.43%)0.14 (-9.70%)0.12 (-16.15%)0.01 (-56.18%)192.00 (+19.25%)168.20 (+18.28%)165.00 (+10.74%)155.00 (+34.78%)12.67 (-28.96%)
fbf1591 — 2025-11-13 03:39:220.20 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)161.00 (n/a)142.20 (n/a)149.00 (n/a)115.00 (n/a)17.84 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.19 (+3.36%)0.16 (+0.86%)0.15 (-7.43%)0.11 (+8.42%)0.03 (-2.62%)202.00 (-7.76%)149.80 (-1.58%)148.00 (+8.03%)119.00 (-3.25%)28.67 (-16.02%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.17 (n/a)0.10 (n/a)0.03 (n/a)219.00 (n/a)152.20 (n/a)137.00 (n/a)123.00 (n/a)34.14 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.16 (+26.76%)0.14 (+28.67%)0.15 (+30.57%)0.13 (+33.15%)0.01 (+30.21%)178.00 (-24.89%)159.80 (-22.28%)157.00 (-23.41%)142.00 (-21.11%)14.50 (-22.58%)
fbf1591 — 2025-11-13 03:39:220.13 (n/a)0.11 (n/a)0.11 (n/a)0.10 (n/a)0.01 (n/a)237.00 (n/a)205.60 (n/a)205.00 (n/a)180.00 (n/a)18.73 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (+29.91%)0.06 (+25.39%)0.06 (+32.26%)0.04 (+14.21%)0.01 (+56.81%)183.00 (-12.44%)134.60 (-19.21%)124.00 (-24.39%)107.00 (-23.02%)25.90 (+8.26%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)209.00 (n/a)166.60 (n/a)164.00 (n/a)139.00 (n/a)23.92 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-4.23%)0.05 (-1.17%)0.05 (-3.27%)0.04 (+27.22%)0.00 (-43.95%)180.00 (-21.40%)159.20 (-1.49%)153.00 (+3.38%)142.00 (+4.41%)15.43 (-55.05%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)229.00 (n/a)161.60 (n/a)148.00 (n/a)136.00 (n/a)34.33 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-12.26%)0.04 (-22.66%)0.04 (-24.74%)0.02 (-46.42%)0.01 (+101.55%)321.00 (+86.63%)205.80 (+36.84%)190.00 (+32.87%)155.00 (+13.97%)59.32 (+348.89%)
fbf1591 — 2025-11-13 03:39:220.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)172.00 (n/a)150.40 (n/a)143.00 (n/a)136.00 (n/a)13.22 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.05 (-2.70%)0.04 (-15.45%)0.04 (-17.65%)0.03 (-9.93%)0.01 (+2.42%)302.00 (+11.03%)217.80 (+18.89%)204.00 (+21.43%)148.00 (+2.78%)50.39 (+10.80%)
fbf1591 — 2025-11-13 03:39:220.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)272.00 (n/a)183.20 (n/a)168.00 (n/a)144.00 (n/a)45.48 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.24 (+22.68%)0.17 (+10.39%)0.16 (+4.23%)0.13 (-6.63%)0.04 (+86.08%)181.00 (+7.10%)138.60 (-6.85%)142.00 (-4.05%)97.00 (-18.49%)27.62 (+62.23%)
fbf1591 — 2025-11-13 03:39:220.19 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)169.00 (n/a)148.80 (n/a)148.00 (n/a)119.00 (n/a)17.02 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.19 (+4.20%)0.17 (+7.31%)0.19 (+10.57%)0.11 (-15.84%)0.03 (+57.71%)202.00 (+18.82%)139.20 (-4.40%)123.00 (-9.56%)119.00 (-4.03%)31.61 (+81.56%)
fbf1591 — 2025-11-13 03:39:220.18 (n/a)0.16 (n/a)0.17 (n/a)0.13 (n/a)0.02 (n/a)170.00 (n/a)145.60 (n/a)136.00 (n/a)124.00 (n/a)17.41 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.20 (+29.31%)0.17 (+31.49%)0.18 (+36.00%)0.12 (+43.98%)0.03 (+7.56%)191.00 (-30.55%)137.60 (-25.30%)125.00 (-26.47%)116.00 (-22.67%)27.24 (-41.39%)
fbf1591 — 2025-11-13 03:39:220.15 (n/a)0.13 (n/a)0.13 (n/a)0.08 (n/a)0.03 (n/a)275.00 (n/a)184.20 (n/a)170.00 (n/a)150.00 (n/a)46.48 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:263.05 (+2.50%)2.77 (+19.82%)2.73 (+22.91%)2.60 (+47.87%)0.15 (-65.45%)188.00 (-32.37%)176.80 (-19.20%)179.00 (-18.64%)160.00 (-2.44%)9.15 (-77.41%)
fbf1591 — 2025-11-13 03:39:222.98 (n/a)2.31 (n/a)2.22 (n/a)1.76 (n/a)0.44 (n/a)278.00 (n/a)218.80 (n/a)220.00 (n/a)164.00 (n/a)40.51 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:263.41 (-16.78%)3.24 (+0.87%)3.28 (+9.40%)2.92 (+17.37%)0.17 (-70.09%)167.00 (-14.80%)151.20 (-3.45%)149.00 (-8.59%)143.00 (+20.17%)8.26 (-68.62%)
fbf1591 — 2025-11-13 03:39:224.10 (n/a)3.21 (n/a)3.00 (n/a)2.49 (n/a)0.56 (n/a)196.00 (n/a)156.60 (n/a)163.00 (n/a)119.00 (n/a)26.31 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.07 (-26.14%)0.07 (-18.62%)0.07 (-15.85%)0.07 (-12.35%)0.00 (-65.53%)170.00 (+14.09%)162.40 (+21.92%)164.00 (+18.84%)153.00 (+35.40%)6.83 (-46.30%)
fbf1591 — 2025-11-13 03:39:220.10 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.01 (n/a)149.00 (n/a)133.20 (n/a)138.00 (n/a)113.00 (n/a)12.72 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+6.96%)0.08 (-4.33%)0.07 (-14.10%)0.07 (-14.45%)0.01 (+110.21%)173.00 (+16.89%)145.40 (+6.44%)156.00 (+16.42%)115.00 (-6.50%)21.49 (+123.76%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.08 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)148.00 (n/a)136.60 (n/a)134.00 (n/a)123.00 (n/a)9.60 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.09 (-3.17%)0.08 (-4.62%)0.08 (+0.74%)0.07 (-9.09%)0.01 (+33.78%)154.00 (+10.00%)139.40 (+5.13%)135.00 (-0.74%)126.00 (+3.28%)10.15 (+53.31%)
fbf1591 — 2025-11-13 03:39:220.09 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.00 (n/a)140.00 (n/a)132.60 (n/a)136.00 (n/a)122.00 (n/a)6.62 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
56543a2 — 2025-11-13 17:58:260.10 (+45.45%)0.08 (+34.01%)0.08 (+28.77%)0.07 (+53.42%)0.01 (+37.92%)161.00 (-34.82%)143.00 (-25.68%)146.00 (-22.34%)110.00 (-31.25%)17.47 (-41.30%)
fbf1591 — 2025-11-13 03:39:220.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)247.00 (n/a)192.40 (n/a)188.00 (n/a)160.00 (n/a)29.76 (n/a)

@Victor-Jung Victor-Jung merged commit 0999a9a into devel Nov 13, 2025
6 checks passed
@Victor-Jung Victor-Jung deleted the add-ci branch November 13, 2025 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants