Skip to content

Conversation

@Icohedron
Copy link
Contributor

@Icohedron Icohedron commented Dec 1, 2025

Changes the Clang XFAIL to a Vulkan && Clang XFAIL since the related issue (llvm/llvm-project#156775) appears to only be related to SPIR-V.

Also adds additional XFAILs for machines that still fail the tests.

Confirmed all Vulkan && Clang workflows XFAIL:

╭────┬──────────────────────┬─────────────┬─────────────────────────────┬─────────────┬──────────────────────────────────╮
│  # │      timestamp       │   run-id    │          workflow           │   status    │               test               │
├────┼──────────────────────┼─────────────┼─────────────────────────────┼─────────────┼──────────────────────────────────┤
│  0 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ UNSUPPORTED │ WaveOps/WaveActiveSum.fp64.test  │
│  1 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│  2 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│  3 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│  4 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│  5 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│  6 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│  7 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│  8 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│  9 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│ 10 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 11 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 12 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│ 13 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│ 14 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│ 15 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 16 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 17 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│ 18 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│ 19 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│ 20 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│ 21 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 22 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 23 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
╰────┴──────────────────────┴─────────────┴─────────────────────────────┴─────────────┴──────────────────────────────────╯

The remaining XFAILs are under D3D12 with Clang, mostly on NVIDIA and WARP. Most of the Metal XFAILs are expected except fp32 because fp32 passes with DXC.

╭────┬──────────────────────┬─────────────┬────────────────────────────────┬─────────────┬──────────────────────────────────╮
│  # │      timestamp       │   run-id    │            workflow            │   status    │               test               │
├────┼──────────────────────┼─────────────┼────────────────────────────────┼─────────────┼──────────────────────────────────┤
│  0 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ UNSUPPORTED │ WaveOps/WaveActiveSum.fp64.test  │
│  1 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ UNSUPPORTED │ WaveOps/WaveActiveSum.fp64.test  │
│  2 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│  3 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│  4 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│  5 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│  6 │ 2025-11-28T23:05:58Z │ 19775415943 │ macOS Metal Clang              │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│  7 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│  8 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│  9 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│ 10 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 11 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 12 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│ 13 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│ 14 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 15 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│ 16 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 17 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│ 18 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│ 19 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│ 20 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp32.test  │
│ 21 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp16.test  │
│ 22 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.int32.test │
│ 23 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.int16.test │
│ 24 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.int64.test │
│ 25 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveActiveSum.fp64.test  │
│ 26 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.fp16.test  │
│ 27 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.fp64.test  │
│ 28 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.int32.test │
│ 29 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.fp32.test  │
│ 30 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.int16.test │
│ 31 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ XPASS       │ WaveOps/WaveActiveSum.int64.test │
│ 32 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.fp32.test  │
│ 33 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.fp16.test  │
│ 34 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.int32.test │
│ 35 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.int16.test │
│ 36 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.fp64.test  │
│ 37 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ XPASS       │ WaveOps/WaveActiveSum.int64.test │
│ 38 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ XPASS       │ WaveOps/WaveActiveSum.fp32.test  │
│ 39 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ XPASS       │ WaveOps/WaveActiveSum.int16.test │
│ 40 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ XPASS       │ WaveOps/WaveActiveSum.int32.test │
│ 41 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ XPASS       │ WaveOps/WaveActiveSum.int64.test │
├────┼──────────────────────┼─────────────┼────────────────────────────────┼─────────────┼──────────────────────────────────┤
│  # │      timestamp       │   run-id    │            workflow            │   status    │               test               │
╰────┴──────────────────────┴─────────────┴────────────────────────────────┴─────────────┴──────────────────────────────────╯

@Icohedron Icohedron requested a review from bob80905 December 1, 2025 21:02
@Icohedron Icohedron added the test-all When applied to a PR this will opt-in to additional pre-merge test configurations.. label Dec 1, 2025
Copy link
Collaborator

@bogner bogner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM other than the missing bug link

Copy link
Collaborator

@llvm-beanz llvm-beanz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One comment, feel free to take or leave it.

@Icohedron Icohedron merged commit 1db46c1 into llvm:main Dec 1, 2025
1 of 23 checks passed
# XFAIL: WARP && Clang

# Bug https://github.com/llvm/offload-test-suite/issues/525
# XFAIL: NV && Clang & DirectX
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo here. I've gone ahead and merged a fix: #536

Suggested change
# XFAIL: NV && Clang & DirectX
# XFAIL: NV && Clang && DirectX

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test-all When applied to a PR this will opt-in to additional pre-merge test configurations..

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants