introduce cuda sdpa #15996

Gasoonjia · 2025-11-26T22:12:00Z

Differential Revision: D87950475

pytorch-bot · 2025-11-26T22:12:06Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15996

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures, 84 Cancelled Jobs, 29 Pending

As of commit 4e1e4cb with merge base 33ec615 ():

NEW FAILURES - The following jobs have failed:

docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-arm-sdk) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-clang12-android) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-clang12) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-gcc9) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-linter) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-mediatek-sdk) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-qnn-sdk) (gh)
Final attempt failed. Child_process exited with error code 1
docker-builds / docker-build (linux.4xlarge, executorch-ubuntu-22.04-zephyr-sdk) (gh)
Final attempt failed. Child_process exited with error code 1

CANCELLED JOBS - The following jobs were cancelled. Please retry:

Build documentation / build (buck2) / Build doc (gh)
Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
##[error]The operation was canceled.
Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
##[error]The operation was canceled.
Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
##[error]The operation was canceled.
Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
##[error]The operation was canceled.
Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
##[error]The operation was canceled.
Build Presets / zephyr (zephyr) / build (gh)
##[error]The operation was canceled.
Lint / android-java-format / linux-job (gh)
##[error]The operation was canceled.
Lint / link-check / lint-file-size / linux-job (gh)
##[error]The operation was canceled.
Lint / link-check / lint-xrefs / linux-job (gh)
##[error]The operation was canceled.
Lint / lintrunner / linux-job (gh)
##[error]The operation was canceled.
Lint / lintrunner-mypy / linux-job (gh)
##[error]The operation was canceled.
periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
##[error]The operation was canceled.
periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
##[error]The operation was canceled.
periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
##[error]The operation was canceled.
periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
##[error]The operation was canceled.
periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
##[error]The operation was canceled.
pull / android / build-llm-demo / linux-job (gh)
##[error]The operation was canceled.
pull / nxp-build-test / linux-job (gh)
##[error]The operation was canceled.
pull / test-binary-size-linux / linux-job (gh)
pull / test-binary-size-linux-gcc / linux-job (gh)
##[error]The operation was canceled.
pull / test-build-wasm-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-custom-ops-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-eval_llama-wikitext-linux / linux-job (gh)
pull / test-llama_runner_eager-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-llama-lora-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-llama-runner-linux-android / linux-job (gh)
##[error]The operation was canceled.
pull / test-mediatek-models-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
##[error]The operation was canceled.
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
##[error]The operation was canceled.
pull / test-moshi-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
pull / test-openvino-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-phi-3-mini-runner-linux / linux-job (gh)
pull / test-quantized-aot-lib-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-samsung-models-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-selective-build-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh)
pull / test-vulkan-models-linux / linux-job (gh)
##[error]The operation was canceled.
pull / test-vulkan-operators-linux / linux-job (gh)
##[error]The operation was canceled.
pull / unittest / linux / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-buck / linux / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-editable / linux / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-nxp-neutron / linux-job (gh)
##[error]The operation was canceled.
pull / unittest-wasm-bindings (--enable-etdump) / linux-job (gh)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-11-26T22:12:08Z

@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating Diff in D87950475.

github-actions · 2025-12-02T03:40:52Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

meta-codesync · 2025-12-02T06:58:25Z

@Gasoonjia has imported this pull request. If you are a Meta employee, you can view this in D87950475.

Summary: Pull Request resolved: #15996 Test Plan: buck2 test mode/dev-nosan fbcode//executorch/backends/cuda/runtime/shims/tests:test_aoti_torch_cuda_scaled_dot_product_attention Differential Revision: D87950475 Pulled By: Gasoonjia

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 26, 2025

meta-codesync bot added fb-exported meta-exported labels Nov 26, 2025

Gasoonjia temporarily deployed to upload-benchmark-results December 2, 2025 04:57 — with GitHub Actions Inactive

facebook-github-bot force-pushed the export-D87950475 branch from 899e6eb to 0ff1e4a Compare December 2, 2025 08:03

Gasoonjia deployed to upload-benchmark-results December 2, 2025 09:24 — with GitHub Actions Active

facebook-github-bot force-pushed the export-D87950475 branch from 0ff1e4a to ca7a93c Compare December 2, 2025 17:34

Gasoonjia had a problem deploying to upload-benchmark-results December 2, 2025 18:39 — with GitHub Actions Failure

introduce cuda sdpa (#15996)

4e1e4cb

Summary: Pull Request resolved: #15996 Test Plan: buck2 test mode/dev-nosan fbcode//executorch/backends/cuda/runtime/shims/tests:test_aoti_torch_cuda_scaled_dot_product_attention Differential Revision: D87950475 Pulled By: Gasoonjia

facebook-github-bot force-pushed the export-D87950475 branch from ca7a93c to 4e1e4cb Compare December 2, 2025 19:38

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

introduce cuda sdpa #15996

introduce cuda sdpa #15996

Gasoonjia commented Nov 26, 2025

Uh oh!

pytorch-bot bot commented Nov 26, 2025 •

edited

Loading

Uh oh!

meta-codesync bot commented Nov 26, 2025

Uh oh!

github-actions bot commented Dec 2, 2025

Uh oh!

meta-codesync bot commented Dec 2, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

introduce cuda sdpa #15996

Are you sure you want to change the base?

introduce cuda sdpa #15996

Conversation

Gasoonjia commented Nov 26, 2025

Uh oh!

pytorch-bot bot commented Nov 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15996

❌ 8 New Failures, 84 Cancelled Jobs, 29 Pending

Uh oh!

meta-codesync bot commented Nov 26, 2025

Uh oh!

github-actions bot commented Dec 2, 2025

This PR needs a release notes: label

Uh oh!

meta-codesync bot commented Dec 2, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pytorch-bot bot commented Nov 26, 2025 •

edited

Loading

This PR needs a `release notes:` label