Skip to content

Conversation

@gmarkall
Copy link
Contributor

@gmarkall gmarkall commented Nov 28, 2025

Rationale for this change

The extra that specifies the CUDA version for Numba-CUDA is required for the CUDA Python bindings to be installed as a Numba-CUDA dependency. Presently the Numba-CUDA interop tests are skipped, and it would be preferable to enable them again and ensure the test suite doesn't skip them due to lack of dependencies.

What changes are included in this PR?

  • Addition of the appropriate extra to the Numba-CUDA installation, so that the bindings will be installed in the CI environment.
  • Removal of the skip for the Numba-CUDA interop tests.

Are these changes tested?

Yes (assuming the CI setup works correctly again with these changes)

Are there any user-facing changes?

No.

The extra that specifies the CUDA version for Numba_CUDA is required for
the CUDA Python bindings to be installed as a Numba-CUDA dependency.

This commit adds the appropriate extra to the Numba-CUDA installation,
so that the bindings will be installed in the CI environment. This
should allow the Numba-CUDA interop tests to run in CI again, instead of
getting skipped.
- Numba-CUDA 0.21.2 has been released, which fixes the API breakage that
  affected Numba-CUDA interop tests.
- The previous commit fixes the installation of Numba-CUDA in the CI
  environment.
- This commit removes the skip of the Numba-CUDA interop tests, with the
  aim of them running again and passing.
@gmarkall gmarkall changed the title GH-47371, GH-48281: [Python] Fix Numba-CUDA interop GH-47371, GH-48281: [Python][CI] Fix Numba-CUDA interop Nov 28, 2025
@pitrou
Copy link
Member

pitrou commented Nov 28, 2025

@github-actions crossbow submit cuda

@github-actions
Copy link

Revision: 91662d1

Submitted crossbow builds: ursacomputing/crossbow @ actions-487d05af51

Task Status
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-cuda-cpp-ubuntu-24.04-cuda-13.0.2 GitHub Actions
test-cuda-python-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-cuda-python-ubuntu-24.04-cuda-13.0.2 GitHub Actions

@gmarkall
Copy link
Contributor Author

For the CUDA 11 tests, from https://github.com/ursacomputing/crossbow/actions/runs/19770191970/job/56652474566#step:6:289:

#10 5.661 WARNING: numba-cuda 0.21.2 does not provide the extra 'cu11'

current Numba-CUDA versions only support CUDA 12 and 13, so this is not unexpected.

For the CUDA 13 tests, it looks to me as if the required packages have installed and the tests ran:

 #10 6.069 Collecting numba-cuda[cu13]
...
 #10 13.62 Successfully installed cuda-bindings-13.0.3 cuda-core-0.4.2 cuda-pathfinder-1.3.2 cuda-python-13.0.3 numba-cuda-0.21.2 nvidia-cuda-cccl-13.0.85 nvidia-cuda-nvrtc-13.0.88 nvidia-cuda-runtime-13.0.96 nvidia-nvjitlink-13.0.88 nvidia-nvvm-13.0.88

(from https://github.com/ursacomputing/crossbow/actions/runs/19770191961/job/56652474688#step:6:4732)

arrow-dev/lib/python3.12/site-packages/pyarrow/tests/test_cuda_numba_interop.py: 18 warnings
  /arrow-dev/lib/python3.12/site-packages/numba_cuda/numba/cuda/dispatcher.py:696: NumbaPerformanceWarning: Grid size 1 will likely result in GPU under-utilization due to low occupancy.
    warn(errors.NumbaPerformanceWarning(msg))

(from https://github.com/ursacomputing/crossbow/actions/runs/19770191961/job/56652474688#step:6:9258)

and I don't see it being skipped.

@pitrou
Copy link
Member

pitrou commented Nov 29, 2025

current Numba-CUDA versions only support CUDA 12 and 13, so this is not unexpected.

Ok. Well, since CI is green, and the CUDA tests pass anyway, I think this is not a problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants