Skip to content

Fix CI: drop EOL Python 3.9 and update GitHub Actions #464

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rexminnis wants to merge 12 commits into
base: master
Choose a base branch
from
+56 −122
Open

Fix CI: drop EOL Python 3.9 and update GitHub Actions #464

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
db7c9c0
Fix CI: drop EOL Python 3.9 and update GitHub Actions
rexminnis Feb 17, 2026
28861a9
Update pylintrc for pylint 3.2.7 compatibility
rexminnis Feb 17, 2026
f2933c6
Restore click<8.3.0 pin needed by Ray 2.37/2.40
rexminnis Feb 17, 2026
9d406f7
Pin numpy<2 to avoid np.NaN removal in NumPy 2.0
rexminnis Feb 17, 2026
6d0f512
Added pandas<2 to both workflow files
rexminnis Feb 17, 2026
47d194c
Add fail-fast: false so all 18 jobs run independently
rexminnis Feb 17, 2026
e36337e
tell skip TF to skip CUDA entirely.
rexminnis Feb 17, 2026
9481a9f
1. tensorflow-cpu — CPU-only build, no CUDA issues at all
rexminnis Feb 17, 2026
82edb16
removing 3 unsupported Spark 3.3.2 + Python 3.11 combos.
rexminnis Feb 17, 2026
dbafec2
excluding 3.11 + 2.50.0 combo since it's a known Ray 2.50.0 serializa…
rexminnis Feb 17, 2026
bd41d51
Retrigger CI (flaky test_torch serialization failures)
rexminnis Feb 17, 2026
05f481e
adding retries to any failed test up to 2 times with a 10-second delay
rexminnis Feb 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 20 additions & 15 deletions .github/workflows/ray_nightly_test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,17 +29,21 @@ jobs:
build-and-test:

strategy:
fail-fast: false
matrix:
os: [ ubuntu-latest ]
python-version: [3.9, 3.10.14]
python-version: ['3.10', '3.11']
spark-version: [3.3.2, 3.4.0, 3.5.0]
exclude:
- python-version: '3.11'
spark-version: 3.3.2

runs-on: ${{ matrix.os }}

steps:
- uses: actions/checkout@ee0669bd1cc54295c223e0bb666b733df41de1c5 # v2.7.0
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@e9aba2c848f5ebd159c070c61ea2c4e2b122355e # v2.3.4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- name: Set up JDK 17
Expand All @@ -58,13 +62,13 @@ jobs:
sudo apt-get install -y mpich
- name: Cache pip - Ubuntu
if: matrix.os == 'ubuntu-latest'
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/.cache/pip
key: ${{ matrix.os }}-${{ matrix.python-version }}-pip
- name: Cache pip - MacOS
if: matrix.os == 'macos-latest'
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/Library/Caches/pip
key: ${{ matrix.os }}-${{ matrix.python-version }}-pip
Expand All @@ -73,8 +77,7 @@ jobs:
PYTHON_VERSION: ${{ matrix.python-version }}
run: |
python -m pip install --upgrade pip
pip install wheel
pip install "numpy<1.24" "click<8.3.0"
pip install wheel "numpy<2" "pandas<2"
SUBVERSION=$(python -c 'import sys; print(sys.version_info[1])')
if [ "$(uname -s)" == "Linux" ]
then
Expand All @@ -83,21 +86,21 @@ jobs:
pip install torch
fi
case $PYTHON_VERSION in
3.9)
pip install "ray[train,default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp39-cp39-manylinux2014_x86_64.whl"
;;
3.10.14)
3.10)
pip install "ray[train,default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp310-cp310-manylinux2014_x86_64.whl"
;;
3.11)
pip install "ray[train,default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp311-cp311-manylinux2014_x86_64.whl"
;;
esac
pip install pyarrow tqdm pytest tensorflow==2.13.1 tabulate grpcio-tools wget
pip install pyarrow tqdm pytest pytest-rerunfailures "tensorflow-cpu>=2.13.1,<2.16" tabulate grpcio-tools wget
pip install "xgboost_ray[default]<=0.1.13"
pip install torchmetrics
HOROVOD_WITH_GLOO=1
HOROVOD_WITH_PYTORCH=1
pip install horovod[pytorch,ray]
- name: Cache Maven
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/.m2
key: ${{ matrix.os }}-m2-${{ hashFiles('core/pom.xml') }}
Expand All @@ -110,13 +113,15 @@ jobs:
pip install dist/raydp-*.whl
- name: Lint
run: |
pip install pylint==2.8.3
pip install pylint==3.2.7
pylint --rcfile=python/pylintrc python/raydp
pylint --rcfile=python/pylintrc examples/*.py
- name: Test with pytest
env:
CUDA_VISIBLE_DEVICES: ""
run: |
ray start --head --num-cpus 6
pytest python/raydp/tests/ -v
pytest python/raydp/tests/ -v --reruns 2 --reruns-delay 10
ray stop --force
- name: Test Examples
run: |
Expand Down
30 changes: 18 additions & 12 deletions .github/workflows/raydp.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,18 +30,24 @@ permissions: # added using https://github.com/step-security/secure-repo
jobs:
build-and-test:
strategy:
fail-fast: false
matrix:
os: [ubuntu-latest]
python-version: [3.9, 3.10.14]
python-version: ['3.10', '3.11']
spark-version: [3.3.2, 3.4.0, 3.5.0]
ray-version: [2.37.0, 2.40.0, 2.50.0]
exclude:
- python-version: '3.11'
spark-version: 3.3.2
- python-version: '3.11'
ray-version: 2.50.0

runs-on: ${{ matrix.os }}

steps:
- uses: actions/checkout@ee0669bd1cc54295c223e0bb666b733df41de1c5 # v2.7.0
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@e9aba2c848f5ebd159c070c61ea2c4e2b122355e # v2.3.4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- name: Set up JDK 17
Expand All @@ -60,35 +66,33 @@ jobs:
sudo apt-get install -y mpich
- name: Cache pip - Ubuntu
if: matrix.os == 'ubuntu-latest'
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/.cache/pip
key: ${{ matrix.os }}-${{ matrix.python-version }}-pip
- name: Cache pip - MacOS
if: matrix.os == 'macos-latest'
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/Library/Caches/pip
key: ${{ matrix.os }}-${{ matrix.python-version }}-pip
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install wheel
pip install "numpy<1.24" "click<8.3.0"
pip install "pydantic<2.0"
pip install wheel "numpy<2" "pandas<2" "click<8.3.0"
SUBVERSION=$(python -c 'import sys; print(sys.version_info[1])')
if [ "$(uname -s)" == "Linux" ]
then
pip install torch --index-url https://download.pytorch.org/whl/cpu
else
pip install torch
fi
pip install pyarrow "ray[train,default]==${{ matrix.ray-version }}" tqdm pytest tensorflow==2.13.1 tabulate grpcio-tools wget
pip install pyarrow "ray[train,default]==${{ matrix.ray-version }}" tqdm pytest pytest-rerunfailures "tensorflow-cpu>=2.13.1,<2.16" tabulate grpcio-tools wget
pip install "xgboost_ray[default]<=0.1.13"
pip install "xgboost<=2.0.3"
pip install torchmetrics
- name: Cache Maven
uses: actions/cache@8492260343ad570701412c2f464a5877dc76bace # v2
uses: actions/cache@v4
with:
path: ~/.m2
key: ${{ matrix.os }}-m2-${{ hashFiles('core/pom.xml') }}
Expand All @@ -101,13 +105,15 @@ jobs:
pip install dist/raydp-*.whl
- name: Lint
run: |
pip install pylint==2.8.3
pip install pylint==3.2.7
pylint --rcfile=python/pylintrc python/raydp
pylint --rcfile=python/pylintrc examples/*.py
- name: Test with pytest
env:
CUDA_VISIBLE_DEVICES: ""
run: |
ray start --head --num-cpus 6
pytest python/raydp/tests/ -v
pytest python/raydp/tests/ -v --reruns 2 --reruns-delay 10
ray stop --force
- name: Test Examples
run: |
Expand Down
Loading