Skip to content

[deps] adding openlineage dependency #58724

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
aslonnie merged 16 commits into from
Nov 27, 2025
Merged

[deps] adding openlineage dependency #58724

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
71a90b3
updating req compiled
elliot-barn Nov 17, 2025
85b81a3
regen llm lock files
elliot-barn Nov 17, 2025
a3ce196
merging master
elliot-barn Nov 18, 2025
fdd266d
removing attrs requirement
elliot-barn Nov 18, 2025
0e47407
updating lock files
elliot-barn Nov 18, 2025
1eaa381
depset for llm serve release test
elliot-barn Nov 18, 2025
874857e
Merge remote-tracking branch 'origin/master' into elliot-barn/adding-…
elliot-barn Nov 21, 2025
6e7bc47
updating reqs
elliot-barn Nov 21, 2025
018b94d
updating dependencies
elliot-barn Nov 21, 2025
b3b8e64
removing depset
elliot-barn Nov 25, 2025
5f6fc56
updating lock file
elliot-barn Nov 25, 2025
033cb67
reverting depset
elliot-barn Nov 25, 2025
f9a902d
disabling jax tests
elliot-barn Nov 25, 2025
bf5c20e
removing requirements file
elliot-barn Nov 26, 2025
321c011
removing unnused lock files
elliot-barn Nov 26, 2025
b0c0ae3
Merge branch 'master' into elliot-barn/adding-openlineage-dep
elliot-barn Nov 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions ci/raydepsets/configs/llm_release_tests.depsets.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,6 @@ build_arg_sets:
- cu128

depsets:

# get rid of this python/deplocks/llm/rayllm_test_py311_cu128.lock
- name: subset_rayllm_depset_${PYTHON_VERSION}_${CUDA_CODE}
operation: subset
source_depset: compiled_ray_llm_depset_${PYTHON_VERSION}_${CUDA_CODE}
Expand All @@ -24,7 +22,6 @@ depsets:
- python/requirements.txt
output: python/deplocks/llm/rayllm_subset_${PYTHON_VERSION}_${CUDA_CODE}.lock


- name: llm_batch_single_node_benchmark_${PYTHON_VERSION}_${CUDA_CODE}
operation: expand
depsets:
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_deps/ray_base_deps_py3.10.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1016,9 +1016,9 @@ python-dateutil==2.8.2 \
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.10.lock
# botocore
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.10.lock
# azure-core
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_deps/ray_base_deps_py3.11.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1010,9 +1010,9 @@ python-dateutil==2.8.2 \
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.11.lock
# botocore
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.11.lock
# azure-core
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_deps/ray_base_deps_py3.12.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1010,9 +1010,9 @@ python-dateutil==2.8.2 \
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.12.lock
# botocore
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.12.lock
# azure-core
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_deps/ray_base_deps_py3.9.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1016,9 +1016,9 @@ python-dateutil==2.8.2 \
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.9.lock
# botocore
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.9.lock
# azure-core
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_extra/ray_base_extra_py3.10.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2151,9 +2151,9 @@ referencing==0.36.2 \
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.10.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.10.lock
# anyscale
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_extra/ray_base_extra_py3.11.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2139,9 +2139,9 @@ referencing==0.36.2 \
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.11.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.11.lock
# anyscale
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_extra/ray_base_extra_py3.12.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2139,9 +2139,9 @@ referencing==0.36.2 \
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.12.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.12.lock
# anyscale
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/base_extra/ray_base_extra_py3.9.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2158,9 +2158,9 @@ referencing==0.36.2 \
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.9.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c release/ray_release/byod/ray_base_extra_testdeps_py3.9.lock
# anyscale
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/llm/ray_py311_cpu.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1735,9 +1735,9 @@ referencing==0.36.2 \
# -c python/deplocks/llm/ray_test_py311_cpu.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c python/deplocks/llm/ray_test_py311_cpu.lock
# -r python/requirements.txt
Expand Down
6 changes: 3 additions & 3 deletions python/deplocks/llm/ray_py311_cu128.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1699,9 +1699,9 @@ referencing==0.36.2 \
# -c python/deplocks/llm/ray_test_py311_cu128.lock
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c python/deplocks/llm/ray_test_py311_cu128.lock
# -r python/requirements.txt
Expand Down
46 changes: 43 additions & 3 deletions python/deplocks/llm/ray_test_py311_cpu.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,7 @@ anyio==3.7.1 \
--hash=sha256:91dee416e570e92c64041bd18b900d1d6fa78dff7048769ce5ac5ddad004fbb5
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# httpx
# jupyter-server
# starlette
# watchfiles
Expand Down Expand Up @@ -204,6 +205,7 @@ attrs==25.1.0 \
# -c /tmp/ray-deps/requirements_compiled.txt
# aiohttp
# jsonschema
# openlineage-python
# referencing
azure-common==1.1.28 \
--hash=sha256:4ac0cd3214e36b6a1b6a442686722a5d8cc449603aa833f3f0f40bda836704a3 \
Expand Down Expand Up @@ -285,6 +287,12 @@ botocore==1.32.7 \
# -r python/requirements/cloud-requirements.txt
# boto3
# s3transfer
build==1.3.0 \
--hash=sha256:698edd0ea270bde950f53aed21f3a0135672206f3911e0176261a31e0e07b397 \
--hash=sha256:7145f0b5061ba90a1500d60bd1b13ca0a8a4cebdd0cc16ed8adf1c0e739f43b4
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# openlineage-python
cachetools==5.5.2 \
--hash=sha256:1a661caa9175d26759571b2e19580f9d6393969e5dfca11fdb1f947a23e640d4 \
--hash=sha256:d26a22bcc62eb95c3beabd9f1ee5e820d3d2704fe2967cbe350e20c8ffcd3f0a
Expand All @@ -303,6 +311,8 @@ certifi==2025.1.31 \
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# -r python/requirements/cloud-requirements.txt
# httpcore
# httpx
# requests
cffi==1.16.0 \
--hash=sha256:0c9ef6ff37e974b73c25eecc13952c55bceed9112be2d9d938ded8e856138bcc \
Expand Down Expand Up @@ -1123,19 +1133,32 @@ h11==0.16.0 \
--hash=sha256:63cf8bbe7522de3bf65932fda1d9c2772064ffb3dae62d55932da54b31cb6c86
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# httpcore
# uvicorn
halo==0.0.31 \
--hash=sha256:5350488fb7d2aa7c31a1344120cee67a872901ce8858f60da7946cef96c208ab \
--hash=sha256:7b67a3521ee91d53b7152d4ee3452811e1d2a6321975137762eb3d70063cc9d6
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# -r python/requirements/cloud-requirements.txt
httpcore==1.0.9 \
--hash=sha256:2d400746a40668fc9dec9810239072b40b4484b640a8c38fd654a024c7a1bf55 \
--hash=sha256:6e34463af53fd2ab5d807f399a9b45ea31c3dfa2276f15a2c3f00afff6e176e8
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# httpx
httplib2==0.20.4 \
--hash=sha256:58a98e45b4b1a48273073f905d2961666ecf0fbac4250ea5b47aef259eb5c585 \
--hash=sha256:8b6a905cb1c79eefd03f8669fd993c36dc341f7c558f056cb5a33b5c2f458543
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# oauth2client
httpx==0.28.1 \
--hash=sha256:75e98c5f16b0f35b567856f597f06ff2270a374470a5c2392242528e3e3e42fc \
--hash=sha256:d909fcccc110f8c7faf814ca82a9a4d816bc5a6dbfea25d6591d6985b8ba59ad
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# openlineage-python
humanize==4.12.1 \
--hash=sha256:1338ba97415c96556758a6e2f65977ed406dddf4620d4c6db9bbdfd07f0f1232 \
--hash=sha256:86014ca5c52675dffa1d404491952f1f5bf03b07c175a51891a343daebf01fea
Expand All @@ -1148,6 +1171,7 @@ idna==3.7 \
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# anyio
# httpx
# jsonschema
# requests
# yarl
Expand Down Expand Up @@ -1940,6 +1964,11 @@ opencensus-context==0.1.3 \
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# opencensus
openlineage-python==1.40.0 \
--hash=sha256:1351780af0c9af9d943e74aade26c92c623f2cd26f334cf515fa1cfacef3f349
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# -r python/requirements/cloud-requirements.txt
opentelemetry-api==1.34.1 \
--hash=sha256:64f0bd06d42824843731d05beea88d4d4b6ae59f9fe347ff7dfa2cc14233bbb3 \
--hash=sha256:b7df4cb0830d5a6c29ad0c0691dbae874d8daefa934b8b1d642de48323d32a8c
Expand Down Expand Up @@ -1981,13 +2010,15 @@ packaging==23.0 \
# -c /tmp/ray-deps/requirements_compiled.txt
# -r python/requirements/cloud-requirements.txt
# -r python/requirements.txt
# build
# ipykernel
# jupyter-server
# jupyterlab
# jupyterlab-server
# kombu
# lazy-loader
# nbconvert
# openlineage-python
# pytest
# scikit-image
# tensorboardx
Expand Down Expand Up @@ -2581,6 +2612,12 @@ pyparsing==3.1.1 \
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# httplib2
pyproject-hooks==1.2.0 \
--hash=sha256:1e859bd5c40fae9448642dd871adf459e5e2084186e8d2c2a79a824c970da1f8 \
--hash=sha256:9e5c6bfa8dcc30091c74b0cf803c81fdd29d94f01992a7707bc97babb1141913
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# build
pytest==7.4.4 \
--hash=sha256:2cf0005922c6ace4a3e2ec8b4080eb0d9753fdc93107415332f50ce9e7994280 \
--hash=sha256:b090cdf5ed60bf4c45261be03239c2c1c22df034fbffe691abe93cd80cea01d8
Expand Down Expand Up @@ -2612,6 +2649,7 @@ python-dateutil==2.8.2 \
# botocore
# celery
# jupyter-client
# openlineage-python
# pandas
python-json-logger==2.0.7 \
--hash=sha256:23e7ec02d34237c5aa1e29a070193a4ea87583bb4e7f8fd06d3de8264c4b2e1c \
Expand Down Expand Up @@ -2682,6 +2720,7 @@ pyyaml==6.0.1 \
# -r python/requirements/cloud-requirements.txt
# -r python/requirements.txt
# jupyter-events
# openlineage-python
pyzmq==26.0.3 \
--hash=sha256:01fbfbeb8249a68d257f601deb50c70c929dc2dfe683b754659569e502fbd3aa \
--hash=sha256:0270b49b6847f0d106d64b5086e9ad5dc8a902413b5dbbb15d12b60f9c1747a4 \
Expand Down Expand Up @@ -2785,9 +2824,9 @@ referencing==0.36.2 \
# -c /tmp/ray-deps/requirements_compiled.txt
# jsonschema
# jsonschema-specifications
requests==2.32.3 \
--hash=sha256:55365417734eb18255590a9ff9eb97e9e1da868d4ccd6402399eaf68af20a760 \
--hash=sha256:70761cfe03c773ceb22aa2f671b4757976145175cdfca038c02654d061d6dcc6
requests==2.32.5 \
--hash=sha256:2462f94637a34fd532264295e186976db0f5d453d1cdd31473c85a6a161affb6 \
--hash=sha256:dbba0bac56e100853db0ea71b82b4dfd5fe2bf6d3754a8893c3af500cec7d7cf
# via
# -c /tmp/ray-deps/requirements_compiled.txt
# -r python/requirements/cloud-requirements.txt
Expand All @@ -2798,6 +2837,7 @@ requests==2.32.3 \
# google-cloud-storage
# jupyterlab-server
# msal
# openlineage-python
# smart-open
rfc3339-validator==0.1.4 \
--hash=sha256:138a2abdf93304ad60530167e51d2dfb9549521a836871b88d7f4695d0022f6b \
Expand Down
Loading