-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Create operators for working with Ray for VertexAI #47340
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
3b2f7f7 to
2e5a9a9
Compare
|
Hi @potiuk ! |
2e5a9a9 to
6184b9e
Compare
|
Rebased it - to check - we had some teething issue with |
9926296 to
3e447b4
Compare
3e447b4 to
f66a983
Compare
|
Hello @potiuk ! I didn't find any python issues related to this. Do you have any idea what is a better way for Airflow to install extra packages for dependencies for |
|
Hi @potiuk :) |
|
I missed that one - but I will come back next week. |
f66a983 to
b7fb631
Compare
|
Some docs failure . I think it's because path to exampleinclude should be changed - according to https://github.com/apache/airflow/blob/main/contributing-docs/11_documentation_building.rst#including-examples-and-other-files |
b7fb631 to
3562dfb
Compare
In this PR I have added new operators for creating and managing Ray clusters on Vertex AI infrastructure.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.