-
Notifications
You must be signed in to change notification settings - Fork 835
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rclone powered batch #2842
Rclone powered batch #2842
Conversation
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Fri Jan 15 11:56:45 UTC 2021 impatient try |
Fri Jan 15 11:56:53 UTC 2021 impatient try |
It is great but maybe we can leave this one as-is and use rclone on different example ? |
Fri Jan 15 12:00:22 UTC 2021 impatient try |
Fri Jan 15 12:00:27 UTC 2021 impatient try |
Fri Jan 15 12:17:07 UTC 2021 impatient try |
Fri Jan 15 12:17:08 UTC 2021 impatient try |
What this PR does / why we need it:
It modifies standard Argo Workflows Batch Example to use
rclone
for pulling / pushing the inputs / output files for batch processing. This greatly extends compatibility with different cloud storage providers (40+).Which issue(s) this PR fixes:
Closes #2819
Special notes for your reviewer:
Does this PR introduce a user-facing change?: