Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move backup/restore to the Charm #169

Open
kimwnasptd opened this issue May 2, 2024 · 1 comment
Open

Move backup/restore to the Charm #169

kimwnasptd opened this issue May 2, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@kimwnasptd
Copy link
Contributor

Context

similarly to canonical/mlmd-operator#80

Right now our backup/restore guide has the following issues

  1. It has manual commands the user needs to run to push the data to S3 (rclone)
  2. Users need to download binaries to parse the secret-key and download the data locally (rclone)
  3. The data needs to go via the host-machine that runs the rclone command, for which we use kubectl port-forward

We should move all of this logic to the Charm, to ensure users don't need to install any binaries and the data will go directly from the Charm to S3

What needs to get done

  1. Include all needed binaries (or python libraries) for backup to the Charm
  2. Have an action that pushes the buckets of MinIO to another S3

Definition of Done

  1. Have a spike to confirm our understanding of rclone sync, and which files it copies
  2. Have a spike to discuss if we want to copy all files, or ones that fit a timeframe (could get field input)
  3. The action can be executed in an airgap environment
  4. Users don't need to run any other commands from their machine
  5. The data will go directly to the S3 from the Charm
@kimwnasptd kimwnasptd added the enhancement New feature or request label May 2, 2024
Copy link

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-5625.

This message was autogenerated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant