Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(artifactGC): include env, volumes, volumeMounts. Fixes #9746 #13728

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

mrkschneider
Copy link

Fixes #9746

Motivation

This PR allows to provide credentials for artifact garbage collection via environment variables or mounted volumes.

Modifications

  • Introduce three new fields to ArtifactGC struct: Env,Volumes,VolumeMounts
  • The new fields are taken into account when grouping artifacts by credential set in artifact_gc.go
  • The new fields are also added to the cleanup pod performing garbage collection

Verification

  • added new fields to existing unit tests
  • submitted workflows with new fields and checked credential grouping + mounting of credentials in cleanup pod

@mrkschneider mrkschneider marked this pull request as draft October 8, 2024 19:56
@mrkschneider mrkschneider marked this pull request as ready for review October 8, 2024 20:04
@mrkschneider
Copy link
Author

mrkschneider commented Oct 8, 2024

Build of argocli is failing in the pull request, though it succeeds locally on my machine. Can you please give me any advice on how to resolve the issue?

@tooptoop4

This comment was marked as spam.

@agilgur5 agilgur5 changed the title feat: ArtifactGC includes env/volumes/volumeMounts. Fixes #9746 feat(artifactGC): include env, volumes, volumeMounts. Fixes #9746 Oct 8, 2024
@agilgur5 agilgur5 added area/spec Changes to the workflow specification. area/artifacts S3/GCP/OSS/Git/HDFS etc area/gc Garbage collection, such as TTLs, retentionPolicy, delays, and more labels Oct 8, 2024
@agilgur5
Copy link
Contributor

agilgur5 commented Oct 8, 2024

Build of argocli is failing in the pull request

That appears to a new bug on main from #13343. It's unrelated to your change so you can ignore it, but will need to rebase once that is fixed.

@MasonM
Copy link
Contributor

MasonM commented Oct 9, 2024

FYI: #13730 should fix the build failures

Signed-off-by: Markus Schneider <markus.schneider89@googlemail.com>
@mrkschneider
Copy link
Author

Build of argocli is failing in the pull request

That appears to a new bug on main from #13343. It's unrelated to your change so you can ignore it, but will need to rebase once that is fixed.

rebasing on main fixed it, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/artifacts S3/GCP/OSS/Git/HDFS etc area/gc Garbage collection, such as TTLs, retentionPolicy, delays, and more area/spec Changes to the workflow specification.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

artifactGC not working with IRSA
4 participants