Implement TTL for AsyncAPI workloads #2151

RobertLucian · 2021-05-07T16:29:03Z

checklist:

run make test and make lint
test manually (i.e. build/push all images, restart operator, and re-deploy APIs)
update docs and add any new files to summary.md (view in gitbook after merging)

# Conflicts: # pkg/crds/apis/batch/v1alpha1/batchjob_metrics.go # pkg/operator/operator/k8s.go # pkg/operator/operator/storage.go # pkg/operator/resources/asyncapi/api.go # pkg/operator/resources/job/batchapi/api.go # pkg/operator/resources/job/batchapi/job.go # pkg/operator/resources/job/cache.go # pkg/operator/resources/job/state.go # pkg/operator/resources/job/taskapi/api.go # pkg/operator/resources/job/taskapi/job.go # pkg/operator/resources/realtimeapi/api.go # pkg/operator/resources/resources.go # pkg/operator/resources/trafficsplitter/api.go

# Conflicts: # cli/cmd/cluster.go # pkg/types/clusterconfig/errors.go

cli/cmd/cluster.go

cli/cmd/errors.go

cli/cmd/cluster.go

manager/render_template.py

pkg/operator/resources/asyncapi/api.go

pkg/types/clusterconfig/cluster_config.go

pkg/types/clusterconfig/errors.go

pkg/lib/aws/s3.go

RobertLucian added 12 commits May 5, 2021 21:12

Create lifecycle expiration date for async workloads

d99fa18

Implement TTL for the S3 bucket (of Cortex)

a536747

Use non-deprecated S3 functions

15f997b

Fix bug on bucket lifecycle policy

16d6b2d

Further fixes

d1839b7

Fix cortex cluster info cmd

0c1adb0

Fix cortex cluster scale cmd

9205446

Async fix

47a7bf6

Merge branch 'master' into feature/implement-ttl-for-s3-on-async

13c954d

Address issued comments

c9087d1

Merge branch 'master' into feature/implement-ttl-for-s3-on-async

67c2d2d

RobertLucian added enhancement New feature or request performance A performance improvement labels May 7, 2021

RobertLucian requested a review from deliahu May 7, 2021 16:29

RobertLucian mentioned this pull request May 7, 2021

Remove bucket cluster configuration option #1611

Closed

1 task

Merge branch 'master' into feature/implement-ttl-for-s3-on-async

549f726

# Conflicts: # cli/cmd/cluster.go # pkg/types/clusterconfig/errors.go