-
Notifications
You must be signed in to change notification settings - Fork 335
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge?
Implement an ExpireSnapshotsAction with similar configuration options and outputs to the Spark expire snapshots procedure. Part of #1453.
Describe the solution you'd like
An expire snapshots action that takes the following inputs:
older_than_ms
: A timestamp in milliseconds, specifying the retention window for snapshotsretain_last
: Minimum number of snapshots to retainmax_concurrent_deletes
: Maximum number of concurrent file deletionssnapshot_ids
: A specific list of snapshot IDs to expiredry_run
: A flag allowing a preview of snapshot expiry
It is important that this action both write a new metadata version with snapshots expired, and followup and delete any now-unreferenced files. This will keep both the latest metadata and the metadata directory clean.
Willingness to contribute
I can contribute to this feature independently
liurenjie1024
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request