[Feature]: Support move files to Trash
when deleting files and restore files from Trash
later
#1167
Closed
2 tasks done
Labels
type:feature
Feature Requests
Description
We should introduce a new feature to improve table security in the situation of deleting files, like snapshots expiration, and orphan files clean, making it easy to restore files when they are deleted by mistake.
Use case/motivation
When files are deleted by mistake, whether they are metadata files or data files, it will cause serious problems for the iceberg table, like loading table errors or reading/writing errors.
And also, it's very difficult to recover the table from the abnormal state above; sometimes, restoring the files is the only way to recover the table.
Describe the solution
Trash
is an optional config for each TableTrash
enabled, files are supposed to be moved to a specific directory, instead of deleted directly from the file system; theTrash
directory is also a config for each TableTrash
when neededTrash
directory is cleaned periodically with an expiration time by AMSGet more details from the doc https://docs.google.com/document/d/1CYBb2u9KmhTcBVy-uUn_Lifu3osNnAgSkiD20LQhmko/edit#heading=h.74a2yp1p0du8
Subtasks
No response
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: