-
Notifications
You must be signed in to change notification settings - Fork 416
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add high-level checking for append-only tables #1759
Comments
@junjunjd - is this done? Can we close this issue? |
#1807 adds some checks for protocol compatibility before we start the heavy lifting. To check append only, we theoretically need to see the generated actions on a table. We could try and guess what might get generated - e.g. in a merge we suspect updates - but might end up rejecting operations that may have worked. then there are more obvious ones - like delete - that we could prohibit. Do you have some specific thoughts on where we could introduce some pre-write checks? |
@roeap The You are right that for a merge, we won't be able to know if there is data change until the actions are generated. Any high-level checking would need to be added to the While going over the operations, I also noticed that filesystem check will always be rejected if the table is append-only and |
Description
Add high-level checking to delete, merge and update operations to return error immediately when the Delta table is append-only.
Use Case
#1747 adds low-level checking for append-only. This issue will add a high-level checking and thus closes #352.
Related Issue(s)
#352
The text was updated successfully, but these errors were encountered: