Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add set_table_properties to DeltaTable class #1663

Closed
ion-elgreco opened this issue Sep 24, 2023 · 4 comments · Fixed by #2264
Closed

Add set_table_properties to DeltaTable class #1663

ion-elgreco opened this issue Sep 24, 2023 · 4 comments · Fixed by #2264
Labels
binding/python Issues for the Python package enhancement New feature or request
Milestone
python v0.15

Comments

@ion-elgreco
Copy link
Collaborator

Description

Use Case
Currently it's not possible to alter the table_properties after a write (or TableConfig as it's referred to in code.) So now you need Spark-delta to alter these properties.
@ion-elgreco ion-elgreco added the enhancement New feature or request label Sep 24, 2023
@MrPowers
Copy link
Collaborator

MrPowers commented Oct 8, 2023

@ion-elgreco - can you provide more details on the specific table properties that you're referring to here?

@ion-elgreco
Copy link
Collaborator Author

ion-elgreco commented Oct 8, 2023 •
edited
Loading

@ion-elgreco - can you provide more details on the specific table properties that you're referring to here?

These ones:
https://books.japila.pl/delta-lake-internals/DeltaConfigs/#table-properties
And https://docs.delta.io/latest/table-properties.html

@ion-elgreco ion-elgreco added this to the python v0.15 milestone Nov 22, 2023
@ion-elgreco ion-elgreco added the binding/python Issues for the Python package label Nov 22, 2023
@ion-elgreco ion-elgreco mentioned this issue Nov 25, 2023
Open
@srsharathreddy-92
Copy link

it would be great if we can change logRetentionDuration property after first write.

@ion-elgreco ion-elgreco mentioned this issue Jan 25, 2024
Closed
@pedrosalgadowork
Copy link

Any update on this, so we can also change it from python?

@ion-elgreco ion-elgreco mentioned this issue Mar 8, 2024
Merged
rtyler added a commit that referenced this issue May 16, 2024
@ion-elgreco @rtyler
feat(python, rust): add set table properties operation (#2264)
507c3a3 
# Description
- Adds `set table properties` operation
- Some logic is shared for the create operation

# Related Issue(s)
- closes #1663
- fixes #2247

---------

Co-authored-by: R. Tyler Croy <rtyler@brokenco.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
binding/python Issues for the Python package enhancement New feature or request
Projects
None yet
Milestone
python v0.15
Development

Successfully merging a pull request may close this issue.

feat(python, rust): add set table properties operation ion-elgreco/delta-rs
4 participants
@MrPowers @ion-elgreco @pedrosalgadowork @srsharathreddy-92