Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: add generation id handling for iceberg #48568

Conversation

subodh1810
Copy link
Contributor

Iceberg generation id deletion

@subodh1810 subodh1810 self-assigned this Nov 20, 2024
@subodh1810 subodh1810 requested a review from a team as a code owner November 20, 2024 08:43
Copy link

vercel bot commented Nov 20, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Nov 20, 2024 6:39pm

@@ -27,13 +28,35 @@ import org.apache.iceberg.util.PropertyUtil
@Singleton
class IcebergTableWriterFactory {

companion object {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: we don't need to use a companion object for this stuff -- you can just make the class, regex and methods file-level objections. If we needed to expose these statically to Java code, then putting them in an object would be required. However, since all of this is Kotlin code, we don't need to do that here.

@subodh1810 subodh1810 changed the base branch from jonathan/iceberg-writer to jonathan/implement-iceberg-stream-loader November 20, 2024 14:29
Copy link
Contributor

@jdpgrailsdev jdpgrailsdev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@subodh1810
Copy link
Contributor Author

Tests passing locally, merging in

@subodh1810 subodh1810 merged commit f51173e into jonathan/implement-iceberg-stream-loader Nov 20, 2024
17 of 19 checks passed
@subodh1810 subodh1810 deleted the iceberg-genreation-id-logic branch November 20, 2024 18:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants