Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add finish to AsyncArrowWriter::finish #6543

Merged
merged 1 commit into from
Oct 12, 2024

Conversation

etseidl
Copy link
Contributor

@etseidl etseidl commented Oct 11, 2024

Which issue does this PR close?

Closes #6530.

Rationale for this change

Mirror other writers and add a finish method that is a close that doesn't consume self. This allows state like bytes written to be queried after writing is complete.

What changes are included in this PR?

Add finish as well as a test provided by @alamb in #6530

Are there any user-facing changes?

@github-actions github-actions bot added the parquet Changes to the parquet crate label Oct 11, 2024
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great to me -- thank you @etseidl and @mbrobbel

cc @tustvold and @pauldix

@alamb alamb changed the title Add finish to AsyncArrowWriter Add finish to AsyncArrowWriter::finish Oct 11, 2024
@alamb alamb merged commit 9633f14 into apache:master Oct 12, 2024
17 checks passed
@alamb
Copy link
Contributor

alamb commented Oct 12, 2024

Thanks again everyone

@etseidl etseidl deleted the async_writer_finish branch October 12, 2024 22:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AsyncArrowWriter API to get the total size of a written parquet file
3 participants