Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Migrated to latest parquet2 #752

Merged
merged 1 commit into from
Jan 11, 2022
Merged

Migrated to latest parquet2 #752

merged 1 commit into from
Jan 11, 2022

Conversation

jorgecarleitao
Copy link
Owner

Note that its API for writing streams changed a bit, from a stream of row groups to a stream of future row groups.

This allows users to not serialize a chunk on the stream while writing, to not block the runtime (e.g. via tokio_rayon).

@codecov
Copy link

codecov bot commented Jan 11, 2022

Codecov Report

Merging #752 (c740e9f) into main (4c29966) will decrease coverage by 0.03%.
The diff coverage is 0.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #752      +/-   ##
==========================================
- Coverage   70.82%   70.79%   -0.04%     
==========================================
  Files         313      313              
  Lines       16931    17050     +119     
==========================================
+ Hits        11992    12070      +78     
- Misses       4939     4980      +41     
Impacted Files Coverage Δ
src/io/parquet/write/record_batch.rs 82.75% <ø> (ø)
src/io/parquet/write/stream.rs 0.00% <0.00%> (ø)
src/io/csv/mod.rs 0.00% <0.00%> (ø)
src/io/avro/mod.rs 66.66% <0.00%> (ø)
src/io/json/mod.rs 100.00% <0.00%> (ø)
src/io/ipc/write/serialize.rs 64.64% <0.00%> (+0.68%) ⬆️
src/io/parquet/read/nested_utils.rs 78.43% <0.00%> (+0.98%) ⬆️
src/io/avro/read/schema.rs 55.91% <0.00%> (+1.07%) ⬆️
src/io/ipc/read/read_basic.rs 72.48% <0.00%> (+2.18%) ⬆️
src/types/native.rs 26.84% <0.00%> (+4.92%) ⬆️
... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4c29966...c740e9f. Read the comment docs.

@jorgecarleitao jorgecarleitao merged commit c7570bf into main Jan 11, 2022
@jorgecarleitao jorgecarleitao deleted the parquet_buffer branch January 11, 2022 07:22
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant