Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Added support to write compressed Arrow IPC (feather v2) #566

Merged
merged 1 commit into from
Nov 4, 2021

Conversation

jorgecarleitao
Copy link
Owner

@jorgecarleitao jorgecarleitao commented Nov 3, 2021

This PR adds support for writing compressed Arrow's IPC format.

Closes #545.

Closes #570 (tracking of backward incompatible changes)

@jorgecarleitao jorgecarleitao added the feature A new feature label Nov 3, 2021
@codecov
Copy link

codecov bot commented Nov 3, 2021

Codecov Report

Merging #566 (ab42d40) into main (ed8836f) will increase coverage by 0.20%.
The diff coverage is 75.76%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #566      +/-   ##
==========================================
+ Coverage   78.90%   79.10%   +0.20%     
==========================================
  Files         395      395              
  Lines       24542    25063     +521     
==========================================
+ Hits        19364    19826     +462     
- Misses       5178     5237      +59     
Impacted Files Coverage Δ
src/io/ipc/read/deserialize.rs 37.41% <50.00%> (+0.17%) ⬆️
src/io/ipc/write/serialize.rs 64.08% <59.25%> (-16.30%) ⬇️
src/io/ipc/compression.rs 84.21% <76.92%> (-15.79%) ⬇️
src/io/ipc/read/read_basic.rs 73.95% <85.71%> (-1.05%) ⬇️
src/io/ipc/write/common.rs 84.66% <88.00%> (+0.74%) ⬆️
src/io/ipc/read/array/boolean.rs 50.00% <100.00%> (ø)
src/io/ipc/read/array/dictionary.rs 50.00% <100.00%> (ø)
tests/it/io/ipc/write/file.rs 100.00% <100.00%> (ø)
tests/it/io/ipc/write/stream.rs 100.00% <100.00%> (ø)
... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ed8836f...ab42d40. Read the comment docs.

@jorgecarleitao jorgecarleitao force-pushed the ipc_compression branch 2 times, most recently from 7cb686a to f9bc10e Compare November 3, 2021 09:17
@jorgecarleitao jorgecarleitao merged commit ec11db5 into main Nov 4, 2021
@jorgecarleitao jorgecarleitao deleted the ipc_compression branch November 4, 2021 06:35
@jorgecarleitao jorgecarleitao changed the title Added writing of compressed Arrow IPC (feather) Added writing of compressed Arrow IPC (feather v2) Nov 4, 2021
@jorgecarleitao jorgecarleitao changed the title Added writing of compressed Arrow IPC (feather v2) Added support to write compressed Arrow IPC (feather v2) Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature A new feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add compression to IpcWriteOptions Add support to write compressed IPC
1 participant