Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Added integration tests for writing compressed parquet #740

Merged
merged 1 commit into from
Jan 7, 2022
Merged

Conversation

jorgecarleitao
Copy link
Owner

Showing that our written compressed parquet files are read by pyarrow and (py)spark.

pyspark does not ship zstd codecs, so we can't test that in this setup (we only test snappy).

@jorgecarleitao jorgecarleitao added the testing PRs that only increase coverage label Jan 7, 2022
@jorgecarleitao
Copy link
Owner Author

related to jorgecarleitao/parquet2#75

@codecov
Copy link

codecov bot commented Jan 7, 2022

Codecov Report

Merging #740 (5445366) into main (299df30) will increase coverage by 0.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #740      +/-   ##
==========================================
+ Coverage   70.78%   70.80%   +0.01%     
==========================================
  Files         313      313              
  Lines       16899    16899              
==========================================
+ Hits        11962    11965       +3     
+ Misses       4937     4934       -3     
Impacted Files Coverage Δ
src/compute/arithmetics/time.rs 26.60% <0.00%> (+0.91%) ⬆️
src/io/parquet/read/nested_utils.rs 78.43% <0.00%> (+0.98%) ⬆️
src/io/avro/read/schema.rs 55.91% <0.00%> (+1.07%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 299df30...5445366. Read the comment docs.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
testing PRs that only increase coverage
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant