parquet.thrift refers to wrong releases for the new compressions #2143
Description
parquet.thrift contains the following:
/**
* Supported compression algorithms.
*
* Codecs added in {color:red}2.3.2{color} can be read by readers based on {color:red}2.3.2{color} and later.
* Codec support may vary between readers based on the format version and
* libraries available at runtime. Gzip, Snappy, and LZ4 codecs are
* widely available, while Zstd and Brotli require additional libraries.
*/
enum CompressionCodec {
UNCOMPRESSED = 0;
SNAPPY = 1;
GZIP = 2;
LZO = 3;
BROTLI = 4; // Added in {color:red}2.3.2{color}
LZ4 = 5; // Added in {color:red}2.3.2{color}
ZSTD = 6; // Added in {color:red}2.3.2{color}
``}
In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.
Reporter: Zoltan Ivanfi / @zivanfi
Assignee: Zoltan Ivanfi / @zivanfi
Related issues:
- Release Parquet format 2.5.0 (blocks)
PRs and other links:
Note: This issue was originally created as PARQUET-1242. Please see the migration documentation for further details.