CHANGELOG.md

Changelog

53.2.0 (2024-10-21)

Full Changelog

Implemented enhancements:

• Implement arrow_json encoder for Decimal128 & Decimal256 DataTypes #6605 [arrow]
• Support DataType::FixedSizeList in make_builder within struct_builder.rs #6594 [arrow]
• Support DataType::Dictionary in make_builder within struct_builder.rs #6589 [arrow]
• Interval parsing from string - accept "mon" and "mons" token #6548 [arrow]
• AsyncArrowWriter API to get the total size of a written parquet file #6530 [parquet]
• append_many for Dictionary builders #6529 [arrow]
• Missing tonic GRPC_STATUS with tonic 0.12.1 #6515 [arrow] [arrow-flight]
• Add example of how to use parquet metadata reader APIs for a local cache #6504 [parquet]
• Remove reliance on raw-entry feature of Hashbrown #6498 [parquet] [arrow] [arrow-flight]
• Improve page index metadata loading in SerializedFileReader::new_with_options #6491 [parquet]
• Release arrow-rs / parquet minor version 53.1.0 (October 2024) #6340 [arrow]

Fixed bugs:

• Compilation fail where c_char = u8 #6571 [arrow]
• Arrow flight CI test failing on master #6568 [arrow] [arrow-flight]

Documentation updates:

• Minor: Document SIMD rationale and tips #6554 [arrow] (alamb)

Closed issues:

• Casting to and from unions #6247 [arrow]

Merged pull requests:

• Minor: more comments for RecordBatch.get_array_memory_size() #6607 [arrow] (2010YOUY01)
• Implement arrow_json encoder for Decimal128 & Decimal256 #6606 [arrow] (phillipleblanc)
• Add support for building FixedSizeListBuilder in struct_builder's mak… #6595 [arrow] (kszlim)
• Add limited support for dictionary builders in make_builders for stru… #6593 [arrow] (kszlim)
• Fix CI with new valid certificates and add script for future usage #6585 [arrow] [arrow-flight] (itsjunetime)
• Update proc-macro2 requirement from =1.0.87 to =1.0.88 #6579 [arrow] [arrow-flight] (dependabot[bot])
• Fix clippy complaints #6573 [parquet] [arrow] [arrow-flight] (itsjunetime)
• Use c_char instead of i8 to compile on platforms where c_char = u8 #6572 [arrow] (itsjunetime)
• Bump pyspark from 3.3.1 to 3.3.2 in /parquet/pytest #6564 [parquet] (dependabot[bot])
• unsafe improvements #6551 [arrow] (ssbr)
• Update README.md #6550 [arrow] [arrow-flight] (Abdullahsab3)
• Fix string '0' cast to decimal with scale 0 #6547 [arrow] (findepi)
• Add finish to AsyncArrowWriter::finish #6543 [parquet] (etseidl)
• Add append_nulls to dictionary builders #6542 [arrow] (adriangb)
• Improve UnionArray::is_nullable #6540 [arrow] (tustvold)
• Allow to read parquet binary column as UTF8 type #6539 [parquet] (goldmedal)
• Use HashTable instead of raw_entry_mut #6537 [parquet] [arrow] (tustvold)
• Add append_many to dictionary arrays to allow adding repeated values #6534 [arrow] (adriangb)
• Adds documentation and example recommending Vec<ArrayRef> over ChunkedArray #6527 [arrow] (efredine)
• Update proc-macro2 requirement from =1.0.86 to =1.0.87 #6526 [arrow] [arrow-flight] (dependabot[bot])
• Add ColumnChunkMetadataBuilder clear APIs #6523 [parquet] (alamb)
• Update sysinfo requirement from 0.31.2 to 0.32.0 #6521 [parquet] (dependabot[bot])
• Update Tonic to 0.12.3 #6517 [arrow] [arrow-flight] (cisaacson)
• Detect missing page indexes while reading Parquet metadata #6507 [parquet] (etseidl)
• Use ParquetMetaDataReader to load page indexes in SerializedFileReader::new_with_options #6506 [parquet] (etseidl)
• Improve parquet MetadataFetch and AsyncFileReader docs #6505 [parquet] (alamb)
• fix arrow-json encoding with dictionary including nulls #6503 [arrow] (samuelcolvin)
• Update brotli requirement from 6.0 to 7.0 #6499 [parquet] (dependabot[bot])
• Benchmark both scenarios, with records skipped and without skipping, for delta-bin-packed primitive arrays with half nulls. #6489 [parquet] (wiedld)
• Add round trip tests for reading/writing parquet metadata #6463 [parquet] (alamb)

* This Changelog was automatically generated by github_changelog_generator