47.0.0 (2023-09-19)
Breaking changes:
- Make FixedSizeBinaryArray value_data return a reference #4820 [arrow]
- Update prost to v0.12.1 #4825 [arrow] [arrow-flight] (tustvold)
- feat: FixedSizeBinaryArray::value_data return reference #4821 [arrow] (wjones127)
- Stateless Row Encoding / Don't Preserve Dictionaries in
RowConverter
(#4811) #4819 [arrow] [arrow-flight] (tustvold) - fix: entries field is non-nullable #4808 [arrow] (wjones127)
- Fix flight sql do put handling, add bind parameter support to FlightSQL cli client #4797 [arrow] [arrow-flight] (suremarc)
- Remove unused dyn_cmp_dict feature #4766 [arrow] (tustvold)
- Add underlying
std::io::Error
toIoError
and addIpcError
variant #4726 [arrow] [arrow-flight] (alexandreyc)
Implemented enhancements:
- Row Format Adapative Block Size #4812 [arrow]
- Stateless Row Conversion #4811 [arrow] [arrow-flight]
- Add option to specify custom null values for CSV reader #4794 [arrow]
- parquet::record::RowIter cannot be customized with batch_size and defaults to 1024 #4782 [parquet]
DynScalar
abstraction (something that makes it easy to create scalarDatum
s) #4781 [arrow]Datum
is not exported as part ofarrow
(it is only exported inarrow_array
) #4780 [arrow]Scalar
is not exported as part ofarrow
(it is only exported inarrow_array
) #4779 [arrow]- Support IntoPyArrow for impl RecordBatchReader #4730 [arrow]
- Datum Based String Kernels #4595 [arrow] [arrow-flight]
Fixed bugs:
- MapArray::new_from_strings creates nullable entries field #4807 [arrow]
- pyarrow module can't roundtrip tensor arrays #4805 [arrow]
concat_batches
errors with "schema mismatch" error when only metadata differs #4799 [arrow]- panic in
cmp
kernels with DictionaryArrays:Option::unwrap()
on aNone
value' #4788 [arrow] - stream ffi panics if schema metadata values aren't valid utf8 #4750 [arrow]
- Regression: Incorrect Sorting of
*ListArray
in 46.0.0 #4746 [arrow] - Row is no longer comparable after reuse #4741 [arrow]
- DoPut FlightSQL handler inadvertently consumes schema at start of Request<Streaming<FlightData>> #4658
- Return error when converting schema #4752 [arrow] (wjones127)
- Implement PyArrowType for
Box<dyn RecordBatchReader + Send>
#4751 [arrow] (wjones127)
Closed issues:
- Building arrow-rust for target wasm32-wasi falied to compile packed_simd_2 #4717
Merged pull requests:
- Respect FormatOption::nulls for NullArray #4836 [arrow] (tustvold)
- Fix merge_dictionary_values in selection kernels #4833 [arrow] (tustvold)
- Fix like scalar null #4832 [arrow] (tustvold)
- More chrono deprecations #4822 [arrow] (tustvold)
- Adaptive Row Block Size (#4812) #4818 [arrow] (tustvold)
- Update proc-macro2 requirement from =1.0.66 to =1.0.67 #4816 [arrow] [arrow-flight] (dependabot[bot])
- Do not check schema for equality in concat_batches #4815 [arrow] (alamb)
- fix: export record batch through stream #4806 [arrow] (wjones127)
- Improve CSV Reader Benchmark Coverage of Small Primitives #4803 [arrow] (tustvold)
- csv: Add option to specify custom null values #4795 [arrow] (vrongmeal)
- Expand docstring and add example to
Scalar
#4793 [arrow] (alamb) - Re-export array crate root (#4780) (#4779) #4791 [arrow] (tustvold)
- Fix DictionaryArray::normalized_keys (#4788) #4789 [arrow] (tustvold)
- Allow custom tree builder for parquet::record::RowIter #4783 [parquet] (YuraKotov)
- Bump actions/checkout from 3 to 4 #4767 (dependabot[bot])
- fix: avoid panic if offset index not exists. #4761 [parquet] (RinChanNOWWW)
- Relax constraints on PyArrowType #4757 (tustvold)
- Chrono deprecations #4748 [arrow] (tustvold)
- Fix List Sorting, Revert Removal of Rank Kernels #4747 [arrow] (tustvold)
- Clear row buffer before reuse #4742 [arrow] (yjshen)
- Datum based like kernels (#4595) #4732 [arrow] [arrow-flight] (tustvold)
- feat: expose DoGet response headers & trailers #4727 [arrow] [arrow-flight] (crepererum)
- Cleanup length and bit_length kernels #4718 [arrow] (tustvold)
* This Changelog was automatically generated by github_changelog_generator