Skip to content

Commit b6e5732

Browse files
zhuqi-lucasalambDandandan
authored
Use the upstream arrow-rs coalesce kernel (#17193)
## Which issue does this PR close? Use the upstream arrow-rs coalesce kernel, and support LimitedBatchCoalesce for datafusion ## Rationale for this change Use the upstream arrow-rs coalesce kernel, also it will support LimitedBatchCoalesce for datafusion. There are some future work based this, for example [Push limit into joins ](#18295) which will optimize join. ## What changes are included in this PR? <!-- There is no need to duplicate the description in the issue here but it is sometimes worth providing a summary of the individual changes in this PR. --> ## Are these changes tested? <!-- We typically require tests for all PRs in order to: 1. Prevent the code from being accidentally broken by subsequent changes 2. Serve as another way to document the expected behavior of the code If tests are not included in your PR, please explain why (for example, are they covered by existing tests)? --> ## Are there any user-facing changes? <!-- If there are user-facing changes then we may require documentation to be updated before approving the PR. --> <!-- If there are any breaking changes to public APIs, please add the `api change` label. --> --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Daniël Heres <danielheres@gmail.com>
1 parent 69f0291 commit b6e5732

File tree

2 files changed

+140
-436
lines changed

2 files changed

+140
-436
lines changed

0 commit comments

Comments
 (0)