Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bo/v36 #63

Closed
wants to merge 800 commits into from
Closed

Bo/v36 #63

wants to merge 800 commits into from

Conversation

sadboy
Copy link
Collaborator

@sadboy sadboy commented Mar 14, 2024

Which issue does this PR close?

Closes #.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Ted-Jiang and others added 30 commits January 11, 2024 11:38
…pache#8815)

* [Minor] extract const and add doc for in_list pruning

* add explain

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Add size check for aggregate

* Fix failing tests

* Minor changes
* Update clippy in pre-commit.sh

* add datafusion-cli
* Clean up

* Add sqllogictest

* fix

* Fix

* Enable enable_round_robin_repartition for enforce_distribution tests

* Fix

* Try to stable test

* Update datafusion/sqllogictest/test_files/repartition.slt

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* Update datafusion/sqllogictest/test_files/repartition.slt

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* Fix scratch space

* Fix test

* Update datafusion/core/src/physical_optimizer/enforce_distribution.rs

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Implement monotonicity for ScalarUDF

* add unit test case
* support array_resize

* support column

* support LargeList

* add function discription

* add example

* fix ci

* remove useless files

* rename variable and improve error

* clean comment

* rename variable

* improve error output

* use MutableArray

* refactor code and reduce extra function calls

* fix error
* docs: document SessionConfig

* make some tests happy

* pr feedback
* Minor: Improve datafusion-proto documentation
[CI] refactor CI builders

* Update .github/actions/setup-macos-builder/action.yaml

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* Update .github/actions/setup-windows-builder/action.yaml

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Remove async from batch serializer

* Clippy

* Update orchestration.rs
* Add group_by_date_trunc and group_by_limit tests to groupby.slt

* Remove two group_by_date_trunc and group_by_limit from .rs tests

* port group_by_dictionary to groupby.slt

* remove group_by.rs

* rename groupby.slt to group_by.slt

* fix typo in comment
* feat: add datafusion-physical-plan to compatible list

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* feat: add datafusion-execution to the list

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* feat: add datafusion to the list

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix: toml format

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
* Prepare object_store 0.9.0

* Update test

* Update to arrow 50.0.0

* Update sqllogictest

* Update sqllogictests

* Format

* Use nullif

* Use released version of arrow-rs

* Update README to remove references to SIMD

* unpatch datafusion-cli

* Adjust memory sizes in tests

* Restore test without explicit region

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Fix ApproxPercentileCont signature

The number of centroids must be an integer in `coerce_types`.
Reflect that in the type signature.

* Add a unit test for percentile signature error message
* Minor: Update `with_column_rename` method doc
* Document parquet_metadata function

Co-authored-by: comphead <comphead@users.noreply.github.com>

---------

Co-authored-by: comphead <comphead@users.noreply.github.com>
BTreeMap gives stable iteration order, so we don't need to sort

Speeds up benchmarks in sql_planner.rs by 3-8%
* Minor: fix wrong function call

* fix array_union
* Port tests in timestamp.rs to sqllogictest

* Fix clippy error

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Migrate order tests to sqllogictest

* Update unit test for pre-known order

* Revert moving parquet file
* add handling for primary key window frame

* Add check for window end

* Add uniqueness check

* Minor changes

* Update signature of WindowFrame::new

* Make is_causal window state

* Minor changes

* Address reviews

* Minor changes

* Add new test

* Minor changes

* Minor changes

* Remove string handling

* Review Part 2

* Improve comments

---------

Co-authored-by: Mehmet Ozan Kabak <ozankabak@gmail.com>
* fix: don't extract common sub expr in CASE WHEN clause

* fix ci

* fix
* feat(cli): use error exit code when command or file

* fix: remove prints

* style: rust fmt

* refactor: use CLI specific error for display

* refactor: better use statements

* Revert "refactor: better use statements"

This reverts commit fac8c3a.

* Revert "refactor: use CLI specific error for display"

This reverts commit e58d331.

* refactor: wrap main_inner, use ExitCode
alamb and others added 16 commits February 15, 2024 07:25
…ScalarStructBuilder` (apache#9229)

* Improve documentation on how to build `ScalarValue::Struct` and add `ScalarStructBuilder`

* Update datafusion/common/src/scalar/struct_builder.rs

* Improved docs

* update test

---------

Co-authored-by: comphead <comphead@users.noreply.github.com>
…aTypes) (apache#8985)

* ScalarValue return types from argument values

* change file name

* try using ?Sized

* use Ok

* move method default impl outside trait

* Use type trait for ExprSchemable

* fix nit

* Proposed Return Type from Expr suggestions (#1)

* Improve return_type_from_args

* Rework example

* Update datafusion/core/tests/user_defined/user_defined_scalar_functions.rs

---------

Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>

* Apply suggestions from code review

Co-authored-by: Alex Huang <huangweijun1001@gmail.com>

* Fix tests + clippy

* rework types to use dyn trait

* fmt

* docs

* Apply suggestions from code review

Co-authored-by: Jeffrey Vo <jeffrey.vo.australia@gmail.com>

* Add docs explaining what happens when both `return_type` and `return_type_from_exprs` are called

* clippy

* fix doc -- comedy of errors

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Alex Huang <huangweijun1001@gmail.com>
Co-authored-by: Jeffrey Vo <jeffrey.vo.australia@gmail.com>
* Dont call multiunzip when no stats

* Update docstring
* GROUP-BY prioritizes input columns in case of ambiguity

* Update datafusion/sqllogictest/test_files/aggregate.slt

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* Update datafusion/sqllogictest/test_files/aggregate.slt

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
…l` `ScalarValue::Struct` (apache#9238)

* Minor: Add example for `ScalarStructBuilder::new_null`

* Fix null display

* fix docs

* tweak
@sadboy sadboy closed this Jun 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.