Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade deps to datafusion 41 #802

Merged
merged 12 commits into from
Aug 23, 2024
Merged

Conversation

Michael-J-Ward
Copy link
Contributor

@Michael-J-Ward Michael-J-Ward commented Aug 10, 2024

Note

This is just the "upgrade the datafusion deps" PR.
After the deps are upgraded, we can implemented features / bugfixes cleanly on top as we prepare for releasing datafusion-python 41

Datafusion 41.0.0 Changelog

Which issue does this PR close?

Part of #828.

What changes are included in this PR?

datafusion dependencies are upgraded and code updated so the tests pass.

No new upstream features were integrated.

Datafusion 41 is not yet released on crates.io.
The old constructor is deprecated.

Ref: apache/datafusion#11403
Upstream Changes:
- The field name was switched from `func_name` to func.
- AggregateFunctionDefinition was removed

Ref: apache/datafusion#11803
Catlog API was extracted to a separate crate.

Ref: apache/datafusion#11516
Also removed `sqlparser` dependency since it's re-exported upstream.

Ref: apache/datafusion#11550
@Michael-J-Ward Michael-J-Ward mentioned this pull request Aug 20, 2024
9 tasks
@Michael-J-Ward Michael-J-Ward marked this pull request as ready for review August 20, 2024 19:16
@Michael-J-Ward Michael-J-Ward changed the title Upgrade 41 Upgrade deps to datafusion 41 Aug 20, 2024
Copy link
Member

@andygrove andygrove left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the datafusion dependencies are re-exported, but I still need to figure out *why*.
@Michael-J-Ward
Copy link
Contributor Author

@andygrove this is ready for merge.

@andygrove andygrove merged commit 3b5085e into apache:main Aug 23, 2024
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants