Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade datafusion to 22 which brings arrow upgrades with it #1249

Merged
merged 12 commits into from
Apr 14, 2023
Merged

Upgrade datafusion to 22 which brings arrow upgrades with it #1249

merged 12 commits into from
Apr 14, 2023

Commits on Apr 13, 2023

  1. Upgrade datafusion to 21 which brings arrow upgrades with it 

    There are a number of API changes and compiler deprecation warnings that need to
be addressed.

See #1248
    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    ade2f32 View commit details
    Browse the repository at this point in the history

  2. Upgrade to arrow 36 to support our schemas better 

    Noticed while upgrading to 34 that checkpoint tests were failing to decode
timestamps with the new `RawReaderBuilder`. This appears to be fixed by release
36
    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    cf0c7be View commit details
    Browse the repository at this point in the history

  3. Temporarily allow the use of the deprecated Decoder API

    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    31c421c View commit details
    Browse the repository at this point in the history

  4. Adapt to the register_object_store() API changes

    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    1643595 View commit details
    Browse the repository at this point in the history

  5. Temporary: source datafusion from git until 22 is released

    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    6e2985f View commit details
    Browse the repository at this point in the history

  6. Upgrade to arrow 37 and datafusion 22

    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    20e0247 View commit details
    Browse the repository at this point in the history

  7. Update the API calls in arrow 37 that now expect Fields

    @rtyler
    rtyler committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    20547be View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. chore: df / arrow changes after update

    @roeap @rtyler
    roeap authored and rtyler committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    7fa531e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into datafusion-upgrade

    @rtyler
    rtyler committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    89524fa View commit details
    Browse the repository at this point in the history

  3. Update the datafusion tests to use the new method for registering tab… 

    …le providers
    @rtyler
    rtyler committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    bfecb6b View commit details
    Browse the repository at this point in the history

  4. cargo fmt

    @rtyler
    rtyler committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    ee4547d View commit details
    Browse the repository at this point in the history

  5. chore: bump arrow-schema in python

    @roeap
    roeap committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    d22f67f View commit details
    Browse the repository at this point in the history