Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: replace deprecated arrow::json::reader::Decoder #1226

Merged
merged 8 commits into from
May 12, 2023
Merged

fix: replace deprecated arrow::json::reader::Decoder #1226

merged 8 commits into from
May 12, 2023

Commits on May 12, 2023

  1. Introduce a failing test for writing with map columns and partitions

    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    3a566ca View commit details
    Browse the repository at this point in the history

  2. Incorporate the latest arrow code and support partitions based on maps 

    This commit incorporates the latest upstream error changes and ensures that a
RecordBatch which contains map data _with_ a partition can be segmented out
correctly.

This depends on the upstream work to support take() on MapArray that @wjones127
recently committed
    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    c62d2bb View commit details
    Browse the repository at this point in the history

  3. Convert test to use DeltaOps instead of deprecated APis

    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    810593d View commit details
    Browse the repository at this point in the history

  4. Address a deprecation warning in the tests

    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    0b1f880 View commit details
    Browse the repository at this point in the history

  5. No longer need to drop decimal data in the test, but binary data for … 

    …JSON is not supported
    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    ea642dc View commit details
    Browse the repository at this point in the history

  6. Upgrade Datafusion and Arrow while I'm here

    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    dc80a35 View commit details
    Browse the repository at this point in the history

  7. Convert back to the Decoder interface which is simpler and no longer … 

    …deprecated in arrow 38
    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    aecd898 View commit details
    Browse the repository at this point in the history

  8. Switch checkpoints over to use the new Decoder API

    @rtyler
    rtyler committed May 12, 2023
    Configuration menu
    Copy the full SHA
    1182c4f View commit details
    Browse the repository at this point in the history