Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Initial split for libarrow components #1175

Closed
wants to merge 28 commits into from
Closed

WIP: Initial split for libarrow components #1175

wants to merge 28 commits into from

Commits on Oct 2, 2023

  1. Initial split for libarrow, libarrow-acero, libarrow-dataset, libarro… 

    …w-flight, libarrow-flight-sql, libarrow-gandiva, libarrow-substrait and use them on pyarrow
    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    c574b01 View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary build requirements

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a6f40bd View commit details
    Browse the repository at this point in the history

  3. Arrow compute is required for default compute kernels to be available… 

    … to register
    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    0b5043f View commit details
    Browse the repository at this point in the history

  4. Add protobuf and grpc to flight and refactor package flags on build

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    544d2fb View commit details
    Browse the repository at this point in the history

  5. Add protobuf to substrait

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    13436e2 View commit details
    Browse the repository at this point in the history

  6. Set Enable Delayed Expansion on Windows build arrow bat

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    fc6eb6a View commit details
    Browse the repository at this point in the history

  7. Only check presence of libarrow_flight_transport_ucx.so on Linux

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    17328d4 View commit details
    Browse the repository at this point in the history

  8. Unconditionally fix protoc-gen-grpc path instead of only for flight

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a1e9138 View commit details
    Browse the repository at this point in the history

  9. Modify ArrowOptions to be turned ON when building pyarrow

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a031627 View commit details
    Browse the repository at this point in the history

  10. Remove grpc and protobuf on some packages

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    30b0915 View commit details
    Browse the repository at this point in the history

  11. Use Windows syntax

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    80caa5b View commit details
    Browse the repository at this point in the history

  12. Initial move to build libarrow-all and then split into components

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a0b1e14 View commit details
    Browse the repository at this point in the history

  13. Add missing protobuf and libgrpc

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    2967eed View commit details
    Browse the repository at this point in the history

  14. Windows fixes

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    ae94de2 View commit details
    Browse the repository at this point in the history

  15. Attempt to move subfolders too

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    3883471 View commit details
    Browse the repository at this point in the history

  16. Use xcopy instead of move to move headers and folder structure

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    1c5f86c View commit details
    Browse the repository at this point in the history

  17. Add missing parquet headers on Windows

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    3d64cd1 View commit details
    Browse the repository at this point in the history

  18. Add Gandiva headers to libarrow-gandiva

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    dafe6b6 View commit details
    Browse the repository at this point in the history

  19. Remove not required host dependencies

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    688128f View commit details
    Browse the repository at this point in the history

  20. Add missing host dependencies, remove unnecessary and host some subpa… 

    …ckages
    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    14eda57 View commit details
    Browse the repository at this point in the history

  21. Build globally and move libarrow-all to be a metapackage

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    d2f91ef View commit details
    Browse the repository at this point in the history

  22. Update missing dependency from rebasing main

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    0ce4125 View commit details
    Browse the repository at this point in the history

  23. Move parquet out of libarrow

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    6136761 View commit details
    Browse the repository at this point in the history

  24. Remove some unnecessary dependencies and add parquet where required

    @raulcd
    raulcd committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    5d15e23 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Arrow cuda should not be present on gandiva now

    @raulcd
    raulcd committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    28edaea View commit details
    Browse the repository at this point in the history

  2. Add libarrow requirement to parquet and gandiva

    @raulcd
    raulcd committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    285fb46 View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary zstd and cuda from gandiva

    @raulcd
    raulcd committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    24e2404 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Add run_exports to libarrow-all

    @raulcd
    raulcd committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    aeb8ceb View commit details
    Browse the repository at this point in the history