Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEDE-4869] Upgrade Arrow version to 4.0.0 #16

Merged
merged 78 commits into from
Nov 26, 2021
Merged

[FEDE-4869] Upgrade Arrow version to 4.0.0 #16

merged 78 commits into from
Nov 26, 2021

Commits on Jun 7, 2021

  1. Make BaseValueVector#MAX_ALLOCATION_SIZE configurable 

    This closes apache#65

Some of the tests are based on the assumption that the JVM can allocate at least
2GB of memory, which is not a common occurence (JVM usually defaults at 512MB).
Current Travis CI VM only have 3GB of memory total, which would have make challenging
to run some of the tests on them

Add a system property to change BaseValueVector.MAX_ALLOCATION_SIZE to allow to use
a much smaller value during tests.
    @laurentgo @GeorgeAp
    laurentgo authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    37e3aa7 View commit details
    Browse the repository at this point in the history

  2. prefix arrow's version with siren

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    36934a0 View commit details
    Browse the repository at this point in the history

  3. use our version of netty

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    f775b41 View commit details
    Browse the repository at this point in the history

  4. updated readme about siren's changes

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    965c694 View commit details
    Browse the repository at this point in the history

  5. fixed dependency issue with our own artifactory

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    2d95009 View commit details
    Browse the repository at this point in the history

  6. use our version of netty

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    b49ed93 View commit details
    Browse the repository at this point in the history

  7. shade the arrow memory jar

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    e5ef15b View commit details
    Browse the repository at this point in the history

  8. improved doc

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    105f61f View commit details
    Browse the repository at this point in the history

  9. fix readme

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    d5a5953 View commit details
    Browse the repository at this point in the history

  10. document the changes done to the arrow fork

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    0a97b4a View commit details
    Browse the repository at this point in the history

  11. ARROW-5856: [Python] [Packaging] Fix use of C++ / Cython API from wheels 

    Author: Antoine Pitrou <antoine@python.org>

Closes apache#4884 from pitrou/ARROW-5856-cython-so-version and squashes the following commits:

a411d7a <Antoine Pitrou> Avoid C++ ABI issues with DictionaryMemo
eaede5b <Antoine Pitrou> Revert ARROW-5082 (" Stop exporting copies of shared libraries in wheel")
4594f78 <Antoine Pitrou> ARROW-5856:  Try to fix Cython API from wheels
    @pitrou @GeorgeAp
    pitrou authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    98af6ec View commit details
    Browse the repository at this point in the history

  12. use our version of netty

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    98ca086 View commit details
    Browse the repository at this point in the history

  13. set drill's default value

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    883c893 View commit details
    Browse the repository at this point in the history

  14. use our version of netty

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    a6f90f2 View commit details
    Browse the repository at this point in the history

  15. bumped to 0.8.0

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    1cf4cbe View commit details
    Browse the repository at this point in the history

  16. update to 0.14.1

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    49bd8fc View commit details
    Browse the repository at this point in the history

  17. comment unneeded modules

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    88a3f62 View commit details
    Browse the repository at this point in the history

  18. update release procedure with unneeded modules commented out

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    90968ce View commit details
    Browse the repository at this point in the history

  19. bump version to siren-0.14.1-1 and update readme

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    29fd716 View commit details
    Browse the repository at this point in the history

  20. do not allocate a new offset buffer if the slice starts at 0 since th… 

    …e relative offset pointer would be unchanged
    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    ad3b1e0 View commit details
    Browse the repository at this point in the history

  21. fix slice bounds

    @scampi @GeorgeAp
    scampi authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    286f9fb View commit details
    Browse the repository at this point in the history

  22. improved readme

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    3580c6f View commit details
    Browse the repository at this point in the history

  23. Upgraded netty dependendcy to siren-4.1.27-3

    @manseaume @GeorgeAp
    manseaume authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    37ac963 View commit details
    Browse the repository at this point in the history

  24. [FEDE-3917] netty direct memory counter deprecation with bump to sire… 

    …n-0.14.1-6-SNAPSHOT (#10)

* Release siren-0.14.1-5

* Bump to version siren-0.14.1-6-SNAPSHOT

* Use Siren Netty fork version siren-4.1.27-4 to release siren-0.14.1-6

* Bump version to release siren-0.14.1-5 using Netty Siren siren-4.1.27-4

* Set the version to siren-0.14.1-6-SNAPSHOT

Co-authored-by: Martin Anseaume <martin.anseaume@siren.io>
    @itudoben @manseaume @GeorgeAp
    2 people authored and GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    a8c58d9 View commit details
    Browse the repository at this point in the history

  25. Fix rebase

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    a4f50fb View commit details
    Browse the repository at this point in the history

  26. Fix pom

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    d7824b0 View commit details
    Browse the repository at this point in the history

  27. Fix rebase - Bump version to siren-4.0.0-1-SNAPSHOT

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    c7a17a9 View commit details
    Browse the repository at this point in the history

  28. Clean-up

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    fd3a41b View commit details
    Browse the repository at this point in the history

  29. Comment out memory-netty module and remove use siren netty

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    9967efa View commit details
    Browse the repository at this point in the history

  30. Update siren netty version

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    1d8e183 View commit details
    Browse the repository at this point in the history

  31. Fix rebase

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    c2163cb View commit details
    Browse the repository at this point in the history

  32. Comment netty

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    8e8633d View commit details
    Browse the repository at this point in the history

  33. Fix TestValueVector

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    75c489b View commit details
    Browse the repository at this point in the history

  34. Remove unused imports

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    c82be02 View commit details
    Browse the repository at this point in the history

  35. Remove unused import

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    814e327 View commit details
    Browse the repository at this point in the history

  36. Clean up

    @GeorgeAp
    GeorgeAp committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    3623c3f View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2021

  1. Clean up - fix checkstyle

    @GeorgeAp
    GeorgeAp committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    b26bec2 View commit details
    Browse the repository at this point in the history

  2. Clean up - fix checkstyle 2

    @GeorgeAp
    GeorgeAp committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    8fb0a62 View commit details
    Browse the repository at this point in the history

  3. WIP

    @GeorgeAp
    GeorgeAp committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    fe59613 View commit details
    Browse the repository at this point in the history

  4. WIP - add siren netty plugin

    @GeorgeAp
    GeorgeAp committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    9b2a562 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2021

  1. WIP - ignore failing test

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    9e8011b View commit details
    Browse the repository at this point in the history

  2. Fix rebase as per peer review

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    c3ebc9b View commit details
    Browse the repository at this point in the history

  3. Fix rebase python

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    115f964 View commit details
    Browse the repository at this point in the history

  4. Fix ZeroVector unused imports

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    93c7b41 View commit details
    Browse the repository at this point in the history

  5. Fix checkstyle

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    9a4b8b3 View commit details
    Browse the repository at this point in the history

  6. Fix rebase

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    14df3df View commit details
    Browse the repository at this point in the history

  7. Fix rebase

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    a45517b View commit details
    Browse the repository at this point in the history

  8. Fix checkstyle imports violation

    @GeorgeAp
    GeorgeAp committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    ffb9291 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2021

  1. Fix checkstyle and update netty version

    @GeorgeAp
    GeorgeAp committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    e25e8ec View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2021

  1. Use Arrow's ArrowBuf instead of our own

    @GeorgeAp
    GeorgeAp committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    a73101d View commit details
    Browse the repository at this point in the history

  2. Fix imports

    @GeorgeAp
    GeorgeAp committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    cfa6070 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. Fix checkstyle

    @GeorgeAp
    GeorgeAp committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    3d7bd90 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2021

  1. Tentative fix: workaround for the shading issue but creat new problems

    @ggdupont
    ggdupont committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    6d94b43 View commit details
    Browse the repository at this point in the history

  2. fix missing import

    @ggdupont
    ggdupont committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    1b5a35e View commit details
    Browse the repository at this point in the history

  3. Fix import

    @GeorgeAp
    GeorgeAp committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    7da1af1 View commit details
    Browse the repository at this point in the history

  4. Fix imports

    @GeorgeAp
    GeorgeAp committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    e8f38e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2021

  1. Revert ignored unit tests

    @GeorgeAp
    GeorgeAp committed Jul 19, 2021
    Configuration menu
    Copy the full SHA
    0e5862e View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2021

  1. Revert automatic format changes

    @GeorgeAp
    GeorgeAp committed Jul 23, 2021
    Configuration menu
    Copy the full SHA
    a1921ea View commit details
    Browse the repository at this point in the history

  2. Revert format to original format

    @GeorgeAp
    GeorgeAp committed Jul 23, 2021
    Configuration menu
    Copy the full SHA
    cede323 View commit details
    Browse the repository at this point in the history

  3. Update vector pom as per peer review

    @GeorgeAp
    GeorgeAp committed Jul 23, 2021
    Configuration menu
    Copy the full SHA
    333f1b8 View commit details
    Browse the repository at this point in the history

  4. Revert ignored TestArrowBufHasher.testHasherNegative

    @GeorgeAp
    GeorgeAp committed Jul 23, 2021
    Configuration menu
    Copy the full SHA
    b188a31 View commit details
    Browse the repository at this point in the history

  5. Clean up

    @GeorgeAp
    GeorgeAp committed Jul 23, 2021
    Configuration menu
    Copy the full SHA
    8942391 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2021

  1. Update as per peer review

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    831c485 View commit details
    Browse the repository at this point in the history

  2. Undo unnecessary change in tasks.yml

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    388be9c View commit details
    Browse the repository at this point in the history

  3. Undo unnecessary changes

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    4afff23 View commit details
    Browse the repository at this point in the history

  4. Revert changes

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    fe8a7a6 View commit details
    Browse the repository at this point in the history

  5. Revert changes

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    c837af0 View commit details
    Browse the repository at this point in the history

  6. Revert changes as per peer review

    @GeorgeAp
    GeorgeAp committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    601fead View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2021

  1. Update as per peer review

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    5d79a19 View commit details
    Browse the repository at this point in the history

  2. Add back class path dependency exclusion

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    c636730 View commit details
    Browse the repository at this point in the history

  3. Remove whitespace

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    8d6d67e View commit details
    Browse the repository at this point in the history

  4. Update memory access with default value

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    3aba23a View commit details
    Browse the repository at this point in the history

  5. Remove class path exclusion

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    1e22aea View commit details
    Browse the repository at this point in the history

  6. Update readme

    @GeorgeAp
    GeorgeAp committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    0827e53 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. Exclude memory-core from the shaded netty in memory-netty package

    @GeorgeAp
    GeorgeAp committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    5ed587b View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2021

  1. Add information for checking that Siren version of Netty is used

    @GeorgeAp
    GeorgeAp committed Nov 4, 2021
    Configuration menu
    Copy the full SHA
    418aaf6 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2021

  1. [FEDE-5144] Fix the static initialization of MemoryUtil (#17) 

    * Remove unecessary setAccessible call

* Catch all errors thrown by the setAccessible call

New version of java can throw InaccessibleObjectException which Arrow
didn't handle
    @scampi
    scampi authored Nov 25, 2021
    Configuration menu
    Copy the full SHA
    f243f2a View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2021

  1. Update netty version to the stable version siren-4.1.48-1

    @GeorgeAp
    GeorgeAp committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    e7aa338 View commit details
    Browse the repository at this point in the history