Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ARROW-10388: [Java] Fix Spark integration build failure #8526

Closed
wants to merge 2 commits into from
Closed

ARROW-10388: [Java] Fix Spark integration build failure #8526

wants to merge 2 commits into from

Conversation

liyafan82
Copy link
Contributor

@github-actions
Copy link

https://issues.apache.org/jira/browse/ARROW-10388

@kou
Copy link
Member

kou commented Oct 27, 2020

@github-actions crossbow submit -spark-

@github-actions
Copy link

Revision: ef51e52

Submitted crossbow builds: ursa-labs/crossbow @ actions-681

Task Status
test-conda-python-3.7-spark-branch-3.0 Github Actions
test-conda-python-3.8-spark-master Github Actions

@liyafan82
Copy link
Contributor Author

liyafan82 commented Oct 27, 2020 •
edited
Loading

The first test (test-conda-python-3.7-spark-branch-3.0) failed because of lacking a library on the class path:

Caused by: java.lang.RuntimeException: No DefaultAllocationManager found on classpath. Can't allocate Arrow buffers. Please consider adding arrow-memory-netty or arrow-memory-unsafe as a dependency.

This change was introduced recently as we split the arrow-memory module into 3 modules.

@emkornfield
Copy link
Contributor

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@liyafan82
Copy link
Contributor Author

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@emkornfield Sounds reasonable. Thanks.

@liyafan82 liyafan82 closed this Oct 29, 2020
@liyafan82 liyafan82 reopened this Oct 29, 2020
@liyafan82
Copy link
Contributor Author

Merging this, as something is wrong with continuous-integration/travis-ci/pr

@liyafan82 liyafan82 closed this in 38971af Oct 29, 2020
@liyafan82
Copy link
Contributor Author

I have opened https://issues.apache.org/jira/browse/SPARK-33279 to track the build failure on spark-3.0 branch.

GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
@liyafan82 @emkornfield @GeorgeAp
ARROW-10388: [Java] Fix Spark integration build failure
69a5645 
Please see https://issues.apache.org/jira/browse/ARROW-10388

Closes apache#8526 from liyafan82/fly_1026_spk

Lead-authored-by: liyafan82 <fan_li_ya@foxmail.com>
Co-authored-by: emkornfield <emkornfield@gmail.com>
Signed-off-by: liyafan82 <fan_li_ya@foxmail.com>
@asfimport asfimport mentioned this pull request Oct 29, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@liyafan82 @kou @emkornfield