Skip to content

[HOT FIX] make-distribution.sh fails if Yarn shuffle jar DNE #3250

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
andrewor14 wants to merge 1 commit into from
Closed

[HOT FIX] make-distribution.sh fails if Yarn shuffle jar DNE #3250

andrewor14 wants to merge 1 commit into from

Conversation

@andrewor14
Copy link
Contributor

@andrewor14 andrewor14 commented Nov 13, 2014

This is introduced in #3147 and is failing builds without the -Pyarn profile.

@SparkQA
Copy link

SparkQA commented Nov 13, 2014

Test build #23317 has started for PR 3250 at commit 23fb717.

  • This patch merges cleanly.

@andrewor14 andrewor14 force-pushed the fix-yarn-shuffle-build branch from 23fb717 to 42b3d37 Compare November 13, 2014 19:53
@andrewor14 andrewor14 changed the title [HOT FIX] Copy Yarn shuffle jar only if it exists [HOT FIX] make-distribution.sh fails if Yarn shuffle jar DNE Nov 13, 2014
@andrewor14
Copy link
Contributor Author

andrewor14 commented Nov 13, 2014

Ok I'm merging this because the result of the tests is irrelevant. I have tested this locally with and without the profile.

@SparkQA
Copy link

SparkQA commented Nov 13, 2014

Test build #23322 has started for PR 3250 at commit 42b3d37.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 13, 2014

Test build #23317 has finished for PR 3250 at commit 23fb717.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

AmplabJenkins commented Nov 13, 2014

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23317/
Test PASSed.

asfgit pushed a commit that referenced this pull request Nov 13, 2014
[HOT FIX] make-distribution.sh fails if Yarn shuffle jar DNE
c07592e 
This is introduced in #3147 and is failing builds without the `-Pyarn` profile.

Author: Andrew Or <andrew@databricks.com>

Closes #3250 from andrewor14/fix-yarn-shuffle-build and squashes the following commits:

42b3d37 [Andrew Or] Do not fail fast if Yarn shuffle jar does not exist

(cherry picked from commit a0fa1ba)
Signed-off-by: Andrew Or <andrew@databricks.com>
@asfgit asfgit closed this in a0fa1ba Nov 13, 2014
@SparkQA
Copy link

SparkQA commented Nov 13, 2014

Test build #23322 has finished for PR 3250 at commit 42b3d37.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class NettyBlockTransferService(conf: SparkConf, securityManager: SecurityManager, numCores: Int)
    • abstract class EdgeRDD[ED, VD](
    • abstract class VertexRDD[VD](

@AmplabJenkins
Copy link

AmplabJenkins commented Nov 13, 2014

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23322/
Test PASSed.

@andrewor14 andrewor14 deleted the fix-yarn-shuffle-build branch November 13, 2014 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@andrewor14 @SparkQA @AmplabJenkins