Skip to content

SPARK-1911 [DOCS] Warn users if their assembly jars are not built with Java 6 #4874

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
srowen wants to merge 1 commit into from
+4 −0
Closed

SPARK-1911 [DOCS] Warn users if their assembly jars are not built with Java 6 #4874

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/building-spark.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,10 @@ redirect_from: "building-with-maven.html"

Building Spark using Maven requires Maven 3.0.4 or newer and Java 6+.

**Note:** Building Spark with Java 7 or later can create JAR files that may not be
Copy link
Contributor

@vanzin vanzin Mar 3, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The "or later" part is not true, I think. I remember testing that JDK7 is the problem: jars with > 65k files created on JDK7 won't work on either JDK6 or JDK8 (!). Jars created with anything but JDK7 seem to work everywhere.

Copy link
Contributor

@vanzin vanzin Mar 3, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nevermind me. Just ran some quick tests and it seems your warning is accurate.

readable with early versions of Java 6, due to the large number of files in the JAR
archive. Build with Java 6 if this is an issue for your deployment.

# Building with `build/mvn`

Spark now comes packaged with a self-contained Maven installation to ease building and deployment of Spark from source located under the `build/` directory. This script will automatically download and setup all necessary build requirements ([Maven](https://maven.apache.org/), [Scala](http://www.scala-lang.org/), and [Zinc](https://github.com/typesafehub/zinc)) locally within the `build/` directory itself. It honors any `mvn` binary if present already, however, will pull down its own copy of Scala and Zinc regardless to ensure proper version requirements are met. `build/mvn` execution acts as a pass through to the `mvn` call allowing easy transition from previous build methods. As an example, one can build a version of Spark as follows:
Expand Down