From 1998144561e2bc0e2fb205458ae6249a28ec4554 Mon Sep 17 00:00:00 2001 From: Kay Ousterhout Date: Sun, 11 Oct 2015 12:38:37 -0700 Subject: [PATCH] [SPARK-11056] Improve documentation of SBT build. This commit improves the documentation around building Spark to (1) recommend using SBT interactive mode to avoid the overhead of launching SBT and (2) refer to the wiki page that documents using SPARK_PREPEND_CLASSES to avoid creating the assembly jar for each compile. --- docs/building-spark.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/building-spark.md b/docs/building-spark.md index f133eb96d9a2..69c382fbb3b0 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -206,6 +206,11 @@ can be set to control the SBT build. For example: build/sbt -Pyarn -Phadoop-2.3 assembly +To avoid the overhead of launching sbt each time you need to re-compile, you can launch sbt +in interactive mode by running `build/sbt`, and then run all build commands at the command +prompt. For more recommendations on reducing build time, refer to the +[wiki page](https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-ReducingBuildTimes). + # Testing with SBT Some of the tests require Spark to be packaged first, so always run `build/sbt assembly` the first time. The following is an example of a correct (build, test) sequence: