You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ka...@apache.org on 2015/10/12 23:23:47 UTC
spark git commit: [SPARK-11056] Improve documentation of SBT build.
Repository: spark
Updated Branches:
refs/heads/master 8a354bef5 -> 091c2c3ec
[SPARK-11056] Improve documentation of SBT build.
This commit improves the documentation around building Spark to
(1) recommend using SBT interactive mode to avoid the overhead of
launching SBT and (2) refer to the wiki page that documents using
SPARK_PREPEND_CLASSES to avoid creating the assembly jar for each
compile.
cc srowen
Author: Kay Ousterhout <ka...@gmail.com>
Closes #9068 from kayousterhout/SPARK-11056.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/091c2c3e
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/091c2c3e
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/091c2c3e
Branch: refs/heads/master
Commit: 091c2c3ecd69803d78c2b15a1487046701059d38
Parents: 8a354be
Author: Kay Ousterhout <ka...@gmail.com>
Authored: Mon Oct 12 14:23:29 2015 -0700
Committer: Kay Ousterhout <ka...@gmail.com>
Committed: Mon Oct 12 14:23:29 2015 -0700
----------------------------------------------------------------------
docs/building-spark.md | 5 +++++
1 file changed, 5 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/091c2c3e/docs/building-spark.md
----------------------------------------------------------------------
diff --git a/docs/building-spark.md b/docs/building-spark.md
index 4d929ee..743643c 100644
--- a/docs/building-spark.md
+++ b/docs/building-spark.md
@@ -216,6 +216,11 @@ can be set to control the SBT build. For example:
build/sbt -Pyarn -Phadoop-2.3 assembly
+To avoid the overhead of launching sbt each time you need to re-compile, you can launch sbt
+in interactive mode by running `build/sbt`, and then run all build commands at the command
+prompt. For more recommendations on reducing build time, refer to the
+[wiki page](https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-ReducingBuildTimes).
+
# Testing with SBT
Some of the tests require Spark to be packaged first, so always run `build/sbt assembly` the first time. The following is an example of a correct (build, test) sequence:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org