You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by an...@apache.org on 2015/01/09 23:55:09 UTC
[1/2] spark git commit: [HOTFIX] Disable Spark UI in SparkSubmitSuite
tests
Repository: spark
Updated Branches:
refs/heads/branch-1.0 b1c1d8612 -> b530bc92a
[HOTFIX] Disable Spark UI in SparkSubmitSuite tests
This should fix a major cause of build breaks when running many parallel tests.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b78422ae
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b78422ae
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b78422ae
Branch: refs/heads/branch-1.0
Commit: b78422ae170b89fa09e8910e247cbfecc23442f8
Parents: b1c1d86
Author: Josh Rosen <jo...@databricks.com>
Authored: Fri Dec 12 12:38:37 2014 -0800
Committer: Andrew Or <an...@databricks.com>
Committed: Fri Jan 9 14:53:25 2015 -0800
----------------------------------------------------------------------
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala | 2 ++
1 file changed, 2 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/b78422ae/core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
----------------------------------------------------------------------
diff --git a/core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala b/core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
index fe817e0..27e1ad9 100644
--- a/core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
+++ b/core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
@@ -260,6 +260,7 @@ class SparkSubmitSuite extends FunSuite with ShouldMatchers with ResetSystemProp
"--class", SimpleApplicationTest.getClass.getName.stripSuffix("$"),
"--name", "testApp",
"--master", "local",
+ "--conf", "spark.ui.enabled=false",
unusedJar.toString)
runSparkSubmit(args)
}
@@ -274,6 +275,7 @@ class SparkSubmitSuite extends FunSuite with ShouldMatchers with ResetSystemProp
"--name", "testApp",
"--master", "local-cluster[2,1,512]",
"--jars", jarsString,
+ "--conf", "spark.ui.enabled=false",
unusedJar.toString)
runSparkSubmit(args)
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[2/2] spark git commit: [HOTFIX] Bind web UI to ephemeral port in
DriverSuite
Posted by an...@apache.org.
[HOTFIX] Bind web UI to ephemeral port in DriverSuite
The job launched by DriverSuite should bind the web UI to an ephemeral port, since it looks like port contention in this test has caused a large number of Jenkins failures when many builds are started simultaneously. Our tests already disable the web UI, but this doesn't affect subprocesses launched by our tests. In this case, I've opted to bind to an ephemeral port instead of disabling the UI because disabling features in this test may mask its ability to catch certain bugs.
See also: e24d3a9
Author: Josh Rosen <jo...@databricks.com>
Closes #3873 from JoshRosen/driversuite-webui-port and squashes the following commits:
48cd05c [Josh Rosen] [HOTFIX] Bind web UI to ephemeral port in DriverSuite.
Conflicts:
core/src/test/scala/org/apache/spark/DriverSuite.scala
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b530bc92
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b530bc92
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b530bc92
Branch: refs/heads/branch-1.0
Commit: b530bc92a523cd92e2ee14d4394fcb2a3f00afb9
Parents: b78422a
Author: Josh Rosen <jo...@databricks.com>
Authored: Thu Jan 1 15:03:54 2015 -0800
Committer: Andrew Or <an...@databricks.com>
Committed: Fri Jan 9 14:54:53 2015 -0800
----------------------------------------------------------------------
----------------------------------------------------------------------
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org