You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by jo...@apache.org on 2015/01/02 00:04:02 UTC
spark git commit: [HOTFIX] Bind web UI to ephemeral port in
DriverSuite
Repository: spark
Updated Branches:
refs/heads/master 7749dd6c3 -> 012839807
[HOTFIX] Bind web UI to ephemeral port in DriverSuite
The job launched by DriverSuite should bind the web UI to an ephemeral port, since it looks like port contention in this test has caused a large number of Jenkins failures when many builds are started simultaneously. Our tests already disable the web UI, but this doesn't affect subprocesses launched by our tests. In this case, I've opted to bind to an ephemeral port instead of disabling the UI because disabling features in this test may mask its ability to catch certain bugs.
See also: e24d3a9
Author: Josh Rosen <jo...@databricks.com>
Closes #3873 from JoshRosen/driversuite-webui-port and squashes the following commits:
48cd05c [Josh Rosen] [HOTFIX] Bind web UI to ephemeral port in DriverSuite.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/01283980
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/01283980
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/01283980
Branch: refs/heads/master
Commit: 012839807c3dc6e7c8c41ac6e956d52a550bb031
Parents: 7749dd6
Author: Josh Rosen <jo...@databricks.com>
Authored: Thu Jan 1 15:03:54 2015 -0800
Committer: Josh Rosen <jo...@databricks.com>
Committed: Thu Jan 1 15:03:54 2015 -0800
----------------------------------------------------------------------
core/src/test/scala/org/apache/spark/DriverSuite.scala | 5 ++++-
1 file changed, 4 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/01283980/core/src/test/scala/org/apache/spark/DriverSuite.scala
----------------------------------------------------------------------
diff --git a/core/src/test/scala/org/apache/spark/DriverSuite.scala b/core/src/test/scala/org/apache/spark/DriverSuite.scala
index 5265ba9..541d8ea 100644
--- a/core/src/test/scala/org/apache/spark/DriverSuite.scala
+++ b/core/src/test/scala/org/apache/spark/DriverSuite.scala
@@ -50,7 +50,10 @@ class DriverSuite extends FunSuite with Timeouts {
object DriverWithoutCleanup {
def main(args: Array[String]) {
Utils.configTestLog4j("INFO")
- val sc = new SparkContext(args(0), "DriverWithoutCleanup")
+ // Bind the web UI to an ephemeral port in order to avoid conflicts with other tests running on
+ // the same machine (we shouldn't just disable the UI here, since that might mask bugs):
+ val conf = new SparkConf().set("spark.ui.port", "0")
+ val sc = new SparkContext(args(0), "DriverWithoutCleanup", conf)
sc.parallelize(1 to 100, 4).count()
}
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org