You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by tg...@apache.org on 2016/01/26 16:40:19 UTC

spark git commit: [SPARK-10911] Executors should System.exit on clean shutdown.

Repository: spark
Updated Branches:
  refs/heads/master 649e9d0f5 -> ae0309a88


[SPARK-10911] Executors should System.exit on clean shutdown.

Call system.exit explicitly to make sure non-daemon user threads terminate. Without this, user applications might live forever if the cluster manager does not appropriately kill them. E.g., YARN had this bug: HADOOP-12441.

Author: zhuol <zh...@yahoo-inc.com>

Closes #9946 from zhuoliu/10911.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ae0309a8
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ae0309a8
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ae0309a8

Branch: refs/heads/master
Commit: ae0309a8812a4fade3a0ea67d8986ca870aeb9eb
Parents: 649e9d0
Author: zhuol <zh...@yahoo-inc.com>
Authored: Tue Jan 26 09:40:02 2016 -0600
Committer: Tom Graves <tg...@yahoo-inc.com>
Committed: Tue Jan 26 09:40:02 2016 -0600

----------------------------------------------------------------------
 .../org/apache/spark/executor/CoarseGrainedExecutorBackend.scala    | 1 +
 1 file changed, 1 insertion(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/ae0309a8/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala b/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
index e3a6c4c..136cf4a 100644
--- a/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
+++ b/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
@@ -241,6 +241,7 @@ private[spark] object CoarseGrainedExecutorBackend extends Logging {
     }
 
     run(driverUrl, executorId, hostname, cores, appId, workerUrl, userClassPath)
+    System.exit(0)
   }
 
   private def printUsageAndExit() = {


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org