You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by an...@apache.org on 2016/03/10 02:54:37 UTC
spark git commit: [SPARK-13778][CORE] Set the executor state for a
worker when removing it
Repository: spark
Updated Branches:
refs/heads/master 37fcda3e6 -> 40e067675
[SPARK-13778][CORE] Set the executor state for a worker when removing it
## What changes were proposed in this pull request?
When a worker is lost, the executors on this worker are also lost. But Master's ApplicationPage still displays their states as running.
This patch just sets the executor state to `LOST` when a worker is lost.
## How was this patch tested?
manual tests
Author: Shixiong Zhu <sh...@databricks.com>
Closes #11609 from zsxwing/SPARK-13778.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/40e06767
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/40e06767
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/40e06767
Branch: refs/heads/master
Commit: 40e0676757c6c7ff367b6738fb42762a29657e94
Parents: 37fcda3
Author: Shixiong Zhu <sh...@databricks.com>
Authored: Wed Mar 9 17:54:34 2016 -0800
Committer: Andrew Or <an...@databricks.com>
Committed: Wed Mar 9 17:54:34 2016 -0800
----------------------------------------------------------------------
core/src/main/scala/org/apache/spark/deploy/master/Master.scala | 1 +
1 file changed, 1 insertion(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/40e06767/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/deploy/master/Master.scala b/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
index 0f11f68..ff8d29f 100644
--- a/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
@@ -763,6 +763,7 @@ private[deploy] class Master(
logInfo("Telling app of lost executor: " + exec.id)
exec.application.driver.send(ExecutorUpdated(
exec.id, ExecutorState.LOST, Some("worker lost"), None))
+ exec.state = ExecutorState.LOST
exec.application.removeExecutor(exec)
}
for (driver <- worker.drivers.values) {
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org