You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by rx...@apache.org on 2013/11/06 08:14:14 UTC

[2/2] git commit: Merge pull request #143 from rxin/scheduler-hang

Merge pull request #143 from rxin/scheduler-hang

Ignore a task update status if the executor doesn't exist anymore.

Otherwise if the scheduler receives a task update message when the executor's been removed, the scheduler would hang.

It is pretty hard to add unit tests for these right now because it is hard to mock the cluster scheduler. We should do that once @kayousterhout finishes merging the local scheduler and the cluster scheduler.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/bf4e6131
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/bf4e6131
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/bf4e6131

Branch: refs/heads/master
Commit: bf4e6131cceef4fe00fb5693117c0732f181dbd9
Parents: 9f7b9bb a02eed6
Author: Reynold Xin <rx...@apache.org>
Authored: Tue Nov 5 23:14:09 2013 -0800
Committer: Reynold Xin <rx...@apache.org>
Committed: Tue Nov 5 23:14:09 2013 -0800

----------------------------------------------------------------------
 .../cluster/CoarseGrainedSchedulerBackend.scala       | 14 +++++++++++---
 1 file changed, 11 insertions(+), 3 deletions(-)
----------------------------------------------------------------------