You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2014/11/06 04:32:33 UTC
[jira] [Commented] (SPARK-1771) CoarseGrainedSchedulerBackend is
not resilient to Akka restarts
[ https://issues.apache.org/jira/browse/SPARK-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199712#comment-14199712 ]
Apache Spark commented on SPARK-1771:
-------------------------------------
User 'CodingCat' has created a pull request for this issue:
https://github.com/apache/spark/pull/3129
> CoarseGrainedSchedulerBackend is not resilient to Akka restarts
> ---------------------------------------------------------------
>
> Key: SPARK-1771
> URL: https://issues.apache.org/jira/browse/SPARK-1771
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Aaron Davidson
>
> The exception reported in SPARK-1769 was propagated through the CoarseGrainedSchedulerBackend, and caused an Actor restart of the DriverActor. Unfortunately, this actor does not seem to have been written with Akka restartability in mind. For instance, the new DriverActor has lost all state about the prior Executors without cleanly disconnecting them. This means that the driver actually has executors attached to it, but doesn't think it does, which leads to mayhem of various sorts.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org