You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2015/12/29 10:40:49 UTC

[jira] [Created] (SPARK-12552) Recovered driver's resource is not counted in the Master

Saisai Shao created SPARK-12552:
-----------------------------------

             Summary: Recovered driver's resource is not counted in the Master
                 Key: SPARK-12552
                 URL: https://issues.apache.org/jira/browse/SPARK-12552
             Project: Spark
          Issue Type: Bug
          Components: Deploy, Spark Core
    Affects Versions: 1.6.0
            Reporter: Saisai Shao


Currently in the implementation of Standalone Master HA, if application is submitted as cluster mode, the resource (CPU cores and memory) of driver is not counted again when recovered from failure, which will lead to unexpected behaviors, like more than expected executors, negative core and memory usage in the web UI. Also the recovered application's state is always {{WAITING}}, we have to change the state to {{RUNNING}} when fully recovered.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org