You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "KaiXinXIaoLei (JIRA)" <ji...@apache.org> on 2015/08/05 12:02:05 UTC

[jira] [Created] (SPARK-9635) It's not necessary for driver to send "RequestExecutors" message to ApplicationMaster when killing executors

KaiXinXIaoLei created SPARK-9635:
------------------------------------

             Summary: It's not necessary for driver to  send "RequestExecutors" message to ApplicationMaster  when killing executors
                 Key: SPARK-9635
                 URL: https://issues.apache.org/jira/browse/SPARK-9635
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.4.1
         Environment: export SPARK_EXECUTOR_MEMORY=16G
export SPARK_DRIVER_MEMORY=14G
export SPARK_EXECUTOR_CORES=4
            Reporter: KaiXinXIaoLei
             Fix For: 1.5.0


I see the code. When  driver kill executors, will send "RequestExecutors" to ApplicationMaster , and change the number of executors requested by driver. 
Other, in spark-dynamic-executor-allocation, when the number of tasks is reduced, the desired number of executors will be changed.
The reason for driver to kill executor is : there is no tasks in executor or there is heartbeat of exectuo is timed out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org