You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "KaiXinXIaoLei (JIRA)" <ji...@apache.org> on 2015/08/05 12:02:05 UTC
[jira] [Created] (SPARK-9635) It's not necessary for driver to
send "RequestExecutors" message to ApplicationMaster when killing
executors
KaiXinXIaoLei created SPARK-9635:
------------------------------------
Summary: It's not necessary for driver to send "RequestExecutors" message to ApplicationMaster when killing executors
Key: SPARK-9635
URL: https://issues.apache.org/jira/browse/SPARK-9635
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.4.1
Environment: export SPARK_EXECUTOR_MEMORY=16G
export SPARK_DRIVER_MEMORY=14G
export SPARK_EXECUTOR_CORES=4
Reporter: KaiXinXIaoLei
Fix For: 1.5.0
I see the code. When driver kill executors, will send "RequestExecutors" to ApplicationMaster , and change the number of executors requested by driver.
Other, in spark-dynamic-executor-allocation, when the number of tasks is reduced, the desired number of executors will be changed.
The reason for driver to kill executor is : there is no tasks in executor or there is heartbeat of exectuo is timed out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org