You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sital Kedia (JIRA)" <ji...@apache.org> on 2017/08/25 01:02:00 UTC

[jira] [Created] (SPARK-21834) Incorrect executor request in case of dynamic allocation

Sital Kedia created SPARK-21834:
-----------------------------------

             Summary: Incorrect executor request in case of dynamic allocation
                 Key: SPARK-21834
                 URL: https://issues.apache.org/jira/browse/SPARK-21834
             Project: Spark
          Issue Type: Bug
          Components: Scheduler
    Affects Versions: 2.2.0
            Reporter: Sital Kedia


killExecutor api currently does not allow killing an executor without updating the total number of executors needed. In case of dynamic allocation is turned on and the allocator tries to kill an executor, the scheduler reduces the total number of executors needed ( see https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala#L635) which is incorrect because the allocator already takes care of setting the required number of executors itself. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org