[jira] [Created] (SPARK-23287) Spark scheduler does not remove initial executor if not one job submitted

["Pavel Plotnikov (JIRA)" <ji...@apache.org>]

Pavel Plotnikov created SPARK-23287:
---------------------------------------

             Summary: Spark scheduler does not remove initial executor if not one job submitted
                 Key: SPARK-23287
                 URL: https://issues.apache.org/jira/browse/SPARK-23287
             Project: Spark
          Issue Type: Bug
          Components: Scheduler
    Affects Versions: 2.2.1
         Environment: Cluster manager - Mesos 1.4.1

Spark 2.2.1

spark app configuration:

spark.dynamicAllocation.minExecutors=0

spark.dynamicAllocation.executorIdleTimeout=25s

spark.dynamicAllocation.initialExecutors=1

spark.dynamicAllocation.schedulerBacklogTimeout=4s

spark.dynamicAllocation.sustainedSchedulerBacklogTimeout=5s
            Reporter: Pavel Plotnikov


When spark application submitted it asquare initial number of executors. If no one job was submitted to application spark didn't remove initial executor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org