You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "weixiuli (Jira)" <ji...@apache.org> on 2021/04/23 03:06:00 UTC

[jira] [Created] (SPARK-35200) Avoid to recompute the pending tasks in the ExecutorAllocationManager and remove unnecessary code

weixiuli created SPARK-35200:
--------------------------------

             Summary: Avoid to recompute the pending tasks in the ExecutorAllocationManager and remove unnecessary code
                 Key: SPARK-35200
                 URL: https://issues.apache.org/jira/browse/SPARK-35200
             Project: Spark
          Issue Type: Improvement
          Components: Scheduler, Spark Core
    Affects Versions: 3.1.1, 3.1.0, 3.0.2
            Reporter: weixiuli


The number of the pending speculative tasks is recomputed in the ExecutorAllocationManager to calculate the maximum number of executors required. while , it only needs to be computed once to improve  performance.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org