You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:20:00 UTC

[jira] [Created] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

Jiang Xingbo created SPARK-24819:
------------------------------------

             Summary: Fail fast when no enough slots to launch the barrier stage on job submitted
                 Key: SPARK-24819
                 URL: https://issues.apache.org/jira/browse/SPARK-24819
             Project: Spark
          Issue Type: New Feature
          Components: Spark Core
    Affects Versions: 2.4.0
            Reporter: Jiang Xingbo


Check all the barrier stages on job submitted, to see whether the barrier stages require more slots (to be able to launch all the barrier tasks in the same stage together) than currently active slots in the cluster. If the job requires more slots than available (both busy and free slots), fail the job on submit.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org