You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 15:59:00 UTC

[jira] [Commented] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

    [ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569509#comment-16569509 ] 

Apache Spark commented on SPARK-24819:
--------------------------------------

User 'jiangxb1987' has created a pull request for this issue:
https://github.com/apache/spark/pull/22001

> Fail fast when no enough slots to launch the barrier stage on job submitted
> ---------------------------------------------------------------------------
>
>                 Key: SPARK-24819
>                 URL: https://issues.apache.org/jira/browse/SPARK-24819
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: Jiang Xingbo
>            Priority: Major
>
> Check all the barrier stages on job submitted, to see whether the barrier stages require more slots (to be able to launch all the barrier tasks in the same stage together) than currently active slots in the cluster. If the job requires more slots than available (both busy and free slots), fail the job on submit.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org