You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2018/04/09 08:22:00 UTC

[jira] [Resolved] (AIRFLOW-2256) SparkOperator supports client standalone mode and retry mechanism

     [ https://issues.apache.org/jira/browse/AIRFLOW-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fokko Driesprong resolved AIRFLOW-2256.
---------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request #3163
[https://github.com/apache/incubator-airflow/pull/3163]

> SparkOperator supports client standalone mode and retry mechanism
> -----------------------------------------------------------------
>
>                 Key: AIRFLOW-2256
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2256
>             Project: Apache Airflow
>          Issue Type: Improvement
>    Affects Versions: 1.9.0
>            Reporter: Milan van der Meer
>            Assignee: Milan van der Meer
>            Priority: Minor
>             Fix For: 2.0.0
>
>
> Currently submitting to a Spark standalone cluster in client mode, is not supported.
> When submitting to a Spark standalone cluster, network failures, or timeouts are common,
> therefore a retry mechanism to poll for the Spark Job status needs to be implemented.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)