You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Milan van der Meer (JIRA)" <ji...@apache.org> on 2018/03/27 07:53:00 UTC

[jira] [Created] (AIRFLOW-2256) SparkOperator supports client standalone mode and retry mechanism

Milan van der Meer created AIRFLOW-2256:
-------------------------------------------

             Summary: SparkOperator supports client standalone mode and retry mechanism
                 Key: AIRFLOW-2256
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2256
             Project: Apache Airflow
          Issue Type: Improvement
    Affects Versions: 1.9.0
            Reporter: Milan van der Meer
            Assignee: Milan van der Meer


Currently submitting to a Spark standalone cluster in client mode, is not supported.

When submitting to a Spark standalone cluster, network failures, or timeouts are common,
therefore a retry mechanism to poll for the Spark Job status needs to be implemented.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)