You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2019/07/07 19:20:00 UTC

[jira] [Created] (AIRFLOW-4906) Improve debugging for the SparkSubmitHook

Fokko Driesprong created AIRFLOW-4906:
-----------------------------------------

             Summary: Improve debugging for the SparkSubmitHook
                 Key: AIRFLOW-4906
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4906
             Project: Apache Airflow
          Issue Type: Improvement
          Components: hooks
    Affects Versions: 1.10.3
            Reporter: Fokko Driesprong
            Assignee: Fokko Driesprong
             Fix For: 2.0.0


Currently, the output of the spark-submit command is not being sent to the logs. This makes debugging of the k8s jobs rather hard. For example, if you make a typo, you only will get the exit code which is non-descriptive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)