You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/09/27 17:18:00 UTC

[jira] [Commented] (AIRFLOW-1647) Fix Spark-sql hook

    [ https://issues.apache.org/jira/browse/AIRFLOW-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182932#comment-16182932 ] 

ASF subversion and git services commented on AIRFLOW-1647:
----------------------------------------------------------

Commit 6a9dc8ad183b906aa92f4a7197e078632c6e0ba6 in incubator-airflow's branch refs/heads/master from [~Fokko]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=6a9dc8a ]

[AIRFLOW-1647] Fix Spark-sql hook

The logging in the spark-sql hook was not working
and causing an
exception because the _process_log is not
available. Write to
the log handler directly because the spark-sql
hook cant run in
yarn-cluster mode. Write tests which verify the
popen call of the
hook.

Closes #2637 from Fokko/AIRFLOW-1647-Fix-spark-
sql-hook


> Fix Spark-sql hook
> ------------------
>
>                 Key: AIRFLOW-1647
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1647
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Fokko Driesprong
>
> The logging of the Spark-sql hook is not working properly. Will fix this and write a proper test which invokes the command itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)