You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/09/27 17:18:00 UTC
[jira] [Commented] (AIRFLOW-1647) Fix Spark-sql hook
[ https://issues.apache.org/jira/browse/AIRFLOW-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182932#comment-16182932 ]
ASF subversion and git services commented on AIRFLOW-1647:
----------------------------------------------------------
Commit 6a9dc8ad183b906aa92f4a7197e078632c6e0ba6 in incubator-airflow's branch refs/heads/master from [~Fokko]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=6a9dc8a ]
[AIRFLOW-1647] Fix Spark-sql hook
The logging in the spark-sql hook was not working
and causing an
exception because the _process_log is not
available. Write to
the log handler directly because the spark-sql
hook cant run in
yarn-cluster mode. Write tests which verify the
popen call of the
hook.
Closes #2637 from Fokko/AIRFLOW-1647-Fix-spark-
sql-hook
> Fix Spark-sql hook
> ------------------
>
> Key: AIRFLOW-1647
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1647
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: Fokko Driesprong
>
> The logging of the Spark-sql hook is not working properly. Will fix this and write a proper test which invokes the command itself.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)