You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2019/06/12 18:50:00 UTC
[jira] [Commented] (AIRFLOW-4233) BigQueryToCloudStorageOperator
with TemplateNotFound for filename ending with .sql
[ https://issues.apache.org/jira/browse/AIRFLOW-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862369#comment-16862369 ]
jack commented on AIRFLOW-4233:
-------------------------------
I'm not sure why there is
{code:java}
template_ext = ('.sql',){code}
in the operator.
The BigQueryToCloudStorageOperator doesn't have sql parameter as it doesn't work with queries at all. It takes only tables. If one wish to export query result to storage once must first run BigQueryOperator to save query result to table and then export the table with BigQueryToCloudStorageOperator .
[~kaxilnaik] maybe you have some input on this template_ext ?
[https://github.com/apache/airflow/blob/master/airflow/contrib/operators/bigquery_to_gcs.py#L63]
> BigQueryToCloudStorageOperator with TemplateNotFound for filename ending with .sql
> ----------------------------------------------------------------------------------
>
> Key: AIRFLOW-4233
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4233
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Reporter: Harris Chiu
> Priority: Major
>
> The issue happens when we have destination url ending with .sql.
> It is related to the defined template extension template_ext = ('.sql',)
> The operator looks for jinja template, however, it's an output path, so the file is not found when looking for any jinja template syntax
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)