You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/05/15 09:13:00 UTC

[jira] [Commented] (AIRFLOW-6794) Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

    [ https://issues.apache.org/jira/browse/AIRFLOW-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108114#comment-17108114 ] 

ASF GitHub Bot commented on AIRFLOW-6794:
-----------------------------------------

JavierLopezT commented on pull request #7688:
URL: https://github.com/apache/airflow/pull/7688#issuecomment-629126259


   I would add at the beggining:
   
       template_fields = ('s3_key', 'select_custom_query',)
       template_ext = ('.sql',)
   
   So that you can place the custom query in a file and also use s3_key and custom query with templates


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query
> -------------------------------------------------------------
>
>                 Key: AIRFLOW-6794
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6794
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, operators
>    Affects Versions: 1.10.9
>            Reporter: Roger Russel Droique Neris
>            Assignee: Omkar
>            Priority: Trivial
>              Labels: AWS, newbie
>
> {{The Redshift operator }}
> {{"airflow.providers.amazon.aws.operators.redshift_to_s3.}}{{RedshiftToS3Transfer" allow only a simple usage to transfer a table to a S3. }}
> {{[https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/redshift_to_s3.py#L110]}}
> {{If possible I would like to implement an usage of a custom query on it.}}
> {{The behavior expected is when a "query" parameter is given then it wil use it, and if the it was not given it will use the default behavior.}}
> {{}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)