You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/15 04:57:23 UTC
[GitHub] [airflow] selvamshan opened a new pull request #10336: Update redshift_to_s3_operator.py
selvamshan opened a new pull request #10336:
URL: https://github.com/apache/airflow/pull/10336
S3ToRedshiftTransfer and RedshiftToS3Transfer with temporary token credentials #9970
Aws ref: https://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-authorization.html
example
copy customer from 's3://mybucket/mydata'
credentials
'aws_iam_role=arn:aws:iam::<account-id>:role/<role-name>;master_symmetric_key=<master-key>'
<!--
Thank you for contributing! Please make sure that your code changes
are covered with tests. And in case of new features or big changes
remember to adjust the documentation.
Feel free to ping committers for the review!
In case of existing issue, reference it using one of the following:
closes: #ISSUE
related: #ISSUE
How to write a good git commit message:
http://chris.beams.io/posts/git-commit/
-->
---
**^ Add meaningful description above**
Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more information.
In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed.
In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] stale[bot] closed pull request #10336: Update redshift_to_s3_operator.py
Posted by GitBox <gi...@apache.org>.
stale[bot] closed pull request #10336:
URL: https://github.com/apache/airflow/pull/10336
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on pull request #10336: Update redshift_to_s3_operator.py
Posted by GitBox <gi...@apache.org>.
potiuk commented on pull request #10336:
URL: https://github.com/apache/airflow/pull/10336#issuecomment-675403257
Hello @selvamshan -> I think that change is already quite stala and we are already moving away from making any fixes to 1.10 operators - instead - we'd rather implement them in master and release backport providers. I am planning to release the 2nd wave of backport providers this week after 1.10.12 gets released (#10014 ) - so if you would like to get that in, I'd love if you make a PR directly to master. I thin the change is rather small. Please ping me on github if you create one and I will fast-track review it if you would like to make it to the 2nd wave of backports.
The operator moved in Airflow 2.0 (and in backport packages) - and you can install it by installing `apache-airlow-backport-providers-amazon` package. The good thing is that if we release it with your change, you will still be able to use the current 1.10 version you are using with those new operators.
Shoudl we close this ticket?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org