You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/06/09 17:32:16 UTC

[GitHub] [airflow] Brooke-white opened a new issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

Brooke-white opened a new issue #16355:
URL: https://github.com/apache/airflow/issues/16355


   **Description**
   
   We should provide support for users to authenticate with Amazon Redshift via IAM or Identity Provider (e.g. Ping, Okta) and execute statements.
   
   [redshift_connector](https://github.com/aws/amazon-redshift-python-driver), the official DB-API Python driver for Amazon Redshift, supports authenticating via IAM or Identity Provider as well as statement execution.
   
   To satisfy this proposal, the following tasks must be completed
   
   - Development of a Hook, proposed name `RedshiftStatementHook`, which depends on redshift_connector  and a sqlalchemy dialect
   - Development of an Operator, proposed name `RedshiftOperator`, which allows users to execute SQL code against Amazon Redshift
   
   **Use case / motivation**
   
   Many users need to access Amazon Redshift using temporary credentials or through an Identity Provider. These is an opportunity to improve the workflow experience for these users, by streamlining the authentication process.
   
   Currently users need to use the `PostgresOperator` to execute queries against their Amazon Redshift cluster. This is not ideal as the `PostgresHook` uses `psycopg2` which afaik does not support using IAM authentication or 3rd party Identity Providers.
   
   There is an existing Hook, `RedshiftHook`, built using boto3, but it does not support statement execution.
   
   
   **Are you willing to submit a PR?**
   
   Yes
   
   **Related Issues**
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #16355:
URL: https://github.com/apache/airflow/issues/16355#issuecomment-860242704


   Would you be working on it @Brooke-white ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #16355:
URL: https://github.com/apache/airflow/issues/16355


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] Brooke-white commented on issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

Posted by GitBox <gi...@apache.org>.
Brooke-white commented on issue #16355:
URL: https://github.com/apache/airflow/issues/16355#issuecomment-861710246


   @potiuk Yes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #16355:
URL: https://github.com/apache/airflow/issues/16355#issuecomment-857893806


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org