You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/03/23 16:36:23 UTC

[GitHub] [airflow] rliuamzn opened a new issue #14962: Create EMR Notebook execution operators

rliuamzn opened a new issue #14962:
URL: https://github.com/apache/airflow/issues/14962


   **Description**
   
   Similar to [EMR Jobflow operator](https://github.com/apache/airflow/blob/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68/airflow/providers/amazon/aws/operators/emr_create_job_flow.py) and [EMR Jobflow sensor](https://github.com/apache/airflow/blob/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68/airflow/providers/amazon/aws/sensors/emr_job_flow.py), we should add operator and sensor that interact with [EMR Notebook execution](https://docs.amazonaws.cn/en_us/emr/latest/ManagementGuide/emr-managed-notebooks-headless-cli.html) and abstracts all amazon logic from the airflow user.
   
   
   **Use case / motivation**
   This will allow airflow users use operator and sensor built for EMR Notebook execution.
   
   
   **Are you willing to submit a PR?**
   Yes. We already have some [code](https://github.com/aws-samples/emr-studio-samples/blob/main/airflow_dag_for_execution/simple_dag.py#L32-L75) to start with.
   
   **Related Issues**
   Not tightly related, but we would like to follow the same standard/pattern with the [feature request for EKS operator](https://github.com/apache/airflow/issues/8544)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #14962: Create EMR Notebook execution operators

Posted by GitBox <gi...@apache.org>.

mik-laj commented on issue #14962:
URL: https://github.com/apache/airflow/issues/14962#issuecomment-805347336


   > Yes. We already have some code to start with.
   
   LGTM. Feel free to submit a PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #14962: Create EMR Notebook execution operators

Posted by GitBox <gi...@apache.org>.

boring-cyborg[bot] commented on issue #14962:
URL: https://github.com/apache/airflow/issues/14962#issuecomment-805051483


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org