You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/28 13:33:16 UTC

[GitHub] [airflow] kaxil opened a new issue #11912: Add how-to Guide for Azure operators

kaxil opened a new issue #11912:
URL: https://github.com/apache/airflow/issues/11912


   **Description**
   
   A guide that describes how to use all the operators for Azure (https://github.com/apache/airflow/tree/master/airflow/providers/microsoft/azure) would be useful.
   
   Other guides are available:
   https://airflow.readthedocs.io/en/latest/howto/operator/index.html
   
   Are you wondering how to start contributing to this project? Start by reading our [contributor guide](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst)
   
   Best regards,
   Kaxil
   
   
   **Related Issues**
   
   Missing guides for operators in Microsoft provider:
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-895359502


   I am still working on this, its just been a hectic few weeks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] kaxil commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-958341671


   Sure, can you create a PR for it


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140


   Missing Doc List
   
   **Provider_file,Example,Doc,Doc-Action**
   
   adls_delete.py,1,1,rename doc
   adls_list.py,0,0
   adx.py,0,0
   azure_batch.py,0,0
   azure_container_instances.py,1,0
   azure_cosmos.py,1,0,
   wasb_delete_blob.py,0,0,
   transfers/azure_blob_to_gcs.py,0,1
   transfers/file_to_wasb.py,1,0
   transfers/local_to_adls.py,1,1
   transfers/oracle_to_azure_data_lake.py,0,0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-952675860


   @kaxil can I take exampes from Azure Docs, and use them in the example_xx_dag.py ? For example for `example_batch_job.py` (currently missing). I can use the documentation example here - https://docs.microsoft.com/en-us/azure/batch/quick-run-python
   
   and run the example with Airflow. I won't be adding any modules to airflow repo. I will just take existing microsoft examples and run them within a DAG.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] eladkal commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-1030912982


   Both tasks listed on the description are resolved so i'm closing this issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883675512


   @potiuk Curious why was below PR done? 
   https://github.com/apache/airflow/pull/15651


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140


   Missing Doc List
   
   **Provider_file,Example,Doc,Doc-Action**
   
   adls_delete.py,1,1,rename doc
   adls_list.py,0,0
   adx.py,0,0
   azure_batch.py,0,0
   azure_container_instances.py,1,0
   azure_cosmos.py,1,0,
   wasb_delete_blob.py,0,0,
   transfers/file_to_wasb.py,1,0
   transfers/oracle_to_azure_data_lake.py,0,0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883675512


   Curious why was this PR done? 
   https://github.com/apache/airflow/pull/15651


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-879604232


   Assigned you :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140


   Missing Doc List
   
   **Provider_file,Example,Doc,Doc-Action**
   
   adls_delete.py,1,1,rename doc
   adls_list.py,0,0
   adx.py,0,0
   azure_batch.py,0,0
   azure_container_instances.py,1,0
   azure_cosmos.py,1,0,
   wasb_delete_blob.py,0,0,
   transfers/file_to_wasb.py,1,0
   transfers/local_to_adls.py,1,1
   transfers/oracle_to_azure_data_lake.py,0,0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883675512


   Curious why was this PR done? 
   https://github.com/apache/airflow/pull/15651/files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] kaxil commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-958341671


   Sure, can you create a PR for it


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-879369497


   I volunteer -- I can do it in a similar way to the aws one I did (pending approval) https://github.com/apache/airflow/pull/16964


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] eladkal closed issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
eladkal closed issue #11912:
URL: https://github.com/apache/airflow/issues/11912


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140


   Missing Doc List
   
   **Provider_file,Example,Doc,Doc-Action**
   
   adls_delete.py,1,1,rename doc
   adls_list.py,0,0
   adx.py,0,0
   azure_batch.py,0,0
   azure_container_instances.py,1,0
   azure_cosmos.py,1,0,
   wasb_delete_blob.py,0,0,
   transfers/file_to_wasb.py,1,0
   transfers/azure_blob_to_gcs.py,1,1 rename page title
   transfers/oracle_to_azure_data_lake.py,0,0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz commented on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-952675860


   @kaxil can I take exampes from Azure Docs, and use them in the example_xx_dag.py ? For example for `example_batch_job.py` (currently missing). I can use the documentation example here - https://docs.microsoft.com/en-us/azure/batch/quick-run-python
   
   and run the example with Airflow. 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

Posted by GitBox <gi...@apache.org>.
pyerbiz edited a comment on issue #11912:
URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140


   Missing Doc List
   
   **Provider_file,Example,Doc,Doc-Action**
   
   adls_delete.py,1,1,rename doc
   adls_list.py,0,0,put in adls.rst
   adx.py,0,0
   azure_batch.py,0,0
   azure_container_instances.py,1,0
   azure_cosmos.py,1,0,
   wasb_delete_blob.py,0,0,
   transfers/file_to_wasb.py,1,0
   transfers/azure_blob_to_gcs.py,1,1 rename page title
   transfers/oracle_to_azure_data_lake.py,0,0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org