You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/12/12 13:44:47 UTC
[GitHub] [airflow] blcksrx opened a new issue, #28305: AZCopy Hook and Operator
blcksrx opened a new issue, #28305:
URL: https://github.com/apache/airflow/issues/28305
### Description
AzCopy is a command-line tool that moves data into and out of Azure Storage. It's a really useful tool to transfer raw data files between data containers in azure and also data storages.
### Use case/motivation
It would be so much easy and convince for Airflow developers that airflow supports this tool as Operator and have this Operator as an example:
```python
op = ACopyTransferOperator(src="...", dest="...", ..)
```
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #28305: AZCopy Hook and Operator
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #28305:
URL: https://github.com/apache/airflow/issues/28305#issuecomment-1373924044
@blcksrx are you working on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] blcksrx closed issue #28305: AZCopy Hook and Operator
Posted by GitBox <gi...@apache.org>.
blcksrx closed issue #28305: AZCopy Hook and Operator
URL: https://github.com/apache/airflow/issues/28305
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] blcksrx commented on issue #28305: AZCopy Hook and Operator
Posted by GitBox <gi...@apache.org>.
blcksrx commented on issue #28305:
URL: https://github.com/apache/airflow/issues/28305#issuecomment-1374023360
@eladkal I will work on that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #28305: AZCopy Hook and Operator
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #28305:
URL: https://github.com/apache/airflow/issues/28305#issuecomment-1445886504
Have you tried Azure data factory "Copy Data Tool"? This would fit to your use case. Detailed documentation available here. [ADF Azure Documentation](https://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-copy-data-tool). So I think you should add a method in azure data factory hook instead of creating a new operator altogether. Thoughts?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org