You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AndyN5 (via GitHub)" <gi...@apache.org> on 2025/01/24 17:23:30 UTC

[I] Introduce a new operator, `ADLSCreateObjectOperator`, to Apache Airflow to simplify the process of writing data to Azure Data Lake Storage (ADLS) from workflows. [airflow]

AndyN5 opened a new issue, #46019:
URL: https://github.com/apache/airflow/issues/46019

   ### Description
   
   
   
   ## Problem
   Currently, users need to rely on custom Python code and the `AzureDataLakeStorageV2Hook` to interact with ADLS. This approach can be cumbersome for users who are not familiar with the hook or Python programming.
   
   
   ## Proposed Solution
   Add a new operator, `ADLSCreateObjectOperator`, that directly integrates with ADLS to create objects from within Airflow workflows. This operator should:
   - Accept input data or file paths.
   - Provide configurations for container name, directory path, and file name.
   - Use the existing `AzureDataLakeStorageV2Hook` to handle the underlying connection and file upload.
   
   ## Benefits
   - Simplifies the process for users to create objects in ADLS.
   
   
   
   ### Use case/motivation
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Introduce a new operator, `ADLSCreateObjectOperator`, to Apache Airflow to simplify the process of writing data to Azure Data Lake Storage (ADLS) from workflows. [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #46019:
URL: https://github.com/apache/airflow/issues/46019#issuecomment-2613812339

   Ai spam


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Introduce a new operator, `ADLSCreateObjectOperator`, to Apache Airflow to simplify the process of writing data to Azure Data Lake Storage (ADLS) from workflows. [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #46019: Introduce a new operator, `ADLSCreateObjectOperator`, to Apache Airflow to simplify the process of writing data to Azure Data Lake Storage (ADLS) from workflows.
URL: https://github.com/apache/airflow/issues/46019


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org