You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jjavieralonso (via GitHub)" <gi...@apache.org> on 2025/01/21 17:12:07 UTC

[I] Enhance DataFusion Integration with Asynchronous and Deferrable Support [airflow]

jjavieralonso opened a new issue, #45850:
URL: https://github.com/apache/airflow/issues/45850

   ### Description
   
   This feature enhances the DataFusion integration in Apache Airflow by adding asynchronous and deferrable support to DataFusion operators and hooks. Additionally, it introduces new DataFusion links and improves error handling.
   
   ### Use case/motivation
   
   The addition of asynchronous and deferrable support allows users to run DataFusion pipelines more efficiently by leveraging non-blocking I/O operations. This is particularly useful for long-running pipelines, reducing the need for active waiting and improving resource utilization. The new DataFusion links provide easier navigation to specific DataFusion resources within the Google Cloud Console.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Enhance DataFusion Integration with Asynchronous and Deferrable Support [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #45850: Enhance DataFusion Integration with Asynchronous and Deferrable Support
URL: https://github.com/apache/airflow/issues/45850


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Enhance DataFusion Integration with Asynchronous and Deferrable Support [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #45850:
URL: https://github.com/apache/airflow/issues/45850#issuecomment-2605836361

   Sure if you want to submit it - feel free. Other than that it's just a (reasonable) wish that might be implemented if someone wants to tackle it. Marking as good first issue 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Enhance DataFusion Integration with Asynchronous and Deferrable Support [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #45850:
URL: https://github.com/apache/airflow/issues/45850#issuecomment-2606514366

   This looks like AI-generated. useless issue report that brings no value and makes no sense. We are generally blocking users that sends a lot of spam AI reports generated by bots.. as of yesterday so we will report your account and block it unless:
   
   a) you explain how you generated reports
   b) prove you are human
   c) explain why you created the issue
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org