You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dcoliversun (via GitHub)" <gi...@apache.org> on 2023/06/06 10:07:19 UTC

[GitHub] [airflow] dcoliversun opened a new issue, #31738: Add Alibaba Cloud AnalyticDB Spark support

dcoliversun opened a new issue, #31738:
URL: https://github.com/apache/airflow/issues/31738

   ### Description
   
   Alibaba Cloud AnalyticDB for MySQL Data Lakehouse Edition (V3.0) uses the same Spark development method for batch applications and SQL applications.[1]
   
   We want to provide operator/hook/sensor to enable Airflow users using AnalyticDB Spark.
   
   reference:
   [1] https://www.alibabacloud.com/help/en/analyticdb-for-mysql/latest/spark-offline-application-development
   
   ### Use case/motivation
   
   1. implement custom operator/hook/sensor for AnalyticDB Spark.
   2. enable users to schedule AnalyticDB Spark Batch/SQL applications by DAGs. Such as follow.
   3. AnalyticDB Spark hooks provides log/Web UI url/application status for users.
   
   ### Related issues
   
   None
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] boring-cyborg[bot] commented on issue #31738: Add Alibaba Cloud AnalyticDB Spark support

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #31738:
URL: https://github.com/apache/airflow/issues/31738#issuecomment-1578345016

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] eladkal closed issue #31738: Add Alibaba Cloud AnalyticDB Spark support

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #31738: Add Alibaba Cloud AnalyticDB Spark support
URL: https://github.com/apache/airflow/issues/31738


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org