You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Airflow Newsletter <mi...@astronomer.io.INVALID> on 2023/05/01 16:22:39 UTC
Apache Airflow Newsletter | April 2023
The latest and greatest happenings in the Airflow Community, including the release of Airflow 2.6.0 and more.
View this email in your browser (https://mailchi.mp/51f45a3b8999/apache-airflow-newsletter-april-9564405?e=9963ef1d25)
April was another action-packed month in the Airflow Community, which is now 2400+ contributors strong!
* We released Airflow 2.6.0 and Helm chart 1.9.0.
* We released over 30 new or improved providers.
* We held events in Paris, Tel Aviv, Chicago, New York . . . (the list goes on).
* We surpassed 30K stars on GitHub!
* We welcomed new committer Hussein Awala (@hussein-awala (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ad62efdc73&e=9963ef1d25) ) to the PMC. Congratulations, Hussein!
As always, check the Airflow Meetups (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7077d69154&e=9963ef1d25) page to find your local community, and please reach out with items for the next issue.
Thanks for reading!
Register (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fc9471f313&e=9963ef1d25) today for updates on Airflow Summit 2023!
Airflow
On May 1, we released Airflow 2.6.0, featuring Notifiers, a new object in Airflow designed to be an extensible layer to add notifications to DAGs. Users can build notification logic from a new base object and call it directly from their DAG files. Additional significant changes include consolidated handling of tasks stuck in queued, removal of `scheduler.tasks.running`, definition of the `cleanup()` method in BaseTrigger as asynchronous, and change of default permissions of file task handler log directories and files to “owner + group” writeable. Also included: many more changes, new features, improvements, bug fixes and internal changes.
* PyPI (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=46813c56bd&e=9963ef1d25) | Release Notes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4671ecd7bb&e=9963ef1d25) | Docs (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cf309ce80d&e=9963ef1d25) | Sources (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=624158acef&e=9963ef1d25) | Docker (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bbc989ba10&e=9963ef1d25)
On April 1, we released Airflow 2.5.3, featuring no significant changes but many bug fixes.
* PyPI (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ea5345fb35&e=9963ef1d25) | Release Notes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=030bc09b73&e=9963ef1d25) | Docs (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f70a9286f1&e=9963ef1d25) | Sources (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=57031c13b4&e=9963ef1d25) | Docker (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f4e7286bd6&e=9963ef1d25)
On April 14, we released Helm chart 1.9.0, including updates to Default PgBouncer and PgBouncer Exporter and an updated Airflow image (2.5.3, formerly 2.5.1), plus new features and bug fixes.
* ArtifactHub (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=91de52ca08&e=9963ef1d25) | Release Notes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c74a6e5f88&e=9963ef1d25) | Docs (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8319f58b2a&e=9963ef1d25) | Sources (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=994ca43c99&e=9963ef1d25)
Ecosystem
In the ecosystem, Astronomer published three Providers releases and a Databricks Provider, and OpenLineage released version 0.23.0 of its Airflow integration:
* Astronomer Providers 1.15.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cfe10c34c1&e=9963ef1d25) (bug fixes)
* Astronomer Providers 1.15.4 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6348808c4c&e=9963ef1d25) (bug fixes)
* Astronomer Providers 1.15.3 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6886ff4386&e=9963ef1d25) (bug fixes)
* Astro Databricks Provider 0.1.2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7f81bdec4f&e=9963ef1d25) (enhancements)
* OpenLineage Airflow Integration 0.23.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=92bccb0192&e=9963ef1d25) (additions, one change, bug fixes)
Providers
We released 4 providers:
* Apache Kafka Provider initial release (1.0.0) (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cb25a526a8&e=9963ef1d25)
* MLflow Provider initial release (1.0.1) (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=669335fad1&e=9963ef1d25)
* Zeppelin Provider initial release (0.0.1) (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b30e23dcc1&e=9963ef1d25)
* Fivetran Async Provider initial release (1.0.0) (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=028213131a&e=9963ef1d25)
We released new versions of 34+ providers:
* Cloudera Airflow Provider 2.1.2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1b398f33a4&e=9963ef1d25)
* Datarobot Airflow Provider 0.0.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=241f4ab35c&e=9963ef1d25)
* Vineyard Provider 0.14.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=be59cfe5aa&e=9963ef1d25)
* Apache Drill Provider 2.3.2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f50888a4e5&e=9963ef1d25)
* Apache Livy Provider 3.4.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=41cfc56196&e=9963ef1d25)
* Apache Hive Provider 6.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a7df82c6d7&e=9963ef1d25)
* Apache HDFS Provider 3.2.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a20f7d0c61&e=9963ef1d25)
* Apache Beam Provider 5.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=085b7316b5&e=9963ef1d25)
* MySQL Provider 5.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3703dfa92c&e=9963ef1d25)
* Datadog Provider 3.2.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=553732b618&e=9963ef1d25)
* dbt Cloud Provider 3.2.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ba9ef25abe&e=9963ef1d25)
* dbt Python Provider 1.0.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fbd0cd7fd3&e=9963ef1d25)
* Presto Provider 5.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f99492d646&e=9963ef1d25)
* Trino Provider 5.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=288721dad8&e=9963ef1d25)
* Jenkins Provider 3.2.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b63eb83470&e=9963ef1d25)
* Hashicorp Provider 3.3.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4bd59d6928&e=9963ef1d25)
* SQLLite Provider 3.3.2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2528cb9e58&e=9963ef1d25)
* ClickHouse Provider 0.2.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=26a74338b5&e=9963ef1d25)
* Alibaba Provider 2.3.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=38b3024391&e=9963ef1d25)
* Google Provider 10.0.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f2689bac51&e=9963ef1d25)
* Databricks Provider 4.1.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=069eb5501a&e=9963ef1d25)
* Snowflake Provider 4.0.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dee4f203fb&e=9963ef1d25)
* Docker Provider 3.6.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f7bc505b54&e=9963ef1d25)
* SSH Provider 3.6.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=309ed35a61&e=9963ef1d25)
* HTTP Provider 4.3.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ae0848912f&e=9963ef1d25)
* SMTP Provider 1.0.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=952e6d0a31&e=9963ef1d25)
* Amazon Provider 7.4.1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8f78eebdcb&e=9963ef1d25)
* May 2: Simplified DAG Authoring with the Astro SKD (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4ce7655225&e=9963ef1d25) , Webinar
* May 9: What’s New in Airflow Airflow 2.6 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4272de25c9&e=9963ef1d25) , Webinar
* May 9: Meetup Airflow Paris @ Algolia (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=405f4daa5f&e=9963ef1d25) , Paris Event
* May 20 (tentatively): Apache Airflow Bangalore Meetup 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b4959582cd&e=9963ef1d25) , Bangalore Event
* May 25: Airflow Meetup @ XPertise (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=59ef43fa75&e=9963ef1d25) , London Event
* June 1: PyData DC (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5caccd6110&e=9963ef1d25) , Virtual Meetup
* September 19-21: Airflow Summit (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8ebb511e35&e=9963ef1d25) , Toronto Conference
* April 27: The April Chicago Apache Airflow Meetup @ Spothero (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=15dc157b00&e=9963ef1d25) , Chicago Event
* April 27: NYC MLOps Community April Meetup @ Arthur (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=07baa198e3&e=9963ef1d25) , NYC Event
* April 25: The Easiest Way to Orchestrate Your dbt Workflows from Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=59a9f4c02e&e=9963ef1d25) , Webinar
* April 25: DC Apache Airflow Meetup @ Slalom (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d35572896f&e=9963ef1d25) , Washington, DC, Event
* April 24: NYC Apache Airflow Meetup @ Etsy (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=43974d2caa&e=9963ef1d25) , NYC Event
* April 23: TLV Apache Airflow Meetup, Spring '23 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0ed481fb2d&e=9963ef1d25) , Tel Aviv Event
* April 19-27: Pycon US (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1b5d3a2ffb&e=9963ef1d25) , Salt Lake City Conference
* April 18: How to Use DuckDB with Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dd47aeb287&e=9963ef1d25) , Webinar
* April 11: How to Pass Data between Your Airflow Tasks (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=faa4d2bb26&e=9963ef1d25) , Webinar
* April 4: How to Test and Debug Your Airflow Connections (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2a113204ef&e=9963ef1d25) , Webinar
* April 4: Paris Apache Airflow Meetup (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=34c4c68ec1&e=9963ef1d25) , Paris Event
This month we had a three-way tie! Congratulations to the winners:
@potiuk (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1e96e97219&e=9963ef1d25)
#30705 | Optimize parallel test execution for unit tests (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d63b4fd858&e=9963ef1d25)
Improves the CPU utilization of our multi-CPU runners and makes the tests involving the complete Provider set execute quite a few minutes faster on average.
@dylanbstorey (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aa68456b26&e=9963ef1d25)
#30175 | Add provider for Apache Kafka (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fcb27b8234&e=9963ef1d25)
Pulls in a series of integrations to Kafka from `airflow-provider-kafka` to core Airflow.
@RNHTTR (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=39f58eb314&e=9963ef1d25)
#30375 | Simplify logic to resolve tasks stuck in queued despite stalled_task_timeout (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=54e6758de3&e=9963ef1d25)
Moves the logic for handling stalled tasks to the scheduler and simplifies the logic by marking any task that has been queued for more than `scheduler.task_ququed_timeout` as failed, allowing it to be retried if the task has available retries.
* Task Group of Apache Airflow in 5 Minutes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dfb6e932c8&e=9963ef1d25) , Akshay Thakare, Medium
* A Spotify Wrapped Project with Apache Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6b477bffb7&e=9963ef1d25) , Kevin Kamau, LinkedIn
* How to Best Use DuckDB with Apache Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cb47b00ada&e=9963ef1d25) , Jeff Fletcher, Medium
* Unsticking Airflow: Stuck Queued Tasks are No More in 2.6.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=713fd83fd1&e=9963ef1d25) , Ryan Hatter, Medium
* 8 Things I Wish I Knew about Airflow Before I Started Orchestrating Machine Learning Workflows (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=92a50955fb&e=9963ef1d25) , Jeff Fletcher, Medium
* ChatGPTOperator for Airflow: The Operator that Wrote Itself (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=df04af4130&e=9963ef1d25) , Cody Rich, Medium
* Orchestrate dbt Core Jobs with the Astro dbt Provider (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e017b2ad4b&e=9963ef1d25) , Astronomer docs
* Kubernetes Executor Support in Astro: A New Era of Scalability and Resource Management (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9bfae3c3b6&e=9963ef1d25) , Constance Martineau, Astronomer blog
* Votes:
+ Release Airflow 2.6.0 from 2.6.0rc5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8bdd4e3d33&e=9963ef1d25)
+ Release Airflow 2.6.0 from 2.6.0rc4 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e78947f41a&e=9963ef1d25)
+ Release Airflow 2.6.0 from 2.6.0rc3 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dd8eaf376c&e=9963ef1d25)
+ Release Airflow 2.6.0 from 2.6.0rc2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f0a8baf579&e=9963ef1d25)
+ Airflow Providers prepared on April 26, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=464cf1e488&e=9963ef1d25)
+ April 2023 PR of the Month (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d585ee8ab2&e=9963ef1d25)
+ Airflow Providers prepared on April 25, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d17602461d&e=9963ef1d25)
+ Release Airflow 2.6.0 from 2.6.0rc1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=995b8d1097&e=9963ef1d25)
+ Airflow Providers prepared on April 21, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1ba10e085a&e=9963ef1d25)
+ Release Apache Airflow Helm Chart 1.9.0 based on 1.9.0rc1 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2f387d3877&e=9963ef1d25)
+ Airflow Providers prepared on April 12, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=539251737f&e=9963ef1d25)
+ Airflow Providers prepared on April 9, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=91d7eb81ca&e=9963ef1d25)
+ Airflow Providers prepared on April 2, 2023 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9653aaa737&e=9963ef1d25)
+ March PR of the Month (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=debbbb9913&e=9963ef1d25)
+ Release Airflow 2.5.3 from 2.5.3rc2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=794209ee92&e=9963ef1d25)
* Discussed:
+ Preparing for dropping Python 3.7 support (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=23a4531028&e=9963ef1d25)
+ AIP-56 Extensible user management (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=960aa4d989&e=9963ef1d25)
+ New Provider - Huawei Cloud (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a6f1bb71bc&e=9963ef1d25)
+ Describing (new) provider approval policies (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0c3b8d38b4&e=9963ef1d25)
+ 2400+ contributors and counting (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2d3a92eabc&e=9963ef1d25)
+ Faster dag parsing by pre-importing airflow modules (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=65c313cd99&e=9963ef1d25)
+ A cache for Airflow Variables (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=11299db39b&e=9963ef1d25)
+ Request for feedback on proposal for new OpenLineage provider in Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ed32045ffd&e=9963ef1d25)
+ AIP-55 Rule-based timetable with logical composition (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=239ff5f75d&e=9963ef1d25)
+ Exclude some providers that hold us back from releasing (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8515315573&e=9963ef1d25)
* Lazy Consensus
+ Suspend Yandex provider due to Protobuf4 limitation (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eb89cba19a&e=9963ef1d25)
+ Accept Kafka provider (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b2a7a33212&e=9963ef1d25)
+ Introduce suspension process for providers due to dependencies holding us back (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bbf84752c9&e=9963ef1d25)
* Announced:
+ Get ready for Airflow Summit (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=65c004314f&e=9963ef1d25)
+ 30k stars on GitHub (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4e1de4eb28&e=9963ef1d25)
+ Apache Airflow 2.6.0 released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f0156ec8f2&e=9963ef1d25)
+ Airflow Providers prepared on April 26, 2023 are released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=76cf6916de&e=9963ef1d25)
+ Airflow Providers prepared on April 21, 2023 are released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4482d3de87&e=9963ef1d25)
+ New committer Hussein Awala (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=60e9c6d9e2&e=9963ef1d25)
+ Apache Airflow 2.6.0rb1 available for testing (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=66181b3e16&e=9963ef1d25)
+ Apache Airflow Helm Chart version 1.9.0 Released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8c1f0711bb&e=9963ef1d25)
+ Airflow Providers prepared on April 12, 2023 are released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=99a4187a69&e=9963ef1d25)
+ Airflow Providers prepared on April 2, 2023 are ready (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eefc2844fc&e=9963ef1d25)
+ Apache Airflow 2.5.3 Released (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7a4f8eb3ff&e=9963ef1d25)
* Proposed:
+ Archiving some old repos (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3e667124a8&e=9963ef1d25)
* AIP-52: Automatic setup and teardown of tasks (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=43ebdebb30&e=9963ef1d25)
* AIP-53: OpenLineage in Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3a3fffc10f&e=9963ef1d25)
* AIP-50: Trigger DAG UI Extension with Flexible User Form Concept (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d35d3d43c7&e=9963ef1d25)
* AIP-26: Production-ready Airflow Docker Image (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8db532d9d7&e=9963ef1d25)
* See the Wiki (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a6cab45bec&e=9963ef1d25) for more of the project’s approved AIPs.
Please subscribe to this newsletter to ensure you always receive the latest issue: https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=36703acd13&e=9963ef1d25.
Know of an upcoming event or publication the community should know about? Let us know at viraj@astronomer.io (mailto:viraj@astronomer.io) or michael.robinson@astronomer.io (mailto:michael.robinson@astronomer.io) .
============================================================
Want to change how you receive these emails?
You can ** update your preferences (https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=53ec9ba965)
or ** unsubscribe from this list (https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=53ec9ba965)
.
Re: Apache Airflow Newsletter | April 2023
Posted by Kaxil Naik <ka...@gmail.com>.
30k 🌟✨⭐️
On Mon, 1 May 2023 at 18:06, Airflow Newsletter
<mi...@astronomer.io.invalid> wrote:
> The latest and greatest happenings in the Airflow Community, including the
> release of Airflow 2.6.0 and more.
>
> View this email in your browser (
> https://mailchi.mp/51f45a3b8999/apache-airflow-newsletter-april-9564405?e=9963ef1d25
> )
>
> April was another action-packed month in the Airflow Community, which is
> now 2400+ contributors strong!
> * We released Airflow 2.6.0 and Helm chart 1.9.0.
> * We released over 30 new or improved providers.
> * We held events in Paris, Tel Aviv, Chicago, New York . . . (the list
> goes on).
> * We surpassed 30K stars on GitHub!
> * We welcomed new committer Hussein Awala (@hussein-awala (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ad62efdc73&e=9963ef1d25)
> ) to the PMC. Congratulations, Hussein!
>
> As always, check the Airflow Meetups (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7077d69154&e=9963ef1d25)
> page to find your local community, and please reach out with items for the
> next issue.
>
> Thanks for reading!
> Register (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fc9471f313&e=9963ef1d25)
> today for updates on Airflow Summit 2023!
>
> Airflow
>
> On May 1, we released Airflow 2.6.0, featuring Notifiers, a new object in
> Airflow designed to be an extensible layer to add notifications to DAGs.
> Users can build notification logic from a new base object and call it
> directly from their DAG files. Additional significant changes include
> consolidated handling of tasks stuck in queued, removal of
> `scheduler.tasks.running`, definition of the `cleanup()` method in
> BaseTrigger as asynchronous, and change of default permissions of file task
> handler log directories and files to “owner + group” writeable. Also
> included: many more changes, new features, improvements, bug fixes and
> internal changes.
> * PyPI (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=46813c56bd&e=9963ef1d25)
> | Release Notes (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4671ecd7bb&e=9963ef1d25)
> | Docs (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cf309ce80d&e=9963ef1d25)
> | Sources (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=624158acef&e=9963ef1d25)
> | Docker (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bbc989ba10&e=9963ef1d25
> )
>
> On April 1, we released Airflow 2.5.3, featuring no significant changes
> but many bug fixes.
> * PyPI (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ea5345fb35&e=9963ef1d25)
> | Release Notes (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=030bc09b73&e=9963ef1d25)
> | Docs (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f70a9286f1&e=9963ef1d25)
> | Sources (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=57031c13b4&e=9963ef1d25)
> | Docker (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f4e7286bd6&e=9963ef1d25
> )
>
> On April 14, we released Helm chart 1.9.0, including updates to Default
> PgBouncer and PgBouncer Exporter and an updated Airflow image (2.5.3,
> formerly 2.5.1), plus new features and bug fixes.
> * ArtifactHub (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=91de52ca08&e=9963ef1d25)
> | Release Notes (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c74a6e5f88&e=9963ef1d25)
> | Docs (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8319f58b2a&e=9963ef1d25)
> | Sources (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=994ca43c99&e=9963ef1d25
> )
>
> Ecosystem
>
> In the ecosystem, Astronomer published three Providers releases and a
> Databricks Provider, and OpenLineage released version 0.23.0 of its Airflow
> integration:
> * Astronomer Providers 1.15.5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cfe10c34c1&e=9963ef1d25)
> (bug fixes)
> * Astronomer Providers 1.15.4 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6348808c4c&e=9963ef1d25)
> (bug fixes)
> * Astronomer Providers 1.15.3 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6886ff4386&e=9963ef1d25)
> (bug fixes)
> * Astro Databricks Provider 0.1.2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7f81bdec4f&e=9963ef1d25)
> (enhancements)
> * OpenLineage Airflow Integration 0.23.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=92bccb0192&e=9963ef1d25)
> (additions, one change, bug fixes)
>
> Providers
>
> We released 4 providers:
> * Apache Kafka Provider initial release (1.0.0) (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cb25a526a8&e=9963ef1d25
> )
> * MLflow Provider initial release (1.0.1) (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=669335fad1&e=9963ef1d25
> )
> * Zeppelin Provider initial release (0.0.1) (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b30e23dcc1&e=9963ef1d25
> )
> * Fivetran Async Provider initial release (1.0.0) (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=028213131a&e=9963ef1d25
> )
>
> We released new versions of 34+ providers:
> * Cloudera Airflow Provider 2.1.2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1b398f33a4&e=9963ef1d25
> )
> * Datarobot Airflow Provider 0.0.5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=241f4ab35c&e=9963ef1d25
> )
> * Vineyard Provider 0.14.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=be59cfe5aa&e=9963ef1d25
> )
> * Apache Drill Provider 2.3.2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f50888a4e5&e=9963ef1d25
> )
> * Apache Livy Provider 3.4.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=41cfc56196&e=9963ef1d25
> )
> * Apache Hive Provider 6.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a7df82c6d7&e=9963ef1d25
> )
> * Apache HDFS Provider 3.2.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a20f7d0c61&e=9963ef1d25
> )
> * Apache Beam Provider 5.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=085b7316b5&e=9963ef1d25
> )
> * MySQL Provider 5.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3703dfa92c&e=9963ef1d25
> )
> * Datadog Provider 3.2.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=553732b618&e=9963ef1d25
> )
> * dbt Cloud Provider 3.2.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ba9ef25abe&e=9963ef1d25
> )
> * dbt Python Provider 1.0.5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fbd0cd7fd3&e=9963ef1d25
> )
> * Presto Provider 5.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f99492d646&e=9963ef1d25
> )
> * Trino Provider 5.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=288721dad8&e=9963ef1d25
> )
> * Jenkins Provider 3.2.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b63eb83470&e=9963ef1d25
> )
> * Hashicorp Provider 3.3.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4bd59d6928&e=9963ef1d25
> )
> * SQLLite Provider 3.3.2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2528cb9e58&e=9963ef1d25
> )
> * ClickHouse Provider 0.2.5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=26a74338b5&e=9963ef1d25
> )
> * Alibaba Provider 2.3.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=38b3024391&e=9963ef1d25
> )
> * Google Provider 10.0.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f2689bac51&e=9963ef1d25
> )
> * Databricks Provider 4.1.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=069eb5501a&e=9963ef1d25
> )
> * Snowflake Provider 4.0.5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dee4f203fb&e=9963ef1d25
> )
> * Docker Provider 3.6.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f7bc505b54&e=9963ef1d25
> )
> * SSH Provider 3.6.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=309ed35a61&e=9963ef1d25
> )
> * HTTP Provider 4.3.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ae0848912f&e=9963ef1d25
> )
> * SMTP Provider 1.0.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=952e6d0a31&e=9963ef1d25
> )
> * Amazon Provider 7.4.1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8f78eebdcb&e=9963ef1d25
> )
>
> * May 2: Simplified DAG Authoring with the Astro SKD (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4ce7655225&e=9963ef1d25)
> , Webinar
> * May 9: What’s New in Airflow Airflow 2.6 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4272de25c9&e=9963ef1d25)
> , Webinar
> * May 9: Meetup Airflow Paris @ Algolia (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=405f4daa5f&e=9963ef1d25)
> , Paris Event
> * May 20 (tentatively): Apache Airflow Bangalore Meetup 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b4959582cd&e=9963ef1d25)
> , Bangalore Event
> * May 25: Airflow Meetup @ XPertise (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=59ef43fa75&e=9963ef1d25)
> , London Event
> * June 1: PyData DC (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5caccd6110&e=9963ef1d25)
> , Virtual Meetup
> * September 19-21: Airflow Summit (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8ebb511e35&e=9963ef1d25)
> , Toronto Conference
>
> * April 27: The April Chicago Apache Airflow Meetup @ Spothero (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=15dc157b00&e=9963ef1d25)
> , Chicago Event
> * April 27: NYC MLOps Community April Meetup @ Arthur (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=07baa198e3&e=9963ef1d25)
> , NYC Event
> * April 25: The Easiest Way to Orchestrate Your dbt Workflows from Airflow
> (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=59a9f4c02e&e=9963ef1d25)
> , Webinar
> * April 25: DC Apache Airflow Meetup @ Slalom (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d35572896f&e=9963ef1d25)
> , Washington, DC, Event
> * April 24: NYC Apache Airflow Meetup @ Etsy (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=43974d2caa&e=9963ef1d25)
> , NYC Event
> * April 23: TLV Apache Airflow Meetup, Spring '23 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0ed481fb2d&e=9963ef1d25)
> , Tel Aviv Event
> * April 19-27: Pycon US (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1b5d3a2ffb&e=9963ef1d25)
> , Salt Lake City Conference
> * April 18: How to Use DuckDB with Airflow (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dd47aeb287&e=9963ef1d25)
> , Webinar
> * April 11: How to Pass Data between Your Airflow Tasks (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=faa4d2bb26&e=9963ef1d25)
> , Webinar
> * April 4: How to Test and Debug Your Airflow Connections (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2a113204ef&e=9963ef1d25)
> , Webinar
> * April 4: Paris Apache Airflow Meetup (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=34c4c68ec1&e=9963ef1d25)
> , Paris Event
>
> This month we had a three-way tie! Congratulations to the winners:
>
> @potiuk (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1e96e97219&e=9963ef1d25
> )
> #30705 | Optimize parallel test execution for unit tests (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d63b4fd858&e=9963ef1d25
> )
>
> Improves the CPU utilization of our multi-CPU runners and makes the tests
> involving the complete Provider set execute quite a few minutes faster on
> average.
>
> @dylanbstorey (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aa68456b26&e=9963ef1d25
> )
> #30175 | Add provider for Apache Kafka (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fcb27b8234&e=9963ef1d25
> )
>
> Pulls in a series of integrations to Kafka from `airflow-provider-kafka`
> to core Airflow.
>
> @RNHTTR (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=39f58eb314&e=9963ef1d25
> )
> #30375 | Simplify logic to resolve tasks stuck in queued despite
> stalled_task_timeout (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=54e6758de3&e=9963ef1d25
> )
>
> Moves the logic for handling stalled tasks to the scheduler and simplifies
> the logic by marking any task that has been queued for more than
> `scheduler.task_ququed_timeout` as failed, allowing it to be retried if the
> task has available retries.
> * Task Group of Apache Airflow in 5 Minutes (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dfb6e932c8&e=9963ef1d25)
> , Akshay Thakare, Medium
> * A Spotify Wrapped Project with Apache Airflow (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6b477bffb7&e=9963ef1d25)
> , Kevin Kamau, LinkedIn
> * How to Best Use DuckDB with Apache Airflow (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cb47b00ada&e=9963ef1d25)
> , Jeff Fletcher, Medium
> * Unsticking Airflow: Stuck Queued Tasks are No More in 2.6.0 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=713fd83fd1&e=9963ef1d25)
> , Ryan Hatter, Medium
> * 8 Things I Wish I Knew about Airflow Before I Started Orchestrating
> Machine Learning Workflows (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=92a50955fb&e=9963ef1d25)
> , Jeff Fletcher, Medium
> * ChatGPTOperator for Airflow: The Operator that Wrote Itself (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=df04af4130&e=9963ef1d25)
> , Cody Rich, Medium
> * Orchestrate dbt Core Jobs with the Astro dbt Provider (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e017b2ad4b&e=9963ef1d25)
> , Astronomer docs
> * Kubernetes Executor Support in Astro: A New Era of Scalability and
> Resource Management (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9bfae3c3b6&e=9963ef1d25)
> , Constance Martineau, Astronomer blog
>
> * Votes:
> + Release Airflow 2.6.0 from 2.6.0rc5 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8bdd4e3d33&e=9963ef1d25
> )
> + Release Airflow 2.6.0 from 2.6.0rc4 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e78947f41a&e=9963ef1d25
> )
> + Release Airflow 2.6.0 from 2.6.0rc3 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dd8eaf376c&e=9963ef1d25
> )
> + Release Airflow 2.6.0 from 2.6.0rc2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f0a8baf579&e=9963ef1d25
> )
> + Airflow Providers prepared on April 26, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=464cf1e488&e=9963ef1d25
> )
> + April 2023 PR of the Month (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d585ee8ab2&e=9963ef1d25
> )
> + Airflow Providers prepared on April 25, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d17602461d&e=9963ef1d25
> )
> + Release Airflow 2.6.0 from 2.6.0rc1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=995b8d1097&e=9963ef1d25
> )
> + Airflow Providers prepared on April 21, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1ba10e085a&e=9963ef1d25
> )
> + Release Apache Airflow Helm Chart 1.9.0 based on 1.9.0rc1 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2f387d3877&e=9963ef1d25
> )
> + Airflow Providers prepared on April 12, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=539251737f&e=9963ef1d25
> )
> + Airflow Providers prepared on April 9, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=91d7eb81ca&e=9963ef1d25
> )
> + Airflow Providers prepared on April 2, 2023 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9653aaa737&e=9963ef1d25
> )
> + March PR of the Month (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=debbbb9913&e=9963ef1d25
> )
> + Release Airflow 2.5.3 from 2.5.3rc2 (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=794209ee92&e=9963ef1d25
> )
> * Discussed:
> + Preparing for dropping Python 3.7 support (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=23a4531028&e=9963ef1d25
> )
> + AIP-56 Extensible user management (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=960aa4d989&e=9963ef1d25
> )
> + New Provider - Huawei Cloud (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a6f1bb71bc&e=9963ef1d25
> )
> + Describing (new) provider approval policies (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0c3b8d38b4&e=9963ef1d25
> )
> + 2400+ contributors and counting (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2d3a92eabc&e=9963ef1d25
> )
> + Faster dag parsing by pre-importing airflow modules (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=65c313cd99&e=9963ef1d25
> )
> + A cache for Airflow Variables (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=11299db39b&e=9963ef1d25
> )
> + Request for feedback on proposal for new OpenLineage provider in Airflow
> (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ed32045ffd&e=9963ef1d25
> )
> + AIP-55 Rule-based timetable with logical composition (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=239ff5f75d&e=9963ef1d25
> )
> + Exclude some providers that hold us back from releasing (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8515315573&e=9963ef1d25
> )
> * Lazy Consensus
> + Suspend Yandex provider due to Protobuf4 limitation (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eb89cba19a&e=9963ef1d25
> )
> + Accept Kafka provider (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b2a7a33212&e=9963ef1d25
> )
> + Introduce suspension process for providers due to dependencies holding
> us back (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bbf84752c9&e=9963ef1d25
> )
> * Announced:
> + Get ready for Airflow Summit (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=65c004314f&e=9963ef1d25
> )
> + 30k stars on GitHub (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4e1de4eb28&e=9963ef1d25
> )
> + Apache Airflow 2.6.0 released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f0156ec8f2&e=9963ef1d25
> )
> + Airflow Providers prepared on April 26, 2023 are released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=76cf6916de&e=9963ef1d25
> )
> + Airflow Providers prepared on April 21, 2023 are released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4482d3de87&e=9963ef1d25
> )
> + New committer Hussein Awala (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=60e9c6d9e2&e=9963ef1d25
> )
> + Apache Airflow 2.6.0rb1 available for testing (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=66181b3e16&e=9963ef1d25
> )
> + Apache Airflow Helm Chart version 1.9.0 Released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8c1f0711bb&e=9963ef1d25
> )
> + Airflow Providers prepared on April 12, 2023 are released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=99a4187a69&e=9963ef1d25
> )
> + Airflow Providers prepared on April 2, 2023 are ready (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eefc2844fc&e=9963ef1d25
> )
> + Apache Airflow 2.5.3 Released (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7a4f8eb3ff&e=9963ef1d25
> )
> * Proposed:
> + Archiving some old repos (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3e667124a8&e=9963ef1d25
> )
>
> * AIP-52: Automatic setup and teardown of tasks (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=43ebdebb30&e=9963ef1d25
> )
> * AIP-53: OpenLineage in Airflow (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3a3fffc10f&e=9963ef1d25
> )
> * AIP-50: Trigger DAG UI Extension with Flexible User Form Concept (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d35d3d43c7&e=9963ef1d25
> )
> * AIP-26: Production-ready Airflow Docker Image (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8db532d9d7&e=9963ef1d25
> )
> * See the Wiki (
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a6cab45bec&e=9963ef1d25)
> for more of the project’s approved AIPs.
>
> Please subscribe to this newsletter to ensure you always receive the
> latest issue:
> https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=36703acd13&e=9963ef1d25
> .
>
> Know of an upcoming event or publication the community should know about?
> Let us know at viraj@astronomer.io (mailto:viraj@astronomer.io) or
> michael.robinson@astronomer.io (mailto:michael.robinson@astronomer.io) .
>
> ============================================================
> Want to change how you receive these emails?
> You can ** update your preferences (
> https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=53ec9ba965
> )
> or ** unsubscribe from this list (
> https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=53ec9ba965
> )
> .