Apache Airflow Newsletter | January 2023

[Airflow Newsletter <jo...@astronomer.io.INVALID>]

View this email in your browser (https://mailchi.mp/0ad49ae0ab4d/apache-airflow-newsletter-january-2023?e=9963ef1d25)

Two months for this newsletter, and a lot of activity into the new year!

We have two new committers, Andrey Anshin and Niko Oliveira, and two new releases 2.5.0 and 2.5.1. Congratulations to everyone involved 🎉

We also deployed the new documentation architecture (PR #27235), so some of the pages you know and love might have moved, but we promise they’re still around.

As always, thanks for reading, and feel free to reach out if there’s an event or article you think should be included.

On December 2, we released Airflow 2.5.0. You can find the build artifacts using these links:
* PyPI (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e28d7eef31&e=9963ef1d25) | Release Notes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5a059e62a3&e=9963ef1d25) | Docs (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=54e6a1fd94&e=9963ef1d25) | Sources (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=742af5c975&e=9963ef1d25) | Docker (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d886ed563a&e=9963ef1d25)

O
n January 20, we released Airflow 2.5.1. You can find it here:
* PyPI (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5bc14ca635&e=9963ef1d25) | Release Notes (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e670883d5e&e=9963ef1d25) | Docs (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2d20b5e69c&e=9963ef1d25) | Sources (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c868da8c40&e=9963ef1d25) | Docker (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=786a3f7b0b&e=9963ef1d25)

* February 7: DC Area Apache Airflow Meetup (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1740c254d2&e=9963ef1d25) , DC Event
* February 7: The Airflow Templates VS Code Extension (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d71af852aa&e=9963ef1d25) , Webinar
* February 14: Simplified DAG Authoring with New Airflow Features (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=650d4c79db&e=9963ef1d25) , Webinar

* January 31: Debugging your Airflow Dags (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d5d7a57e93&e=9963ef1d25) , Webinar
* January 24: Using the new Fivetran Provider (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=85cb163bb0&e=9963ef1d25) , Webinar
* January 17: What’s new in Airflow 2.5 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c5c11b3023&e=9963ef1d25) , Webinar

https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bd1f8df02d&e=9963ef1d25 @jens-scheffler-bosch
#27063 AIP-50 Trigger UI based on FAB

Covers AIP-50 Parts 1, 3, and 4. Enables users to easily create a UI that will trigger a DAG with a given set of parameters
* “Apache Airflow Bad vs. Best Practices In Production (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b726a8947e&e=9963ef1d25) ” Bhavani Ravi, Medium
* “Community Story: Airflow + Great Expectations at Factory Pal (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=22a814d5a9&e=9963ef1d25) ” Benji Lampel, Medium
* “Unleashing the power of TaskFlow API in Apache Airflow (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c34f74b578&e=9963ef1d25) ” Ferruzzi, Medium
* “Get Improved Data Quality Checks in Airflow with the Updated Great Expectations Operator (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5a9afc0661&e=9963ef1d25) ” Benji Lampel and Tamara Fingerlin, Astro Blog

* Votes:
+ Release Airflow 2.5.0 from 2.5.0rc3 [accepted]
+ Airflow Providers prepared on December 1st, 2022 (RC1) [accepted]
+ Airflow Providers prepared on December 14, 2022 (RC1) [accepted]
+ Airflow Providers prepared on January 02, 2023 - RC2 [accepted]
+ AIP-50 Trigger DAG UI Extension with Flexible User Form Concept [accepted]
+ AIP-52 Automatic setup and teardown tasks [accepted]
+ Airflow Providers prepared on January 14, 2023 [accepted]
+ Release Airflow 2.5.1 from 2.5.1rc1 [withdrawn]
+ Release Airflow 2.5.1 from 2.5.1rc2 [accepted]
+ Release Airflow Python Client 2.5.0 based on 2.5.0rc1 [accepted]
+ Airflow Providers prepared on January 23, 2023  [accepted]
* Lazy Consensus
+ Release of API Clients
o Update the release process for API clients
* Discussed:
+ Release of API clients
o Should we make it part of our release process to also release api clients when cutting new airflow core versions ?
+ New Provider: Pandera
+ AIP-52 Automatic setup and tear down tasks
+ Whether to fail early for Xcom.set when value exceeds the BLOB limit
+ Assessing what is a breaking change for Airflow (SemVer context) [Continued]
+ Request for feedback on proposal for new OpenLineage provider in Airflow
* Proposed:
+ Remove Executor Coupling in Core Airflow Code Base
+ Dealing with public runner test failures (Integration tests restructuring)
+ Switching our CI runners to K8S controller open-sourced for Apache Arrow
* Announced:
+ Apache Airflow 2.5.0 Released
+ Airflow Providers released on December 02, 2022 are ready
+ New committer Andrey Anshin (Taragolis)
+ New committer Niko Oliveira (o-nikolas)
+ Airflow Providers released on January 02, 2023 are ready
+ Airflow Providers released on January 14, 2023 are ready
+ Apache Airflow 2.5.1 Released
+ Airflow Providers prepared on January 23, 2023 are ready
+ Amazon provider package system tests dashboard

* Airflow Helm Chart 1.9.0 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=da54116b45&e=9963ef1d25)
* Airflow 2.5.2 (https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=24126bb137&e=9963ef1d25)

Please subscribe to this newsletter to ensure you always receive the latest issue:  https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=29109b9244&e=9963ef1d25.
Know of an upcoming event or publication the community should know about? Let me know at john.thomas@astronomer.io (mailto:john.thomas@astronomer.io) .

============================================================
Want to change how you receive these emails?
You can ** update your preferences (https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=c610e201a4)
or ** unsubscribe from this list (https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=9963ef1d25&c=c610e201a4)
.