You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Kaxil Naik <ka...@apache.org> on 2021/09/11 13:08:08 UTC
Apache Airflow 2.2.0beta1 available for testing
Hey fellow Airflowers,
We have cut Airflow 2.2.0beta1 now that all the main features have been
included.
This "snapshot" is intended for members of the Airflow developer community
to test the build and allow early testing 2.2.0. Please test this beta and
create GitHub issues wherever possible if you encounter bugs, (use 2.2.0b1
in the version dropdown filter when creating the issue).
For clarity, this is not an official release of Apache Airflow either -
that doesn't happen until we make a release candidate and then vote on that.
The beta snapshot is available at:
https://dist.apache.org/repos/dist/dev/airflow/2.2.0b1/
*apache-airflow-2.2.0b1-source.tar.gz* is a source release that comes with
INSTALL instructions.
*apache-airflow-2.2.0b1.tar.gz* is the binary Python "sdist" snapshot.
*apache_airflow-2.2.0b1-py3-none-any.whl* is the binary Python wheel
snapshot.
This snapshot has been pushed to PyPI too at
https://pypi.org/project/apache-airflow/2.2.0b1/ and can be installed by
running the following command:
pip install 'apache-airflow==2.2.0b1'
*Constraints files* are available at
https://github.com/apache/airflow/tree/constraints-2.2.0b1
*Full Changelog*:
https://github.com/apache/airflow/blob/2.2.0b1/CHANGELOG.txt
*New Features:*
- AIP-39: Handle DAG scheduling with timetables (#15397)
- AIP-39: ``DagRun.data_interval_start|end`` (#16352)
- AIP-40: Add Deferrable "Async" Tasks (#15389)
- Add Airflow Standalone command (#15826)
- Ability to test connections from UI or API (#15795)
- Add Next Run to UI (#17732)
- Allow custom timetable as a DAG argument (#17414)
- Add a calendar field to choose the execution date of the DAG when
triggering it (#16141)
- Allow setting specific ``cwd`` for BashOperator (#17751)
- Show import errors in DAG views (#17818)
- Add pre/post execution hooks [Experimental] (#17576)
- Add triggerer to ``docker-compose.yaml`` file (#17745)
- Added table to view providers in Airflow ui under admin tab (#15385)
- Adds secrets backend/logging/auth information to provider yaml (#17625)
- Add date format filters to Jinja environment (#17451)
- Introduce ``RESTARTING`` state (#16681)
- Webserver: Unpause DAG on manual trigger (#16569)
- API endpoint to create new user (#16609)
- Add ``insert_args`` for support transfer replace (#15825)
- Add recursive flag to glob in filesystem sensor (#16894)
- Add conn to jinja template context (#16686)
- Add ``default_args`` for ``TaskGroup`` (#16557)
- Allow adding duplicate connections from UI (#15574)
- Allow specifying multiple URLs via the CORS config option (#17941)
- Implement API endpoint for DAG deletion (#17980)
- Add DAG run endpoint for marking a dagrun success or failed(#17839)
- Add Triggerer warning banner in UI (#17565)
- Add support for ``kinit`` options ``[-f|-F]`` and ``[-a|-A]`` (#17816)
- Queue support for DaskExecutor using Dask Worker Resources (#16829)
- Make auto refresh interval configurable (#18107)
Regards,
Jed & Kaxil
Re: Apache Airflow 2.2.0beta1 available for testing
Posted by Jarek Potiuk <ja...@potiuk.com>.
Good that we have Betas and people testing them!
On Wed, Sep 15, 2021 at 1:19 PM Ash Berlin-Taylor <as...@apache.org> wrote:
> We've got our first release blocker -- it wasn't possible to actually
> upgrade the DB.
>
> Doh!
>
> https://github.com/apache/airflow/pull/18266
>
> An easy fix, but it stopped upgrading an install -- `airflow db upgrade`
> etc would only work on an empty DB.
>
> -ash
>
> On Sat, Sep 11 2021 at 18:26:01 +0200, Jarek Potiuk <ja...@potiuk.com>
> wrote:
>
> NICE! Two AIP-s in one release :). That will be awesome to have
> "defferable operators" and "flexible scheduling" .
>
> On Sat, Sep 11, 2021 at 3:16 PM Kaxil Naik <ka...@apache.org> wrote:
>
>> The Docker images are available too for convenience:
>> https://hub.docker.com/r/apache/airflow/tags?page=1&ordering=last_updated&name=2.2.0b1
>>
>> On Sat, Sep 11, 2021 at 2:08 PM Kaxil Naik <ka...@apache.org> wrote:
>>
>>> Hey fellow Airflowers,
>>>
>>> We have cut Airflow 2.2.0beta1 now that all the main features have been
>>> included.
>>>
>>> This "snapshot" is intended for members of the Airflow developer
>>> community to test the build and allow early testing 2.2.0. Please test this
>>> beta and create GitHub issues wherever possible if you encounter bugs,
>>> (use 2.2.0b1 in the version dropdown filter when creating the issue).
>>>
>>> For clarity, this is not an official release of Apache Airflow either -
>>> that doesn't happen until we make a release candidate and then vote on that.
>>>
>>> The beta snapshot is available at:
>>>
>>> https://dist.apache.org/repos/dist/dev/airflow/2.2.0b1/
>>>
>>> *apache-airflow-2.2.0b1-source.tar.gz* is a source release that comes
>>> with INSTALL instructions.
>>> *apache-airflow-2.2.0b1.tar.gz* is the binary Python "sdist" snapshot.
>>> *apache_airflow-2.2.0b1-py3-none-any.whl* is the binary Python wheel
>>> snapshot.
>>>
>>> This snapshot has been pushed to PyPI too at
>>> https://pypi.org/project/apache-airflow/2.2.0b1/ and can be installed
>>> by running the following command:
>>>
>>> pip install 'apache-airflow==2.2.0b1'
>>>
>>> *Constraints files* are available at
>>> https://github.com/apache/airflow/tree/constraints-2.2.0b1
>>>
>>> *Full Changelog*:
>>> https://github.com/apache/airflow/blob/2.2.0b1/CHANGELOG.txt
>>>
>>> *New Features:*
>>>
>>> - AIP-39: Handle DAG scheduling with timetables (#15397)
>>> - AIP-39: ``DagRun.data_interval_start|end`` (#16352)
>>> - AIP-40: Add Deferrable "Async" Tasks (#15389)
>>> - Add Airflow Standalone command (#15826)
>>> - Ability to test connections from UI or API (#15795)
>>> - Add Next Run to UI (#17732)
>>> - Allow custom timetable as a DAG argument (#17414)
>>> - Add a calendar field to choose the execution date of the DAG when
>>> triggering it (#16141)
>>> - Allow setting specific ``cwd`` for BashOperator (#17751)
>>> - Show import errors in DAG views (#17818)
>>> - Add pre/post execution hooks [Experimental] (#17576)
>>> - Add triggerer to ``docker-compose.yaml`` file (#17745)
>>> - Added table to view providers in Airflow ui under admin tab
>>> (#15385)
>>> - Adds secrets backend/logging/auth information to provider yaml
>>> (#17625)
>>> - Add date format filters to Jinja environment (#17451)
>>> - Introduce ``RESTARTING`` state (#16681)
>>> - Webserver: Unpause DAG on manual trigger (#16569)
>>> - API endpoint to create new user (#16609)
>>> - Add ``insert_args`` for support transfer replace (#15825)
>>> - Add recursive flag to glob in filesystem sensor (#16894)
>>> - Add conn to jinja template context (#16686)
>>> - Add ``default_args`` for ``TaskGroup`` (#16557)
>>> - Allow adding duplicate connections from UI (#15574)
>>> - Allow specifying multiple URLs via the CORS config option (#17941)
>>> - Implement API endpoint for DAG deletion (#17980)
>>> - Add DAG run endpoint for marking a dagrun success or failed(#17839)
>>> - Add Triggerer warning banner in UI (#17565)
>>> - Add support for ``kinit`` options ``[-f|-F]`` and ``[-a|-A]``
>>> (#17816)
>>> - Queue support for DaskExecutor using Dask Worker Resources (#16829)
>>> - Make auto refresh interval configurable (#18107)
>>>
>>> Regards,
>>> Jed & Kaxil
>>>
>>
Re: Apache Airflow 2.2.0beta1 available for testing
Posted by Ash Berlin-Taylor <as...@apache.org>.
We've got our first release blocker -- it wasn't possible to actually
upgrade the DB.
Doh!
<https://github.com/apache/airflow/pull/18266>
An easy fix, but it stopped upgrading an install -- `airflow db
upgrade` etc would only work on an empty DB.
-ash
On Sat, Sep 11 2021 at 18:26:01 +0200, Jarek Potiuk <ja...@potiuk.com>
wrote:
> NICE! Two AIP-s in one release :). That will be awesome to have
> "defferable operators" and "flexible scheduling" .
>
> On Sat, Sep 11, 2021 at 3:16 PM Kaxil Naik <kaxilnaik@apache.org
> <ma...@apache.org>> wrote:
>> The Docker images are available too for convenience:
>> <https://hub.docker.com/r/apache/airflow/tags?page=1&ordering=last_updated&name=2.2.0b1>
>>
>> On Sat, Sep 11, 2021 at 2:08 PM Kaxil Naik <kaxilnaik@apache.org
>> <ma...@apache.org>> wrote:
>>> Hey fellow Airflowers,
>>>
>>> We have cut Airflow 2.2.0beta1 now that all the main features have
>>> been included.
>>>
>>> This "snapshot" is intended for members of the Airflow developer
>>> community to test the build and allow early testing 2.2.0. Please
>>> test this beta and create GitHub issues wherever possible if you
>>> encounter bugs, (use 2.2.0b1 in the version dropdown filter when
>>> creating the issue).
>>>
>>> For clarity, this is not an official release of Apache Airflow
>>> either - that doesn't happen until we make a release candidate and
>>> then vote on that.
>>>
>>> The beta snapshot is available at:
>>>
>>> <https://dist.apache.org/repos/dist/dev/airflow/2.2.0b1/>
>>>
>>> *apache-airflow-2.2.0b1-source.tar.gz* is a source release that
>>> comes with INSTALL instructions.
>>> *apache-airflow-2.2.0b1.tar.gz* is the binary Python "sdist"
>>> snapshot.
>>> *apache_airflow-2.2.0b1-py3-none-any.whl* is the binary Python
>>> wheel snapshot.
>>>
>>> This snapshot has been pushed to PyPI too at
>>> <https://pypi.org/project/apache-airflow/2.2.0b1/> and can be
>>> installed by running the following command:
>>>
>>> pip install 'apache-airflow==2.2.0b1'
>>>
>>> *Constraints files* are available at
>>> <https://github.com/apache/airflow/tree/constraints-2.2.0b1>
>>> *
>>> *
>>> *Full Changelog*:
>>> <https://github.com/apache/airflow/blob/2.2.0b1/CHANGELOG.txt>
>>> _
>>> _
>>> _New Features:_
>>> AIP-39: Handle DAG scheduling with timetables (#15397)AIP-39:
>>> ``DagRun.data_interval_start|end`` (#16352)AIP-40: Add Deferrable
>>> "Async" Tasks (#15389)Add Airflow Standalone command
>>> (#15826)Ability to test connections from UI or API (#15795)Add Next
>>> Run to UI (#17732)Allow custom timetable as a DAG argument
>>> (#17414)Add a calendar field to choose the execution date of the
>>> DAG when triggering it (#16141)Allow setting specific ``cwd`` for
>>> BashOperator (#17751)Show import errors in DAG views (#17818)Add
>>> pre/post execution hooks [Experimental] (#17576)Add triggerer to
>>> ``docker-compose.yaml`` file (#17745)Added table to view providers
>>> in Airflow ui under admin tab (#15385)Adds secrets
>>> backend/logging/auth information to provider yaml (#17625)Add date
>>> format filters to Jinja environment (#17451)Introduce
>>> ``RESTARTING`` state (#16681)Webserver: Unpause DAG on manual
>>> trigger (#16569)API endpoint to create new user (#16609)Add
>>> ``insert_args`` for support transfer replace (#15825)Add recursive
>>> flag to glob in filesystem sensor (#16894)Add conn to jinja
>>> template context (#16686)Add ``default_args`` for ``TaskGroup``
>>> (#16557)Allow adding duplicate connections from UI (#15574)Allow
>>> specifying multiple URLs via the CORS config option
>>> (#17941)Implement API endpoint for DAG deletion (#17980)Add DAG run
>>> endpoint for marking a dagrun success or failed(#17839)Add
>>> Triggerer warning banner in UI (#17565)Add support for ``kinit``
>>> options ``[-f|-F]`` and ``[-a|-A]`` (#17816)Queue support for
>>> DaskExecutor using Dask Worker Resources (#16829)Make auto refresh
>>> interval configurable (#18107)
>>> Regards,
>>> Jed & Kaxil
Re: Apache Airflow 2.2.0beta1 available for testing
Posted by Jarek Potiuk <ja...@potiuk.com>.
NICE! Two AIP-s in one release :). That will be awesome to have
"defferable operators" and "flexible scheduling" .
On Sat, Sep 11, 2021 at 3:16 PM Kaxil Naik <ka...@apache.org> wrote:
> The Docker images are available too for convenience:
> https://hub.docker.com/r/apache/airflow/tags?page=1&ordering=last_updated&name=2.2.0b1
>
> On Sat, Sep 11, 2021 at 2:08 PM Kaxil Naik <ka...@apache.org> wrote:
>
>> Hey fellow Airflowers,
>>
>> We have cut Airflow 2.2.0beta1 now that all the main features have been
>> included.
>>
>> This "snapshot" is intended for members of the Airflow developer
>> community to test the build and allow early testing 2.2.0. Please test this
>> beta and create GitHub issues wherever possible if you encounter bugs,
>> (use 2.2.0b1 in the version dropdown filter when creating the issue).
>>
>> For clarity, this is not an official release of Apache Airflow either -
>> that doesn't happen until we make a release candidate and then vote on that.
>>
>> The beta snapshot is available at:
>>
>> https://dist.apache.org/repos/dist/dev/airflow/2.2.0b1/
>>
>> *apache-airflow-2.2.0b1-source.tar.gz* is a source release that comes
>> with INSTALL instructions.
>> *apache-airflow-2.2.0b1.tar.gz* is the binary Python "sdist" snapshot.
>> *apache_airflow-2.2.0b1-py3-none-any.whl* is the binary Python wheel
>> snapshot.
>>
>> This snapshot has been pushed to PyPI too at
>> https://pypi.org/project/apache-airflow/2.2.0b1/ and can be installed by
>> running the following command:
>>
>> pip install 'apache-airflow==2.2.0b1'
>>
>> *Constraints files* are available at
>> https://github.com/apache/airflow/tree/constraints-2.2.0b1
>>
>> *Full Changelog*:
>> https://github.com/apache/airflow/blob/2.2.0b1/CHANGELOG.txt
>>
>> *New Features:*
>>
>> - AIP-39: Handle DAG scheduling with timetables (#15397)
>> - AIP-39: ``DagRun.data_interval_start|end`` (#16352)
>> - AIP-40: Add Deferrable "Async" Tasks (#15389)
>> - Add Airflow Standalone command (#15826)
>> - Ability to test connections from UI or API (#15795)
>> - Add Next Run to UI (#17732)
>> - Allow custom timetable as a DAG argument (#17414)
>> - Add a calendar field to choose the execution date of the DAG when
>> triggering it (#16141)
>> - Allow setting specific ``cwd`` for BashOperator (#17751)
>> - Show import errors in DAG views (#17818)
>> - Add pre/post execution hooks [Experimental] (#17576)
>> - Add triggerer to ``docker-compose.yaml`` file (#17745)
>> - Added table to view providers in Airflow ui under admin tab (#15385)
>> - Adds secrets backend/logging/auth information to provider yaml
>> (#17625)
>> - Add date format filters to Jinja environment (#17451)
>> - Introduce ``RESTARTING`` state (#16681)
>> - Webserver: Unpause DAG on manual trigger (#16569)
>> - API endpoint to create new user (#16609)
>> - Add ``insert_args`` for support transfer replace (#15825)
>> - Add recursive flag to glob in filesystem sensor (#16894)
>> - Add conn to jinja template context (#16686)
>> - Add ``default_args`` for ``TaskGroup`` (#16557)
>> - Allow adding duplicate connections from UI (#15574)
>> - Allow specifying multiple URLs via the CORS config option (#17941)
>> - Implement API endpoint for DAG deletion (#17980)
>> - Add DAG run endpoint for marking a dagrun success or failed(#17839)
>> - Add Triggerer warning banner in UI (#17565)
>> - Add support for ``kinit`` options ``[-f|-F]`` and ``[-a|-A]``
>> (#17816)
>> - Queue support for DaskExecutor using Dask Worker Resources (#16829)
>> - Make auto refresh interval configurable (#18107)
>>
>> Regards,
>> Jed & Kaxil
>>
>
Re: Apache Airflow 2.2.0beta1 available for testing
Posted by Kaxil Naik <ka...@apache.org>.
The Docker images are available too for convenience:
https://hub.docker.com/r/apache/airflow/tags?page=1&ordering=last_updated&name=2.2.0b1
On Sat, Sep 11, 2021 at 2:08 PM Kaxil Naik <ka...@apache.org> wrote:
> Hey fellow Airflowers,
>
> We have cut Airflow 2.2.0beta1 now that all the main features have been
> included.
>
> This "snapshot" is intended for members of the Airflow developer community
> to test the build and allow early testing 2.2.0. Please test this beta and
> create GitHub issues wherever possible if you encounter bugs, (use 2.2.0b1
> in the version dropdown filter when creating the issue).
>
> For clarity, this is not an official release of Apache Airflow either -
> that doesn't happen until we make a release candidate and then vote on that.
>
> The beta snapshot is available at:
>
> https://dist.apache.org/repos/dist/dev/airflow/2.2.0b1/
>
> *apache-airflow-2.2.0b1-source.tar.gz* is a source release that comes
> with INSTALL instructions.
> *apache-airflow-2.2.0b1.tar.gz* is the binary Python "sdist" snapshot.
> *apache_airflow-2.2.0b1-py3-none-any.whl* is the binary Python wheel
> snapshot.
>
> This snapshot has been pushed to PyPI too at
> https://pypi.org/project/apache-airflow/2.2.0b1/ and can be installed by
> running the following command:
>
> pip install 'apache-airflow==2.2.0b1'
>
> *Constraints files* are available at
> https://github.com/apache/airflow/tree/constraints-2.2.0b1
>
> *Full Changelog*:
> https://github.com/apache/airflow/blob/2.2.0b1/CHANGELOG.txt
>
> *New Features:*
>
> - AIP-39: Handle DAG scheduling with timetables (#15397)
> - AIP-39: ``DagRun.data_interval_start|end`` (#16352)
> - AIP-40: Add Deferrable "Async" Tasks (#15389)
> - Add Airflow Standalone command (#15826)
> - Ability to test connections from UI or API (#15795)
> - Add Next Run to UI (#17732)
> - Allow custom timetable as a DAG argument (#17414)
> - Add a calendar field to choose the execution date of the DAG when
> triggering it (#16141)
> - Allow setting specific ``cwd`` for BashOperator (#17751)
> - Show import errors in DAG views (#17818)
> - Add pre/post execution hooks [Experimental] (#17576)
> - Add triggerer to ``docker-compose.yaml`` file (#17745)
> - Added table to view providers in Airflow ui under admin tab (#15385)
> - Adds secrets backend/logging/auth information to provider yaml
> (#17625)
> - Add date format filters to Jinja environment (#17451)
> - Introduce ``RESTARTING`` state (#16681)
> - Webserver: Unpause DAG on manual trigger (#16569)
> - API endpoint to create new user (#16609)
> - Add ``insert_args`` for support transfer replace (#15825)
> - Add recursive flag to glob in filesystem sensor (#16894)
> - Add conn to jinja template context (#16686)
> - Add ``default_args`` for ``TaskGroup`` (#16557)
> - Allow adding duplicate connections from UI (#15574)
> - Allow specifying multiple URLs via the CORS config option (#17941)
> - Implement API endpoint for DAG deletion (#17980)
> - Add DAG run endpoint for marking a dagrun success or failed(#17839)
> - Add Triggerer warning banner in UI (#17565)
> - Add support for ``kinit`` options ``[-f|-F]`` and ``[-a|-A]``
> (#17816)
> - Queue support for DaskExecutor using Dask Worker Resources (#16829)
> - Make auto refresh interval configurable (#18107)
>
> Regards,
> Jed & Kaxil
>