You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Ash Berlin-Taylor <as...@apache.org> on 2021/06/26 06:29:51 UTC
[VOTE] Release Airflow 2.1.1 from RC1
Hey fellow Airflowers,
(I am sending this on behalf of James, as timezones are tricky and he
is not yet a PMC member so cannot sign the release himself.)
We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
release, which will last for 72 hours, from Tuesday, June 29, 2021 at
06:30am UTC or until 3 binding +1 votes have been received.
Consider this my [James] (non-binding) +1. As I’m not a member of the
PMC, Ash signed the distribution.
Airflow 2.1.1 RC1 is available at:
<https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/>
apache-airflow-2.1.1-source.tar.gz is a source release that comes with
INSTALL instructions.
apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
"binary" release.
Public keys are available at:
<https://dist.apache.org/repos/dist/release/airflow/KEYS>
Only votes from PMC members are binding, but all members of the
community are encouraged to test the release and vote with
"(non-binding)".
The test procedure for PMCs and Contributors who would like to test
this RC are described in
<https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs>
Please note that the version number excludes the `rcX` string, so it's
now
simply 2.1.1. This will allow us to rename the artifact without
modifying
the artifact checksums when we actually release.
Changes since 2.1.1 below.
Thanks,
James
Bug Fixes
"""""""""
- Don't crash attempting to mask secrets in dict with non-string keys
(#16601)
- Always install sphinx_airflow_theme from ``PyPI`` (#16594)
- Remove limitation for elasticsearch library (#16553)
- Adding extra requirements for build and runtime of the PROD image.
(#16170)
- Cattrs 1.7.0 released by the end of May 2021 break lineage usage
(#16173)
- Removes unnecessary packages from setup_requires (#16139)
- Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
- Improvements for Docker Image docs (#14843)
- Ensure that ``dag_run.conf`` is a dict (#15057)
- Fix CLI connections import and migrate logic from secrets to
Connection model (#15425)
- Fix Dag Details start date bug (#16206)
- Fix DAG run state not updated while DAG is paused (#16343)
- Allow null value for operator field in task_instance schema(REST API)
(#16516)
- Avoid recursion going too deep when redacting logs (#16491)
- Backfill: Don't create a DagRun if no tasks match task regex (#16461)
- Tree View UI for larger DAGs & more consistent spacing in Tree View
(#16522)
- Correctly handle None returns from Query.scalar() (#16345)
- Adding ``only_active`` parameter to /dags endpoint (#14306)
- Don't show stale Serialized DAGs if they are deleted in DB (#16368)
- Make REST API List DAGs endpoint consistent with UI/CLI behaviour
(#16318)
- Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
- Queue tasks with higher priority and earlier execution_date first.
(#15210)
- Make task ID on legend have enough width and width of line chart to
be 100%. (#15915)
- Fix normalize-url vulnerability (#16375)
- Validate retries value on init for better errors (#16415)
- add num_runs query param for tree refresh (#16437)
- Fix templated default/example values in config ref docs (#16442)
- Add ``passphrase`` and ``private_key`` to default sensitive field
names (#16392)
- Fix tasks in an infinite slots pool were never scheduled (#15247)
- Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
- Don't fail to log if we can't redact something (#16118)
- Set max tree width to 1200 pixels (#16067)
- Fill the "job_id" field for ``airflow task run`` without
``--local``/``--raw`` for KubeExecutor (#16108)
- Fixes problem where conf variable was used before initialization
(#16088)
- Fix apply defaults for task decorator (#16085)
- Parse recently modified files even if just parsed (#16075)
- Ensure that we don't try to mask empty string in logs (#16057)
- Don't die when masking ``log.exception`` when there is no exception
(#16047)
- Restores apply_defaults import in base_sensor_operator (#16040)
- Fix auto-refresh in tree view When webserver ui is not in ``/``
(#16018)
- Fix dag.clear() to set multiple dags to running when necessary
(#15382)
- Fix Celery executor getting stuck randomly because of reset_signals
in multiprocessing (#15989)
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Kaxil Naik <ka...@gmail.com>.
+1 (binding)
On Tue, Jun 29, 2021, 16:03 Xinbin Huang <bi...@gmail.com> wrote:
> +1 (non-binding)
>
> On Tue, Jun 29, 2021 at 8:00 AM Jed Cunningham <je...@astronomer.io.invalid>
> wrote:
>
>> +1 (non-binding)
>>
>> On Tue, Jun 29, 2021 at 3:50 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>>
>>> +1 (binding) because I didn't actually cast it yet :D
>>>
>>> I think since the CeleryKubernetesExecutor behaviour is not a regression
>>> from 2.1.0, combined with Kaxil finding a workaround that it is worth
>>> carrying on with the 2.1.1 release, and we will follow up soon-ish with a
>>> 2.1.2
>>>
>>> On Mon, Jun 28 2021 at 09:55:58 -0700, Daniel Standish <
>>> dpstandish@gmail.com> wrote:
>>>
>>> I am not sure if this would block release, but I think
>>> CeleryKubernetesExecutor remains broken in this release if this issue is
>>> correct:
>>> https://github.com/apache/airflow/issues/16326#issuecomment-869597105
>>>
>>> It was already broken in 2.1.0 so maybe that renders it a non-blocker?
>>>
>>>
>>> On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <el...@apache.org> wrote:
>>>
>>>> +1 (non-binding)
>>>>
>>>> On Mon, Jun 28, 2021 at 6:08 PM James Timmins
>>>> <ja...@astronomer.io.invalid> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>,
>>>>> wrote:
>>>>>
>>>>> For convenience of people testing the release, I've also pushed
>>>>> 2.1.1rc1 docker images to our DockerHub:
>>>>>
>>>>> Those images are available for everyone to test (they also contain the
>>>>> latest provider packages released in June):
>>>>>
>>>>> docker pull apache/airflow:2.1.1rc1-python3.6
>>>>> docker pull apache/airflow:2.1.1rc1-python3.7
>>>>> docker pull apache/airflow:2.1.1rc1-python3.8
>>>>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>>>>
>>>>> I am also adding step to make it "default" as part of our release
>>>>> process in the future: https://github.com/apache/airflow/pull/16674
>>>>>
>>>>> J.
>>>>>
>>>>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>>>>> <ep...@gmail.com> wrote:
>>>>>
>>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>>
>>>>>
>>>>> From: Jarek Potiuk
>>>>> Sent: Saturday, June 26, 2021 11:07 AM
>>>>> To: dev@airflow.apache.org
>>>>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>>>>
>>>>>
>>>>>
>>>>> +1 (binding) - tested signatures/licences/code, installed it in
>>>>>
>>>>> breeze including all the latest released providers and run a few
>>>>>
>>>>> workflows. All seems good.
>>>>>
>>>>>
>>>>>
>>>>> Two tiny issues:
>>>>>
>>>>>
>>>>>
>>>>> * .rat-excludes is missing in the sources. This is quite likely fine
>>>>>
>>>>> but we need to change our verification instructions a bit to take
>>>>>
>>>>> .rat-excludes from Airflow sources.
>>>>>
>>>>> * setup.cfg misses license but I think this might be expected as it is
>>>>>
>>>>> likely automatically stripped-off any comments (?) - we should add it
>>>>>
>>>>> to .rat-excludes then.
>>>>>
>>>>>
>>>>>
>>>>> J.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org>
>>>>> wrote:
>>>>>
>>>>>
>>>>>
>>>>> Hey fellow Airflowers,
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (I am sending this on behalf of James, as timezones are tricky and he
>>>>> is not yet a PMC member so cannot sign the release himself.)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
>>>>> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
>>>>> 06:30am UTC or until 3 binding +1 votes have been received.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Consider this my [James] (non-binding) +1. As I’m not a member of the
>>>>> PMC, Ash signed the distribution.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Airflow 2.1.1 RC1 is available at:
>>>>> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
>>>>> INSTALL instructions.
>>>>>
>>>>>
>>>>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>>>>>
>>>>>
>>>>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
>>>>> "binary" release.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Public keys are available at:
>>>>>
>>>>>
>>>>> https://dist.apache.org/repos/dist/release/airflow/KEYS
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Only votes from PMC members are binding, but all members of the
>>>>> community are encouraged to test the release and vote with "(non-binding)".
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> The test procedure for PMCs and Contributors who would like to test
>>>>> this RC are described in
>>>>>
>>>>>
>>>>>
>>>>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Please note that the version number excludes the `rcX` string, so it's
>>>>> now
>>>>>
>>>>>
>>>>> simply 2.1.1. This will allow us to rename the artifact without
>>>>> modifying
>>>>>
>>>>>
>>>>> the artifact checksums when we actually release.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Changes since 2.1.1 below.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>>
>>>>> James
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Bug Fixes
>>>>>
>>>>>
>>>>> """""""""
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> - Don't crash attempting to mask secrets in dict with non-string keys
>>>>> (#16601)
>>>>>
>>>>>
>>>>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>>>>
>>>>>
>>>>> - Remove limitation for elasticsearch library (#16553)
>>>>>
>>>>>
>>>>> - Adding extra requirements for build and runtime of the PROD image.
>>>>> (#16170)
>>>>>
>>>>>
>>>>> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage
>>>>> (#16173)
>>>>>
>>>>>
>>>>> - Removes unnecessary packages from setup_requires (#16139)
>>>>>
>>>>>
>>>>> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>>>>>
>>>>>
>>>>> - Improvements for Docker Image docs (#14843)
>>>>>
>>>>>
>>>>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>>>>
>>>>>
>>>>> - Fix CLI connections import and migrate logic from secrets to
>>>>> Connection model (#15425)
>>>>>
>>>>>
>>>>> - Fix Dag Details start date bug (#16206)
>>>>>
>>>>>
>>>>> - Fix DAG run state not updated while DAG is paused (#16343)
>>>>>
>>>>>
>>>>> - Allow null value for operator field in task_instance schema(REST
>>>>> API) (#16516)
>>>>>
>>>>>
>>>>> - Avoid recursion going too deep when redacting logs (#16491)
>>>>>
>>>>>
>>>>> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>>>>>
>>>>>
>>>>> - Tree View UI for larger DAGs & more consistent spacing in Tree View
>>>>> (#16522)
>>>>>
>>>>>
>>>>> - Correctly handle None returns from Query.scalar() (#16345)
>>>>>
>>>>>
>>>>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>>>>
>>>>>
>>>>> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>>>>>
>>>>>
>>>>> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
>>>>> (#16318)
>>>>>
>>>>>
>>>>> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>>>>>
>>>>>
>>>>> - Queue tasks with higher priority and earlier execution_date first.
>>>>> (#15210)
>>>>>
>>>>>
>>>>> - Make task ID on legend have enough width and width of line chart to
>>>>> be 100%. (#15915)
>>>>>
>>>>>
>>>>> - Fix normalize-url vulnerability (#16375)
>>>>>
>>>>>
>>>>> - Validate retries value on init for better errors (#16415)
>>>>>
>>>>>
>>>>> - add num_runs query param for tree refresh (#16437)
>>>>>
>>>>>
>>>>> - Fix templated default/example values in config ref docs (#16442)
>>>>>
>>>>>
>>>>> - Add ``passphrase`` and ``private_key`` to default sensitive field
>>>>> names (#16392)
>>>>>
>>>>>
>>>>> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>>>>>
>>>>>
>>>>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>>>>
>>>>>
>>>>> - Don't fail to log if we can't redact something (#16118)
>>>>>
>>>>>
>>>>> - Set max tree width to 1200 pixels (#16067)
>>>>>
>>>>>
>>>>> - Fill the "job_id" field for ``airflow task run`` without
>>>>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>>>>
>>>>>
>>>>> - Fixes problem where conf variable was used before initialization
>>>>> (#16088)
>>>>>
>>>>>
>>>>> - Fix apply defaults for task decorator (#16085)
>>>>>
>>>>>
>>>>> - Parse recently modified files even if just parsed (#16075)
>>>>>
>>>>>
>>>>> - Ensure that we don't try to mask empty string in logs (#16057)
>>>>>
>>>>>
>>>>> - Don't die when masking ``log.exception`` when there is no exception
>>>>> (#16047)
>>>>>
>>>>>
>>>>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>>>>
>>>>>
>>>>> - Fix auto-refresh in tree view When webserver ui is not in ``/``
>>>>> (#16018)
>>>>>
>>>>>
>>>>> - Fix dag.clear() to set multiple dags to running when necessary
>>>>> (#15382)
>>>>>
>>>>>
>>>>> - Fix Celery executor getting stuck randomly because of reset_signals
>>>>> in multiprocessing (#15989)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> +48 660 796 129
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> +48 660 796 129
>>>>>
>>>>>
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Xinbin Huang <bi...@gmail.com>.
+1 (non-binding)
On Tue, Jun 29, 2021 at 8:00 AM Jed Cunningham <je...@astronomer.io.invalid>
wrote:
> +1 (non-binding)
>
> On Tue, Jun 29, 2021 at 3:50 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>
>> +1 (binding) because I didn't actually cast it yet :D
>>
>> I think since the CeleryKubernetesExecutor behaviour is not a regression
>> from 2.1.0, combined with Kaxil finding a workaround that it is worth
>> carrying on with the 2.1.1 release, and we will follow up soon-ish with a
>> 2.1.2
>>
>> On Mon, Jun 28 2021 at 09:55:58 -0700, Daniel Standish <
>> dpstandish@gmail.com> wrote:
>>
>> I am not sure if this would block release, but I think
>> CeleryKubernetesExecutor remains broken in this release if this issue is
>> correct:
>> https://github.com/apache/airflow/issues/16326#issuecomment-869597105
>>
>> It was already broken in 2.1.0 so maybe that renders it a non-blocker?
>>
>>
>> On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <el...@apache.org> wrote:
>>
>>> +1 (non-binding)
>>>
>>> On Mon, Jun 28, 2021 at 6:08 PM James Timmins
>>> <ja...@astronomer.io.invalid> wrote:
>>>
>>>> +1 (non-binding)
>>>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>, wrote:
>>>>
>>>> For convenience of people testing the release, I've also pushed
>>>> 2.1.1rc1 docker images to our DockerHub:
>>>>
>>>> Those images are available for everyone to test (they also contain the
>>>> latest provider packages released in June):
>>>>
>>>> docker pull apache/airflow:2.1.1rc1-python3.6
>>>> docker pull apache/airflow:2.1.1rc1-python3.7
>>>> docker pull apache/airflow:2.1.1rc1-python3.8
>>>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>>>
>>>> I am also adding step to make it "default" as part of our release
>>>> process in the future: https://github.com/apache/airflow/pull/16674
>>>>
>>>> J.
>>>>
>>>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>>>> <ep...@gmail.com> wrote:
>>>>
>>>>
>>>> +1 (non-binding)
>>>>
>>>>
>>>>
>>>> From: Jarek Potiuk
>>>> Sent: Saturday, June 26, 2021 11:07 AM
>>>> To: dev@airflow.apache.org
>>>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>>>
>>>>
>>>>
>>>> +1 (binding) - tested signatures/licences/code, installed it in
>>>>
>>>> breeze including all the latest released providers and run a few
>>>>
>>>> workflows. All seems good.
>>>>
>>>>
>>>>
>>>> Two tiny issues:
>>>>
>>>>
>>>>
>>>> * .rat-excludes is missing in the sources. This is quite likely fine
>>>>
>>>> but we need to change our verification instructions a bit to take
>>>>
>>>> .rat-excludes from Airflow sources.
>>>>
>>>> * setup.cfg misses license but I think this might be expected as it is
>>>>
>>>> likely automatically stripped-off any comments (?) - we should add it
>>>>
>>>> to .rat-excludes then.
>>>>
>>>>
>>>>
>>>> J.
>>>>
>>>>
>>>>
>>>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org>
>>>> wrote:
>>>>
>>>>
>>>>
>>>> Hey fellow Airflowers,
>>>>
>>>>
>>>>
>>>>
>>>> (I am sending this on behalf of James, as timezones are tricky and he
>>>> is not yet a PMC member so cannot sign the release himself.)
>>>>
>>>>
>>>>
>>>>
>>>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
>>>> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
>>>> 06:30am UTC or until 3 binding +1 votes have been received.
>>>>
>>>>
>>>>
>>>>
>>>> Consider this my [James] (non-binding) +1. As I’m not a member of the
>>>> PMC, Ash signed the distribution.
>>>>
>>>>
>>>>
>>>>
>>>> Airflow 2.1.1 RC1 is available at:
>>>> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>>>>
>>>>
>>>>
>>>>
>>>> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
>>>> INSTALL instructions.
>>>>
>>>>
>>>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>>>>
>>>>
>>>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
>>>> "binary" release.
>>>>
>>>>
>>>>
>>>>
>>>> Public keys are available at:
>>>>
>>>>
>>>> https://dist.apache.org/repos/dist/release/airflow/KEYS
>>>>
>>>>
>>>>
>>>>
>>>> Only votes from PMC members are binding, but all members of the
>>>> community are encouraged to test the release and vote with "(non-binding)".
>>>>
>>>>
>>>>
>>>>
>>>> The test procedure for PMCs and Contributors who would like to test
>>>> this RC are described in
>>>>
>>>>
>>>>
>>>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>>>>
>>>>
>>>>
>>>>
>>>> Please note that the version number excludes the `rcX` string, so it's
>>>> now
>>>>
>>>>
>>>> simply 2.1.1. This will allow us to rename the artifact without
>>>> modifying
>>>>
>>>>
>>>> the artifact checksums when we actually release.
>>>>
>>>>
>>>>
>>>>
>>>> Changes since 2.1.1 below.
>>>>
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>>
>>>> James
>>>>
>>>>
>>>>
>>>>
>>>> Bug Fixes
>>>>
>>>>
>>>> """""""""
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> - Don't crash attempting to mask secrets in dict with non-string keys
>>>> (#16601)
>>>>
>>>>
>>>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>>>
>>>>
>>>> - Remove limitation for elasticsearch library (#16553)
>>>>
>>>>
>>>> - Adding extra requirements for build and runtime of the PROD image.
>>>> (#16170)
>>>>
>>>>
>>>> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage
>>>> (#16173)
>>>>
>>>>
>>>> - Removes unnecessary packages from setup_requires (#16139)
>>>>
>>>>
>>>> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>>>>
>>>>
>>>> - Improvements for Docker Image docs (#14843)
>>>>
>>>>
>>>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>>>
>>>>
>>>> - Fix CLI connections import and migrate logic from secrets to
>>>> Connection model (#15425)
>>>>
>>>>
>>>> - Fix Dag Details start date bug (#16206)
>>>>
>>>>
>>>> - Fix DAG run state not updated while DAG is paused (#16343)
>>>>
>>>>
>>>> - Allow null value for operator field in task_instance schema(REST API)
>>>> (#16516)
>>>>
>>>>
>>>> - Avoid recursion going too deep when redacting logs (#16491)
>>>>
>>>>
>>>> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>>>>
>>>>
>>>> - Tree View UI for larger DAGs & more consistent spacing in Tree View
>>>> (#16522)
>>>>
>>>>
>>>> - Correctly handle None returns from Query.scalar() (#16345)
>>>>
>>>>
>>>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>>>
>>>>
>>>> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>>>>
>>>>
>>>> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
>>>> (#16318)
>>>>
>>>>
>>>> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>>>>
>>>>
>>>> - Queue tasks with higher priority and earlier execution_date first.
>>>> (#15210)
>>>>
>>>>
>>>> - Make task ID on legend have enough width and width of line chart to
>>>> be 100%. (#15915)
>>>>
>>>>
>>>> - Fix normalize-url vulnerability (#16375)
>>>>
>>>>
>>>> - Validate retries value on init for better errors (#16415)
>>>>
>>>>
>>>> - add num_runs query param for tree refresh (#16437)
>>>>
>>>>
>>>> - Fix templated default/example values in config ref docs (#16442)
>>>>
>>>>
>>>> - Add ``passphrase`` and ``private_key`` to default sensitive field
>>>> names (#16392)
>>>>
>>>>
>>>> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>>>>
>>>>
>>>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>>>
>>>>
>>>> - Don't fail to log if we can't redact something (#16118)
>>>>
>>>>
>>>> - Set max tree width to 1200 pixels (#16067)
>>>>
>>>>
>>>> - Fill the "job_id" field for ``airflow task run`` without
>>>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>>>
>>>>
>>>> - Fixes problem where conf variable was used before initialization
>>>> (#16088)
>>>>
>>>>
>>>> - Fix apply defaults for task decorator (#16085)
>>>>
>>>>
>>>> - Parse recently modified files even if just parsed (#16075)
>>>>
>>>>
>>>> - Ensure that we don't try to mask empty string in logs (#16057)
>>>>
>>>>
>>>> - Don't die when masking ``log.exception`` when there is no exception
>>>> (#16047)
>>>>
>>>>
>>>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>>>
>>>>
>>>> - Fix auto-refresh in tree view When webserver ui is not in ``/``
>>>> (#16018)
>>>>
>>>>
>>>> - Fix dag.clear() to set multiple dags to running when necessary
>>>> (#15382)
>>>>
>>>>
>>>> - Fix Celery executor getting stuck randomly because of reset_signals
>>>> in multiprocessing (#15989)
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> +48 660 796 129
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> +48 660 796 129
>>>>
>>>>
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Jed Cunningham <je...@astronomer.io.INVALID>.
+1 (non-binding)
On Tue, Jun 29, 2021 at 3:50 AM Ash Berlin-Taylor <as...@apache.org> wrote:
> +1 (binding) because I didn't actually cast it yet :D
>
> I think since the CeleryKubernetesExecutor behaviour is not a regression
> from 2.1.0, combined with Kaxil finding a workaround that it is worth
> carrying on with the 2.1.1 release, and we will follow up soon-ish with a
> 2.1.2
>
> On Mon, Jun 28 2021 at 09:55:58 -0700, Daniel Standish <
> dpstandish@gmail.com> wrote:
>
> I am not sure if this would block release, but I think
> CeleryKubernetesExecutor remains broken in this release if this issue is
> correct:
> https://github.com/apache/airflow/issues/16326#issuecomment-869597105
>
> It was already broken in 2.1.0 so maybe that renders it a non-blocker?
>
>
> On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <el...@apache.org> wrote:
>
>> +1 (non-binding)
>>
>> On Mon, Jun 28, 2021 at 6:08 PM James Timmins <ja...@astronomer.io.invalid>
>> wrote:
>>
>>> +1 (non-binding)
>>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>, wrote:
>>>
>>> For convenience of people testing the release, I've also pushed
>>> 2.1.1rc1 docker images to our DockerHub:
>>>
>>> Those images are available for everyone to test (they also contain the
>>> latest provider packages released in June):
>>>
>>> docker pull apache/airflow:2.1.1rc1-python3.6
>>> docker pull apache/airflow:2.1.1rc1-python3.7
>>> docker pull apache/airflow:2.1.1rc1-python3.8
>>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>>
>>> I am also adding step to make it "default" as part of our release
>>> process in the future: https://github.com/apache/airflow/pull/16674
>>>
>>> J.
>>>
>>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>>> <ep...@gmail.com> wrote:
>>>
>>>
>>> +1 (non-binding)
>>>
>>>
>>>
>>> From: Jarek Potiuk
>>> Sent: Saturday, June 26, 2021 11:07 AM
>>> To: dev@airflow.apache.org
>>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>>
>>>
>>>
>>> +1 (binding) - tested signatures/licences/code, installed it in
>>>
>>> breeze including all the latest released providers and run a few
>>>
>>> workflows. All seems good.
>>>
>>>
>>>
>>> Two tiny issues:
>>>
>>>
>>>
>>> * .rat-excludes is missing in the sources. This is quite likely fine
>>>
>>> but we need to change our verification instructions a bit to take
>>>
>>> .rat-excludes from Airflow sources.
>>>
>>> * setup.cfg misses license but I think this might be expected as it is
>>>
>>> likely automatically stripped-off any comments (?) - we should add it
>>>
>>> to .rat-excludes then.
>>>
>>>
>>>
>>> J.
>>>
>>>
>>>
>>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org>
>>> wrote:
>>>
>>>
>>>
>>> Hey fellow Airflowers,
>>>
>>>
>>>
>>>
>>> (I am sending this on behalf of James, as timezones are tricky and he is
>>> not yet a PMC member so cannot sign the release himself.)
>>>
>>>
>>>
>>>
>>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
>>> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
>>> 06:30am UTC or until 3 binding +1 votes have been received.
>>>
>>>
>>>
>>>
>>> Consider this my [James] (non-binding) +1. As I’m not a member of the
>>> PMC, Ash signed the distribution.
>>>
>>>
>>>
>>>
>>> Airflow 2.1.1 RC1 is available at:
>>> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>>>
>>>
>>>
>>>
>>> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
>>> INSTALL instructions.
>>>
>>>
>>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>>>
>>>
>>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
>>> "binary" release.
>>>
>>>
>>>
>>>
>>> Public keys are available at:
>>>
>>>
>>> https://dist.apache.org/repos/dist/release/airflow/KEYS
>>>
>>>
>>>
>>>
>>> Only votes from PMC members are binding, but all members of the
>>> community are encouraged to test the release and vote with "(non-binding)".
>>>
>>>
>>>
>>>
>>> The test procedure for PMCs and Contributors who would like to test this
>>> RC are described in
>>>
>>>
>>>
>>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>>>
>>>
>>>
>>>
>>> Please note that the version number excludes the `rcX` string, so it's
>>> now
>>>
>>>
>>> simply 2.1.1. This will allow us to rename the artifact without modifying
>>>
>>>
>>> the artifact checksums when we actually release.
>>>
>>>
>>>
>>>
>>> Changes since 2.1.1 below.
>>>
>>>
>>>
>>>
>>> Thanks,
>>>
>>>
>>> James
>>>
>>>
>>>
>>>
>>> Bug Fixes
>>>
>>>
>>> """""""""
>>>
>>>
>>>
>>>
>>>
>>>
>>> - Don't crash attempting to mask secrets in dict with non-string keys
>>> (#16601)
>>>
>>>
>>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>>
>>>
>>> - Remove limitation for elasticsearch library (#16553)
>>>
>>>
>>> - Adding extra requirements for build and runtime of the PROD image.
>>> (#16170)
>>>
>>>
>>> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage
>>> (#16173)
>>>
>>>
>>> - Removes unnecessary packages from setup_requires (#16139)
>>>
>>>
>>> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>>>
>>>
>>> - Improvements for Docker Image docs (#14843)
>>>
>>>
>>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>>
>>>
>>> - Fix CLI connections import and migrate logic from secrets to
>>> Connection model (#15425)
>>>
>>>
>>> - Fix Dag Details start date bug (#16206)
>>>
>>>
>>> - Fix DAG run state not updated while DAG is paused (#16343)
>>>
>>>
>>> - Allow null value for operator field in task_instance schema(REST API)
>>> (#16516)
>>>
>>>
>>> - Avoid recursion going too deep when redacting logs (#16491)
>>>
>>>
>>> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>>>
>>>
>>> - Tree View UI for larger DAGs & more consistent spacing in Tree View
>>> (#16522)
>>>
>>>
>>> - Correctly handle None returns from Query.scalar() (#16345)
>>>
>>>
>>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>>
>>>
>>> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>>>
>>>
>>> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
>>> (#16318)
>>>
>>>
>>> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>>>
>>>
>>> - Queue tasks with higher priority and earlier execution_date first.
>>> (#15210)
>>>
>>>
>>> - Make task ID on legend have enough width and width of line chart to be
>>> 100%. (#15915)
>>>
>>>
>>> - Fix normalize-url vulnerability (#16375)
>>>
>>>
>>> - Validate retries value on init for better errors (#16415)
>>>
>>>
>>> - add num_runs query param for tree refresh (#16437)
>>>
>>>
>>> - Fix templated default/example values in config ref docs (#16442)
>>>
>>>
>>> - Add ``passphrase`` and ``private_key`` to default sensitive field
>>> names (#16392)
>>>
>>>
>>> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>>>
>>>
>>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>>
>>>
>>> - Don't fail to log if we can't redact something (#16118)
>>>
>>>
>>> - Set max tree width to 1200 pixels (#16067)
>>>
>>>
>>> - Fill the "job_id" field for ``airflow task run`` without
>>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>>
>>>
>>> - Fixes problem where conf variable was used before initialization
>>> (#16088)
>>>
>>>
>>> - Fix apply defaults for task decorator (#16085)
>>>
>>>
>>> - Parse recently modified files even if just parsed (#16075)
>>>
>>>
>>> - Ensure that we don't try to mask empty string in logs (#16057)
>>>
>>>
>>> - Don't die when masking ``log.exception`` when there is no exception
>>> (#16047)
>>>
>>>
>>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>>
>>>
>>> - Fix auto-refresh in tree view When webserver ui is not in ``/``
>>> (#16018)
>>>
>>>
>>> - Fix dag.clear() to set multiple dags to running when necessary (#15382)
>>>
>>>
>>> - Fix Celery executor getting stuck randomly because of reset_signals in
>>> multiprocessing (#15989)
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>> +48 660 796 129
>>>
>>>
>>>
>>>
>>>
>>> --
>>> +48 660 796 129
>>>
>>>
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Ash Berlin-Taylor <as...@apache.org>.
+1 (binding) because I didn't actually cast it yet :D
I think since the CeleryKubernetesExecutor behaviour is not a
regression from 2.1.0, combined with Kaxil finding a workaround that it
is worth carrying on with the 2.1.1 release, and we will follow up
soon-ish with a 2.1.2
On Mon, Jun 28 2021 at 09:55:58 -0700, Daniel Standish
<dp...@gmail.com> wrote:
> I am not sure if this would block release, but I think
> CeleryKubernetesExecutor remains broken in this release if this issue
> is correct:
> <https://github.com/apache/airflow/issues/16326#issuecomment-869597105>
>
> It was already broken in 2.1.0 so maybe that renders it a non-blocker?
>
>
> On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <eladkal@apache.org
> <ma...@apache.org>> wrote:
>> +1 (non-binding)
>>
>> On Mon, Jun 28, 2021 at 6:08 PM James Timmins
>> <ja...@astronomer.io.invalid> wrote:
>>> +1 (non-binding)
>>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <jarek@potiuk.com
>>> <ma...@potiuk.com>>, wrote:
>>>> For convenience of people testing the release, I've also pushed
>>>> 2.1.1rc1 docker images to our DockerHub:
>>>>
>>>> Those images are available for everyone to test (they also
>>>> contain the
>>>> latest provider packages released in June):
>>>>
>>>> docker pull apache/airflow:2.1.1rc1-python3.6
>>>> docker pull apache/airflow:2.1.1rc1-python3.7
>>>> docker pull apache/airflow:2.1.1rc1-python3.8
>>>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>>>
>>>> I am also adding step to make it "default" as part of our release
>>>> process in the future:
>>>> <https://github.com/apache/airflow/pull/16674>
>>>>
>>>> J.
>>>>
>>>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>>>> <ephraimanierobi@gmail.com <ma...@gmail.com>>
>>>> wrote:
>>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>>
>>>>>
>>>>> From: Jarek Potiuk
>>>>> Sent: Saturday, June 26, 2021 11:07 AM
>>>>> To: dev@airflow.apache.org <ma...@airflow.apache.org>
>>>>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>>>>
>>>>>
>>>>>
>>>>> +1 (binding) - tested signatures/licences/code, installed it in
>>>>>
>>>>> breeze including all the latest released providers and run a few
>>>>>
>>>>> workflows. All seems good.
>>>>>
>>>>>
>>>>>
>>>>> Two tiny issues:
>>>>>
>>>>>
>>>>>
>>>>> * .rat-excludes is missing in the sources. This is quite likely
>>>>> fine
>>>>>
>>>>> but we need to change our verification instructions a bit to take
>>>>>
>>>>> .rat-excludes from Airflow sources.
>>>>>
>>>>> * setup.cfg misses license but I think this might be expected as
>>>>> it is
>>>>>
>>>>> likely automatically stripped-off any comments (?) - we should
>>>>> add it
>>>>>
>>>>> to .rat-excludes then.
>>>>>
>>>>>
>>>>>
>>>>> J.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor
>>>>> <ash@apache.org <ma...@apache.org>> wrote:
>>>>>
>>>>>>
>>>>>
>>>>>> Hey fellow Airflowers,
>>>>>
>>>>>>
>>>>>
>>>>>> (I am sending this on behalf of James, as timezones are tricky
>>>>>> and he is not yet a PMC member so cannot sign the release
>>>>>> himself.)
>>>>>
>>>>>>
>>>>>
>>>>>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote
>>>>>> on the release, which will last for 72 hours, from Tuesday, June
>>>>>> 29, 2021 at 06:30am UTC or until 3 binding +1 votes have been
>>>>>> received.
>>>>>
>>>>>>
>>>>>
>>>>>> Consider this my [James] (non-binding) +1. As I’m not a member
>>>>>> of the PMC, Ash signed the distribution.
>>>>>
>>>>>>
>>>>>
>>>>>> Airflow 2.1.1 RC1 is available at:
>>>>>> <https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/>
>>>>>
>>>>>>
>>>>>
>>>>>> apache-airflow-2.1.1-source.tar.gz is a source release that
>>>>>> comes with INSTALL instructions.
>>>>>
>>>>>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist"
>>>>>> release.
>>>>>
>>>>>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
>>>>>> "binary" release.
>>>>>
>>>>>>
>>>>>
>>>>>> Public keys are available at:
>>>>>
>>>>>> <https://dist.apache.org/repos/dist/release/airflow/KEYS>
>>>>>
>>>>>>
>>>>>
>>>>>> Only votes from PMC members are binding, but all members of the
>>>>>> community are encouraged to test the release and vote with
>>>>>> "(non-binding)".
>>>>>
>>>>>>
>>>>>
>>>>>> The test procedure for PMCs and Contributors who would like to
>>>>>> test this RC are described in
>>>>>
>>>>>> <https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs>
>>>>>
>>>>>>
>>>>>
>>>>>> Please note that the version number excludes the `rcX` string,
>>>>>> so it's now
>>>>>
>>>>>> simply 2.1.1. This will allow us to rename the artifact without
>>>>>> modifying
>>>>>
>>>>>> the artifact checksums when we actually release.
>>>>>
>>>>>>
>>>>>
>>>>>> Changes since 2.1.1 below.
>>>>>
>>>>>>
>>>>>
>>>>>> Thanks,
>>>>>
>>>>>> James
>>>>>
>>>>>>
>>>>>
>>>>>> Bug Fixes
>>>>>
>>>>>> """""""""
>>>>>
>>>>>>
>>>>>
>>>>>>
>>>>>
>>>>>> - Don't crash attempting to mask secrets in dict with non-string
>>>>>> keys (#16601)
>>>>>
>>>>>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>>>>
>>>>>> - Remove limitation for elasticsearch library (#16553)
>>>>>
>>>>>> - Adding extra requirements for build and runtime of the PROD
>>>>>> image. (#16170)
>>>>>
>>>>>> - Cattrs 1.7.0 released by the end of May 2021 break lineage
>>>>>> usage (#16173)
>>>>>
>>>>>> - Removes unnecessary packages from setup_requires (#16139)
>>>>>
>>>>>> - Pins docutils to <0.17 until breaking behaviour is fixed
>>>>>> (#16133)
>>>>>
>>>>>> - Improvements for Docker Image docs (#14843)
>>>>>
>>>>>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>>>>
>>>>>> - Fix CLI connections import and migrate logic from secrets to
>>>>>> Connection model (#15425)
>>>>>
>>>>>> - Fix Dag Details start date bug (#16206)
>>>>>
>>>>>> - Fix DAG run state not updated while DAG is paused (#16343)
>>>>>
>>>>>> - Allow null value for operator field in task_instance
>>>>>> schema(REST API) (#16516)
>>>>>
>>>>>> - Avoid recursion going too deep when redacting logs (#16491)
>>>>>
>>>>>> - Backfill: Don't create a DagRun if no tasks match task regex
>>>>>> (#16461)
>>>>>
>>>>>> - Tree View UI for larger DAGs & more consistent spacing in Tree
>>>>>> View (#16522)
>>>>>
>>>>>> - Correctly handle None returns from Query.scalar() (#16345)
>>>>>
>>>>>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>>>>
>>>>>> - Don't show stale Serialized DAGs if they are deleted in DB
>>>>>> (#16368)
>>>>>
>>>>>> - Make REST API List DAGs endpoint consistent with UI/CLI
>>>>>> behaviour (#16318)
>>>>>
>>>>>> - Support remote logging in elasticsearch with ``filebeat 7``
>>>>>> (#14625)
>>>>>
>>>>>> - Queue tasks with higher priority and earlier execution_date
>>>>>> first. (#15210)
>>>>>
>>>>>> - Make task ID on legend have enough width and width of line
>>>>>> chart to be 100%. (#15915)
>>>>>
>>>>>> - Fix normalize-url vulnerability (#16375)
>>>>>
>>>>>> - Validate retries value on init for better errors (#16415)
>>>>>
>>>>>> - add num_runs query param for tree refresh (#16437)
>>>>>
>>>>>> - Fix templated default/example values in config ref docs
>>>>>> (#16442)
>>>>>
>>>>>> - Add ``passphrase`` and ``private_key`` to default sensitive
>>>>>> field names (#16392)
>>>>>
>>>>>> - Fix tasks in an infinite slots pool were never scheduled
>>>>>> (#15247)
>>>>>
>>>>>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>>>>
>>>>>> - Don't fail to log if we can't redact something (#16118)
>>>>>
>>>>>> - Set max tree width to 1200 pixels (#16067)
>>>>>
>>>>>> - Fill the "job_id" field for ``airflow task run`` without
>>>>>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>>>>
>>>>>> - Fixes problem where conf variable was used before
>>>>>> initialization (#16088)
>>>>>
>>>>>> - Fix apply defaults for task decorator (#16085)
>>>>>
>>>>>> - Parse recently modified files even if just parsed (#16075)
>>>>>
>>>>>> - Ensure that we don't try to mask empty string in logs (#16057)
>>>>>
>>>>>> - Don't die when masking ``log.exception`` when there is no
>>>>>> exception (#16047)
>>>>>
>>>>>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>>>>
>>>>>> - Fix auto-refresh in tree view When webserver ui is not in
>>>>>> ``/`` (#16018)
>>>>>
>>>>>> - Fix dag.clear() to set multiple dags to running when necessary
>>>>>> (#15382)
>>>>>
>>>>>> - Fix Celery executor getting stuck randomly because of
>>>>>> reset_signals in multiprocessing (#15989)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> +48 660 796 129
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> +48 660 796 129
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Daniel Standish <dp...@gmail.com>.
I am not sure if this would block release, but I think
CeleryKubernetesExecutor remains broken in this release if this issue is
correct:
https://github.com/apache/airflow/issues/16326#issuecomment-869597105
It was already broken in 2.1.0 so maybe that renders it a non-blocker?
On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <el...@apache.org> wrote:
> +1 (non-binding)
>
> On Mon, Jun 28, 2021 at 6:08 PM James Timmins <ja...@astronomer.io.invalid>
> wrote:
>
>> +1 (non-binding)
>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>, wrote:
>>
>> For convenience of people testing the release, I've also pushed
>> 2.1.1rc1 docker images to our DockerHub:
>>
>> Those images are available for everyone to test (they also contain the
>> latest provider packages released in June):
>>
>> docker pull apache/airflow:2.1.1rc1-python3.6
>> docker pull apache/airflow:2.1.1rc1-python3.7
>> docker pull apache/airflow:2.1.1rc1-python3.8
>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>
>> I am also adding step to make it "default" as part of our release
>> process in the future: https://github.com/apache/airflow/pull/16674
>>
>> J.
>>
>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>> <ep...@gmail.com> wrote:
>>
>>
>> +1 (non-binding)
>>
>>
>>
>> From: Jarek Potiuk
>> Sent: Saturday, June 26, 2021 11:07 AM
>> To: dev@airflow.apache.org
>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>
>>
>>
>> +1 (binding) - tested signatures/licences/code, installed it in
>>
>> breeze including all the latest released providers and run a few
>>
>> workflows. All seems good.
>>
>>
>>
>> Two tiny issues:
>>
>>
>>
>> * .rat-excludes is missing in the sources. This is quite likely fine
>>
>> but we need to change our verification instructions a bit to take
>>
>> .rat-excludes from Airflow sources.
>>
>> * setup.cfg misses license but I think this might be expected as it is
>>
>> likely automatically stripped-off any comments (?) - we should add it
>>
>> to .rat-excludes then.
>>
>>
>>
>> J.
>>
>>
>>
>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>>
>>
>>
>> Hey fellow Airflowers,
>>
>>
>>
>>
>> (I am sending this on behalf of James, as timezones are tricky and he is
>> not yet a PMC member so cannot sign the release himself.)
>>
>>
>>
>>
>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
>> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
>> 06:30am UTC or until 3 binding +1 votes have been received.
>>
>>
>>
>>
>> Consider this my [James] (non-binding) +1. As I’m not a member of the
>> PMC, Ash signed the distribution.
>>
>>
>>
>>
>> Airflow 2.1.1 RC1 is available at:
>> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>>
>>
>>
>>
>> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
>> INSTALL instructions.
>>
>>
>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>>
>>
>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary"
>> release.
>>
>>
>>
>>
>> Public keys are available at:
>>
>>
>> https://dist.apache.org/repos/dist/release/airflow/KEYS
>>
>>
>>
>>
>> Only votes from PMC members are binding, but all members of the community
>> are encouraged to test the release and vote with "(non-binding)".
>>
>>
>>
>>
>> The test procedure for PMCs and Contributors who would like to test this
>> RC are described in
>>
>>
>>
>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>>
>>
>>
>>
>> Please note that the version number excludes the `rcX` string, so it's now
>>
>>
>> simply 2.1.1. This will allow us to rename the artifact without modifying
>>
>>
>> the artifact checksums when we actually release.
>>
>>
>>
>>
>> Changes since 2.1.1 below.
>>
>>
>>
>>
>> Thanks,
>>
>>
>> James
>>
>>
>>
>>
>> Bug Fixes
>>
>>
>> """""""""
>>
>>
>>
>>
>>
>>
>> - Don't crash attempting to mask secrets in dict with non-string keys
>> (#16601)
>>
>>
>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>
>>
>> - Remove limitation for elasticsearch library (#16553)
>>
>>
>> - Adding extra requirements for build and runtime of the PROD image.
>> (#16170)
>>
>>
>> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage
>> (#16173)
>>
>>
>> - Removes unnecessary packages from setup_requires (#16139)
>>
>>
>> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>>
>>
>> - Improvements for Docker Image docs (#14843)
>>
>>
>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>
>>
>> - Fix CLI connections import and migrate logic from secrets to Connection
>> model (#15425)
>>
>>
>> - Fix Dag Details start date bug (#16206)
>>
>>
>> - Fix DAG run state not updated while DAG is paused (#16343)
>>
>>
>> - Allow null value for operator field in task_instance schema(REST API)
>> (#16516)
>>
>>
>> - Avoid recursion going too deep when redacting logs (#16491)
>>
>>
>> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>>
>>
>> - Tree View UI for larger DAGs & more consistent spacing in Tree View
>> (#16522)
>>
>>
>> - Correctly handle None returns from Query.scalar() (#16345)
>>
>>
>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>
>>
>> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>>
>>
>> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
>> (#16318)
>>
>>
>> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>>
>>
>> - Queue tasks with higher priority and earlier execution_date first.
>> (#15210)
>>
>>
>> - Make task ID on legend have enough width and width of line chart to be
>> 100%. (#15915)
>>
>>
>> - Fix normalize-url vulnerability (#16375)
>>
>>
>> - Validate retries value on init for better errors (#16415)
>>
>>
>> - add num_runs query param for tree refresh (#16437)
>>
>>
>> - Fix templated default/example values in config ref docs (#16442)
>>
>>
>> - Add ``passphrase`` and ``private_key`` to default sensitive field names
>> (#16392)
>>
>>
>> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>>
>>
>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>
>>
>> - Don't fail to log if we can't redact something (#16118)
>>
>>
>> - Set max tree width to 1200 pixels (#16067)
>>
>>
>> - Fill the "job_id" field for ``airflow task run`` without
>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>
>>
>> - Fixes problem where conf variable was used before initialization
>> (#16088)
>>
>>
>> - Fix apply defaults for task decorator (#16085)
>>
>>
>> - Parse recently modified files even if just parsed (#16075)
>>
>>
>> - Ensure that we don't try to mask empty string in logs (#16057)
>>
>>
>> - Don't die when masking ``log.exception`` when there is no exception
>> (#16047)
>>
>>
>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>
>>
>> - Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
>>
>>
>> - Fix dag.clear() to set multiple dags to running when necessary (#15382)
>>
>>
>> - Fix Celery executor getting stuck randomly because of reset_signals in
>> multiprocessing (#15989)
>>
>>
>>
>>
>>
>>
>>
>>
>> --
>>
>> +48 660 796 129
>>
>>
>>
>>
>>
>> --
>> +48 660 796 129
>>
>>
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Elad Kalif <el...@apache.org>.
+1 (non-binding)
On Mon, Jun 28, 2021 at 6:08 PM James Timmins <ja...@astronomer.io.invalid>
wrote:
> +1 (non-binding)
> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>, wrote:
>
> For convenience of people testing the release, I've also pushed
> 2.1.1rc1 docker images to our DockerHub:
>
> Those images are available for everyone to test (they also contain the
> latest provider packages released in June):
>
> docker pull apache/airflow:2.1.1rc1-python3.6
> docker pull apache/airflow:2.1.1rc1-python3.7
> docker pull apache/airflow:2.1.1rc1-python3.8
> docker pull apache/airflow:2.1.1rc1 # python 3.6
>
> I am also adding step to make it "default" as part of our release
> process in the future: https://github.com/apache/airflow/pull/16674
>
> J.
>
> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
> <ep...@gmail.com> wrote:
>
>
> +1 (non-binding)
>
>
>
> From: Jarek Potiuk
> Sent: Saturday, June 26, 2021 11:07 AM
> To: dev@airflow.apache.org
> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>
>
>
> +1 (binding) - tested signatures/licences/code, installed it in
>
> breeze including all the latest released providers and run a few
>
> workflows. All seems good.
>
>
>
> Two tiny issues:
>
>
>
> * .rat-excludes is missing in the sources. This is quite likely fine
>
> but we need to change our verification instructions a bit to take
>
> .rat-excludes from Airflow sources.
>
> * setup.cfg misses license but I think this might be expected as it is
>
> likely automatically stripped-off any comments (?) - we should add it
>
> to .rat-excludes then.
>
>
>
> J.
>
>
>
> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>
>
>
> Hey fellow Airflowers,
>
>
>
>
> (I am sending this on behalf of James, as timezones are tricky and he is
> not yet a PMC member so cannot sign the release himself.)
>
>
>
>
> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
> 06:30am UTC or until 3 binding +1 votes have been received.
>
>
>
>
> Consider this my [James] (non-binding) +1. As I’m not a member of the PMC,
> Ash signed the distribution.
>
>
>
>
> Airflow 2.1.1 RC1 is available at:
> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>
>
>
>
> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
> INSTALL instructions.
>
>
> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>
>
> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary"
> release.
>
>
>
>
> Public keys are available at:
>
>
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
>
>
>
> Only votes from PMC members are binding, but all members of the community
> are encouraged to test the release and vote with "(non-binding)".
>
>
>
>
> The test procedure for PMCs and Contributors who would like to test this
> RC are described in
>
>
>
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>
>
>
>
> Please note that the version number excludes the `rcX` string, so it's now
>
>
> simply 2.1.1. This will allow us to rename the artifact without modifying
>
>
> the artifact checksums when we actually release.
>
>
>
>
> Changes since 2.1.1 below.
>
>
>
>
> Thanks,
>
>
> James
>
>
>
>
> Bug Fixes
>
>
> """""""""
>
>
>
>
>
>
> - Don't crash attempting to mask secrets in dict with non-string keys
> (#16601)
>
>
> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>
>
> - Remove limitation for elasticsearch library (#16553)
>
>
> - Adding extra requirements for build and runtime of the PROD image.
> (#16170)
>
>
> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
>
>
> - Removes unnecessary packages from setup_requires (#16139)
>
>
> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>
>
> - Improvements for Docker Image docs (#14843)
>
>
> - Ensure that ``dag_run.conf`` is a dict (#15057)
>
>
> - Fix CLI connections import and migrate logic from secrets to Connection
> model (#15425)
>
>
> - Fix Dag Details start date bug (#16206)
>
>
> - Fix DAG run state not updated while DAG is paused (#16343)
>
>
> - Allow null value for operator field in task_instance schema(REST API)
> (#16516)
>
>
> - Avoid recursion going too deep when redacting logs (#16491)
>
>
> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>
>
> - Tree View UI for larger DAGs & more consistent spacing in Tree View
> (#16522)
>
>
> - Correctly handle None returns from Query.scalar() (#16345)
>
>
> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>
>
> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>
>
> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
> (#16318)
>
>
> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>
>
> - Queue tasks with higher priority and earlier execution_date first.
> (#15210)
>
>
> - Make task ID on legend have enough width and width of line chart to be
> 100%. (#15915)
>
>
> - Fix normalize-url vulnerability (#16375)
>
>
> - Validate retries value on init for better errors (#16415)
>
>
> - add num_runs query param for tree refresh (#16437)
>
>
> - Fix templated default/example values in config ref docs (#16442)
>
>
> - Add ``passphrase`` and ``private_key`` to default sensitive field names
> (#16392)
>
>
> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>
>
> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>
>
> - Don't fail to log if we can't redact something (#16118)
>
>
> - Set max tree width to 1200 pixels (#16067)
>
>
> - Fill the "job_id" field for ``airflow task run`` without
> ``--local``/``--raw`` for KubeExecutor (#16108)
>
>
> - Fixes problem where conf variable was used before initialization (#16088)
>
>
> - Fix apply defaults for task decorator (#16085)
>
>
> - Parse recently modified files even if just parsed (#16075)
>
>
> - Ensure that we don't try to mask empty string in logs (#16057)
>
>
> - Don't die when masking ``log.exception`` when there is no exception
> (#16047)
>
>
> - Restores apply_defaults import in base_sensor_operator (#16040)
>
>
> - Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
>
>
> - Fix dag.clear() to set multiple dags to running when necessary (#15382)
>
>
> - Fix Celery executor getting stuck randomly because of reset_signals in
> multiprocessing (#15989)
>
>
>
>
>
>
>
>
> --
>
> +48 660 796 129
>
>
>
>
>
> --
> +48 660 796 129
>
>
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by James Timmins <ja...@astronomer.io.INVALID>.
+1 (non-binding)
On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>, wrote:
> For convenience of people testing the release, I've also pushed
> 2.1.1rc1 docker images to our DockerHub:
>
> Those images are available for everyone to test (they also contain the
> latest provider packages released in June):
>
> docker pull apache/airflow:2.1.1rc1-python3.6
> docker pull apache/airflow:2.1.1rc1-python3.7
> docker pull apache/airflow:2.1.1rc1-python3.8
> docker pull apache/airflow:2.1.1rc1 # python 3.6
>
> I am also adding step to make it "default" as part of our release
> process in the future: https://github.com/apache/airflow/pull/16674
>
> J.
>
> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
> <ep...@gmail.com> wrote:
> >
> > +1 (non-binding)
> >
> >
> >
> > From: Jarek Potiuk
> > Sent: Saturday, June 26, 2021 11:07 AM
> > To: dev@airflow.apache.org
> > Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
> >
> >
> >
> > +1 (binding) - tested signatures/licences/code, installed it in
> >
> > breeze including all the latest released providers and run a few
> >
> > workflows. All seems good.
> >
> >
> >
> > Two tiny issues:
> >
> >
> >
> > * .rat-excludes is missing in the sources. This is quite likely fine
> >
> > but we need to change our verification instructions a bit to take
> >
> > .rat-excludes from Airflow sources.
> >
> > * setup.cfg misses license but I think this might be expected as it is
> >
> > likely automatically stripped-off any comments (?) - we should add it
> >
> > to .rat-excludes then.
> >
> >
> >
> > J.
> >
> >
> >
> > On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
> >
> > >
> >
> > > Hey fellow Airflowers,
> >
> > >
> >
> > > (I am sending this on behalf of James, as timezones are tricky and he is not yet a PMC member so cannot sign the release himself.)
> >
> > >
> >
> > > We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the release, which will last for 72 hours, from Tuesday, June 29, 2021 at 06:30am UTC or until 3 binding +1 votes have been received.
> >
> > >
> >
> > > Consider this my [James] (non-binding) +1. As I’m not a member of the PMC, Ash signed the distribution.
> >
> > >
> >
> > > Airflow 2.1.1 RC1 is available at: https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
> >
> > >
> >
> > > apache-airflow-2.1.1-source.tar.gz is a source release that comes with INSTALL instructions.
> >
> > > apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
> >
> > > apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary" release.
> >
> > >
> >
> > > Public keys are available at:
> >
> > > https://dist.apache.org/repos/dist/release/airflow/KEYS
> >
> > >
> >
> > > Only votes from PMC members are binding, but all members of the community are encouraged to test the release and vote with "(non-binding)".
> >
> > >
> >
> > > The test procedure for PMCs and Contributors who would like to test this RC are described in
> >
> > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
> >
> > >
> >
> > > Please note that the version number excludes the `rcX` string, so it's now
> >
> > > simply 2.1.1. This will allow us to rename the artifact without modifying
> >
> > > the artifact checksums when we actually release.
> >
> > >
> >
> > > Changes since 2.1.1 below.
> >
> > >
> >
> > > Thanks,
> >
> > > James
> >
> > >
> >
> > > Bug Fixes
> >
> > > """""""""
> >
> > >
> >
> > >
> >
> > > - Don't crash attempting to mask secrets in dict with non-string keys (#16601)
> >
> > > - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
> >
> > > - Remove limitation for elasticsearch library (#16553)
> >
> > > - Adding extra requirements for build and runtime of the PROD image. (#16170)
> >
> > > - Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
> >
> > > - Removes unnecessary packages from setup_requires (#16139)
> >
> > > - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
> >
> > > - Improvements for Docker Image docs (#14843)
> >
> > > - Ensure that ``dag_run.conf`` is a dict (#15057)
> >
> > > - Fix CLI connections import and migrate logic from secrets to Connection model (#15425)
> >
> > > - Fix Dag Details start date bug (#16206)
> >
> > > - Fix DAG run state not updated while DAG is paused (#16343)
> >
> > > - Allow null value for operator field in task_instance schema(REST API) (#16516)
> >
> > > - Avoid recursion going too deep when redacting logs (#16491)
> >
> > > - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
> >
> > > - Tree View UI for larger DAGs & more consistent spacing in Tree View (#16522)
> >
> > > - Correctly handle None returns from Query.scalar() (#16345)
> >
> > > - Adding ``only_active`` parameter to /dags endpoint (#14306)
> >
> > > - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
> >
> > > - Make REST API List DAGs endpoint consistent with UI/CLI behaviour (#16318)
> >
> > > - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
> >
> > > - Queue tasks with higher priority and earlier execution_date first. (#15210)
> >
> > > - Make task ID on legend have enough width and width of line chart to be 100%. (#15915)
> >
> > > - Fix normalize-url vulnerability (#16375)
> >
> > > - Validate retries value on init for better errors (#16415)
> >
> > > - add num_runs query param for tree refresh (#16437)
> >
> > > - Fix templated default/example values in config ref docs (#16442)
> >
> > > - Add ``passphrase`` and ``private_key`` to default sensitive field names (#16392)
> >
> > > - Fix tasks in an infinite slots pool were never scheduled (#15247)
> >
> > > - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
> >
> > > - Don't fail to log if we can't redact something (#16118)
> >
> > > - Set max tree width to 1200 pixels (#16067)
> >
> > > - Fill the "job_id" field for ``airflow task run`` without ``--local``/``--raw`` for KubeExecutor (#16108)
> >
> > > - Fixes problem where conf variable was used before initialization (#16088)
> >
> > > - Fix apply defaults for task decorator (#16085)
> >
> > > - Parse recently modified files even if just parsed (#16075)
> >
> > > - Ensure that we don't try to mask empty string in logs (#16057)
> >
> > > - Don't die when masking ``log.exception`` when there is no exception (#16047)
> >
> > > - Restores apply_defaults import in base_sensor_operator (#16040)
> >
> > > - Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
> >
> > > - Fix dag.clear() to set multiple dags to running when necessary (#15382)
> >
> > > - Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)
> >
> >
> >
> >
> >
> >
> >
> > --
> >
> > +48 660 796 129
> >
> >
>
>
>
> --
> +48 660 796 129
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Jarek Potiuk <ja...@potiuk.com>.
For convenience of people testing the release, I've also pushed
2.1.1rc1 docker images to our DockerHub:
Those images are available for everyone to test (they also contain the
latest provider packages released in June):
docker pull apache/airflow:2.1.1rc1-python3.6
docker pull apache/airflow:2.1.1rc1-python3.7
docker pull apache/airflow:2.1.1rc1-python3.8
docker pull apache/airflow:2.1.1rc1 # python 3.6
I am also adding step to make it "default" as part of our release
process in the future: https://github.com/apache/airflow/pull/16674
J.
On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
<ep...@gmail.com> wrote:
>
> +1 (non-binding)
>
>
>
> From: Jarek Potiuk
> Sent: Saturday, June 26, 2021 11:07 AM
> To: dev@airflow.apache.org
> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>
>
>
> +1 (binding) - tested signatures/licences/code, installed it in
>
> breeze including all the latest released providers and run a few
>
> workflows. All seems good.
>
>
>
> Two tiny issues:
>
>
>
> * .rat-excludes is missing in the sources. This is quite likely fine
>
> but we need to change our verification instructions a bit to take
>
> .rat-excludes from Airflow sources.
>
> * setup.cfg misses license but I think this might be expected as it is
>
> likely automatically stripped-off any comments (?) - we should add it
>
> to .rat-excludes then.
>
>
>
> J.
>
>
>
> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>
> >
>
> > Hey fellow Airflowers,
>
> >
>
> > (I am sending this on behalf of James, as timezones are tricky and he is not yet a PMC member so cannot sign the release himself.)
>
> >
>
> > We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the release, which will last for 72 hours, from Tuesday, June 29, 2021 at 06:30am UTC or until 3 binding +1 votes have been received.
>
> >
>
> > Consider this my [James] (non-binding) +1. As I’m not a member of the PMC, Ash signed the distribution.
>
> >
>
> > Airflow 2.1.1 RC1 is available at: https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>
> >
>
> > apache-airflow-2.1.1-source.tar.gz is a source release that comes with INSTALL instructions.
>
> > apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>
> > apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary" release.
>
> >
>
> > Public keys are available at:
>
> > https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> >
>
> > Only votes from PMC members are binding, but all members of the community are encouraged to test the release and vote with "(non-binding)".
>
> >
>
> > The test procedure for PMCs and Contributors who would like to test this RC are described in
>
> > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>
> >
>
> > Please note that the version number excludes the `rcX` string, so it's now
>
> > simply 2.1.1. This will allow us to rename the artifact without modifying
>
> > the artifact checksums when we actually release.
>
> >
>
> > Changes since 2.1.1 below.
>
> >
>
> > Thanks,
>
> > James
>
> >
>
> > Bug Fixes
>
> > """""""""
>
> >
>
> >
>
> > - Don't crash attempting to mask secrets in dict with non-string keys (#16601)
>
> > - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>
> > - Remove limitation for elasticsearch library (#16553)
>
> > - Adding extra requirements for build and runtime of the PROD image. (#16170)
>
> > - Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
>
> > - Removes unnecessary packages from setup_requires (#16139)
>
> > - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>
> > - Improvements for Docker Image docs (#14843)
>
> > - Ensure that ``dag_run.conf`` is a dict (#15057)
>
> > - Fix CLI connections import and migrate logic from secrets to Connection model (#15425)
>
> > - Fix Dag Details start date bug (#16206)
>
> > - Fix DAG run state not updated while DAG is paused (#16343)
>
> > - Allow null value for operator field in task_instance schema(REST API) (#16516)
>
> > - Avoid recursion going too deep when redacting logs (#16491)
>
> > - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>
> > - Tree View UI for larger DAGs & more consistent spacing in Tree View (#16522)
>
> > - Correctly handle None returns from Query.scalar() (#16345)
>
> > - Adding ``only_active`` parameter to /dags endpoint (#14306)
>
> > - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>
> > - Make REST API List DAGs endpoint consistent with UI/CLI behaviour (#16318)
>
> > - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>
> > - Queue tasks with higher priority and earlier execution_date first. (#15210)
>
> > - Make task ID on legend have enough width and width of line chart to be 100%. (#15915)
>
> > - Fix normalize-url vulnerability (#16375)
>
> > - Validate retries value on init for better errors (#16415)
>
> > - add num_runs query param for tree refresh (#16437)
>
> > - Fix templated default/example values in config ref docs (#16442)
>
> > - Add ``passphrase`` and ``private_key`` to default sensitive field names (#16392)
>
> > - Fix tasks in an infinite slots pool were never scheduled (#15247)
>
> > - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>
> > - Don't fail to log if we can't redact something (#16118)
>
> > - Set max tree width to 1200 pixels (#16067)
>
> > - Fill the "job_id" field for ``airflow task run`` without ``--local``/``--raw`` for KubeExecutor (#16108)
>
> > - Fixes problem where conf variable was used before initialization (#16088)
>
> > - Fix apply defaults for task decorator (#16085)
>
> > - Parse recently modified files even if just parsed (#16075)
>
> > - Ensure that we don't try to mask empty string in logs (#16057)
>
> > - Don't die when masking ``log.exception`` when there is no exception (#16047)
>
> > - Restores apply_defaults import in base_sensor_operator (#16040)
>
> > - Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
>
> > - Fix dag.clear() to set multiple dags to running when necessary (#15382)
>
> > - Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)
>
>
>
>
>
>
>
> --
>
> +48 660 796 129
>
>
--
+48 660 796 129
RE: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Ephraim Anierobi <ep...@gmail.com>.
+1 (non-binding)
**From:**[Jarek Potiuk](mailto:jarek@potiuk.com)
**Sent:** Saturday, June 26, 2021 11:07 AM
**To:**[dev@airflow.apache.org](mailto:dev@airflow.apache.org)
**Subject:** Re: [VOTE] Release Airflow 2.1.1 from RC1
+1 (binding) - tested signatures/licences/code, installed it in
breeze including all the latest released providers and run a few
workflows. All seems good.
Two tiny issues:
* .rat-excludes is missing in the sources. This is quite likely fine
but we need to change our verification instructions a bit to take
.rat-excludes from Airflow sources.
* setup.cfg misses license but I think this might be expected as it is
likely automatically stripped-off any comments (?) - we should add it
to .rat-excludes then.
J.
On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>
> Hey fellow Airflowers,
>
> (I am sending this on behalf of James, as timezones are tricky and he is not
yet a PMC member so cannot sign the release himself.)
>
> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
release, which will last for 72 hours, from Tuesday, June 29, 2021 at 06:30am
UTC or until 3 binding +1 votes have been received.
>
> Consider this my [James] (non-binding) +1. As I’m not a member of the PMC,
Ash signed the distribution.
>
> Airflow 2.1.1 RC1 is available at:
https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>
> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
INSTALL instructions.
> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary"
release.
>
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> Only votes from PMC members are binding, but all members of the community
are encouraged to test the release and vote with "(non-binding)".
>
> The test procedure for PMCs and Contributors who would like to test this RC
are described in
>
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-
the-release-candidate-by-pmcs
>
> Please note that the version number excludes the `rcX` string, so it's now
> simply 2.1.1. This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
>
> Changes since 2.1.1 below.
>
> Thanks,
> James
>
> Bug Fixes
> """""""""
>
>
> \- Don't crash attempting to mask secrets in dict with non-string keys
(#16601)
> \- Always install sphinx_airflow_theme from ``PyPI`` (#16594)
> \- Remove limitation for elasticsearch library (#16553)
> \- Adding extra requirements for build and runtime of the PROD image.
(#16170)
> \- Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
> \- Removes unnecessary packages from setup_requires (#16139)
> \- Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
> \- Improvements for Docker Image docs (#14843)
> \- Ensure that ``dag_run.conf`` is a dict (#15057)
> \- Fix CLI connections import and migrate logic from secrets to Connection
model (#15425)
> \- Fix Dag Details start date bug (#16206)
> \- Fix DAG run state not updated while DAG is paused (#16343)
> \- Allow null value for operator field in task_instance schema(REST API)
(#16516)
> \- Avoid recursion going too deep when redacting logs (#16491)
> \- Backfill: Don't create a DagRun if no tasks match task regex (#16461)
> \- Tree View UI for larger DAGs & more consistent spacing in Tree View
(#16522)
> \- Correctly handle None returns from Query.scalar() (#16345)
> \- Adding ``only_active`` parameter to /dags endpoint (#14306)
> \- Don't show stale Serialized DAGs if they are deleted in DB (#16368)
> \- Make REST API List DAGs endpoint consistent with UI/CLI behaviour
(#16318)
> \- Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
> \- Queue tasks with higher priority and earlier execution_date first.
(#15210)
> \- Make task ID on legend have enough width and width of line chart to be
100%. (#15915)
> \- Fix normalize-url vulnerability (#16375)
> \- Validate retries value on init for better errors (#16415)
> \- add num_runs query param for tree refresh (#16437)
> \- Fix templated default/example values in config ref docs (#16442)
> \- Add ``passphrase`` and ``private_key`` to default sensitive field names
(#16392)
> \- Fix tasks in an infinite slots pool were never scheduled (#15247)
> \- Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
> \- Don't fail to log if we can't redact something (#16118)
> \- Set max tree width to 1200 pixels (#16067)
> \- Fill the "job_id" field for ``airflow task run`` without
``--local``/``--raw`` for KubeExecutor (#16108)
> \- Fixes problem where conf variable was used before initialization (#16088)
> \- Fix apply defaults for task decorator (#16085)
> \- Parse recently modified files even if just parsed (#16075)
> \- Ensure that we don't try to mask empty string in logs (#16057)
> \- Don't die when masking ``log.exception`` when there is no exception
(#16047)
> \- Restores apply_defaults import in base_sensor_operator (#16040)
> \- Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
> \- Fix dag.clear() to set multiple dags to running when necessary (#15382)
> \- Fix Celery executor getting stuck randomly because of reset_signals in
multiprocessing (#15989)
\--
+48 660 796 129
Re: [VOTE] Release Airflow 2.1.1 from RC1
Posted by Jarek Potiuk <ja...@potiuk.com>.
+1 (binding) - tested signatures/licences/code, installed it in
breeze including all the latest released providers and run a few
workflows. All seems good.
Two tiny issues:
* .rat-excludes is missing in the sources. This is quite likely fine
but we need to change our verification instructions a bit to take
.rat-excludes from Airflow sources.
* setup.cfg misses license but I think this might be expected as it is
likely automatically stripped-off any comments (?) - we should add it
to .rat-excludes then.
J.
On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>
> Hey fellow Airflowers,
>
> (I am sending this on behalf of James, as timezones are tricky and he is not yet a PMC member so cannot sign the release himself.)
>
> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the release, which will last for 72 hours, from Tuesday, June 29, 2021 at 06:30am UTC or until 3 binding +1 votes have been received.
>
> Consider this my [James] (non-binding) +1. As I’m not a member of the PMC, Ash signed the distribution.
>
> Airflow 2.1.1 RC1 is available at: https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>
> apache-airflow-2.1.1-source.tar.gz is a source release that comes with INSTALL instructions.
> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel "binary" release.
>
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> Only votes from PMC members are binding, but all members of the community are encouraged to test the release and vote with "(non-binding)".
>
> The test procedure for PMCs and Contributors who would like to test this RC are described in
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>
> Please note that the version number excludes the `rcX` string, so it's now
> simply 2.1.1. This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
>
> Changes since 2.1.1 below.
>
> Thanks,
> James
>
> Bug Fixes
> """""""""
>
>
> - Don't crash attempting to mask secrets in dict with non-string keys (#16601)
> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
> - Remove limitation for elasticsearch library (#16553)
> - Adding extra requirements for build and runtime of the PROD image. (#16170)
> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
> - Removes unnecessary packages from setup_requires (#16139)
> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
> - Improvements for Docker Image docs (#14843)
> - Ensure that ``dag_run.conf`` is a dict (#15057)
> - Fix CLI connections import and migrate logic from secrets to Connection model (#15425)
> - Fix Dag Details start date bug (#16206)
> - Fix DAG run state not updated while DAG is paused (#16343)
> - Allow null value for operator field in task_instance schema(REST API) (#16516)
> - Avoid recursion going too deep when redacting logs (#16491)
> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
> - Tree View UI for larger DAGs & more consistent spacing in Tree View (#16522)
> - Correctly handle None returns from Query.scalar() (#16345)
> - Adding ``only_active`` parameter to /dags endpoint (#14306)
> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour (#16318)
> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
> - Queue tasks with higher priority and earlier execution_date first. (#15210)
> - Make task ID on legend have enough width and width of line chart to be 100%. (#15915)
> - Fix normalize-url vulnerability (#16375)
> - Validate retries value on init for better errors (#16415)
> - add num_runs query param for tree refresh (#16437)
> - Fix templated default/example values in config ref docs (#16442)
> - Add ``passphrase`` and ``private_key`` to default sensitive field names (#16392)
> - Fix tasks in an infinite slots pool were never scheduled (#15247)
> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
> - Don't fail to log if we can't redact something (#16118)
> - Set max tree width to 1200 pixels (#16067)
> - Fill the "job_id" field for ``airflow task run`` without ``--local``/``--raw`` for KubeExecutor (#16108)
> - Fixes problem where conf variable was used before initialization (#16088)
> - Fix apply defaults for task decorator (#16085)
> - Parse recently modified files even if just parsed (#16075)
> - Ensure that we don't try to mask empty string in logs (#16057)
> - Don't die when masking ``log.exception`` when there is no exception (#16047)
> - Restores apply_defaults import in base_sensor_operator (#16040)
> - Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
> - Fix dag.clear() to set multiple dags to running when necessary (#15382)
> - Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)
--
+48 660 796 129