You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Ephraim Anierobi <ep...@apache.org> on 2022/05/21 22:40:24 UTC
[VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Hey fellow Airflowers,
I have cut Airflow 2.3.1rc1. This email is calling a vote on the release,
which will last at least 72 hours, from Saturday, May 21, 2022, at 10:40 pm
UTC
until Tuesday, May 24, 2022, at 10:40 pm UTC
<https://www.timeanddate.com/worldclock/fixedtime.html?msg=8&iso=20220524T2240&p1=1440>,
and until 3 binding +1 votes have been received.
Status of testing of the release is kept in:
https://github.com/apache/airflow/issues/23852
Consider this my (binding) +1.
Airflow 2.3.1rc1 is available at:
https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/
*apache-airflow-2.3.1-source.tar.gz* is a source release that comes with
INSTALL instructions.
*apache-airflow-2.3.1.tar.gz* is the binary Python "sdist" release.
*apache_airflow-2.3.1-py3-none-any.whl* is the binary Python wheel "binary"
release.
Public keys are available at:
https://dist.apache.org/repos/dist/release/airflow/KEYS
Please vote accordingly:
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Only votes from PMC members are binding, but all members of the community
are encouraged to test the release and vote with "(non-binding)".
The test procedure for PMCs and Contributors who would like to test this RC
are described in
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
Please note that the version number excludes the `rcX` string, so it's now
simply 2.3.1. This will allow us to rename the artifact without modifying
the artifact checksums when we actually release.
Release Notes:
https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst
Changes since 2.3.0:
*Bug Fixes*:
- Automatically reschedule stalled queued tasks in ``CeleryExecutor``
(#23690)
- Fix expand/collapse all buttons (#23590)
- Grid view status filters (#23392)
- Expand/collapse all groups (#23487)
- Fix retrieval of deprecated non-config values (#23723)
- Fix secrets rendered in UI when task is not executed. (#22754)
- Fix provider import error matching (#23825)
- Fix regression in ignoring symlinks (#23535)
- Fix ``dag-processor`` fetch metadata database config (#23575)
- Fix auto upstream dep when expanding non-templated field (#23771)
- Fix task log is not captured (#23684)
- Add ``reschedule`` to the serialized fields for the
``BaseSensorOperator`` (#23674)
- Modify db clean to also catch the ProgrammingError exception (#23699)
- Remove titles from link buttons (#23736)
- Fix grid details header text overlap (#23728)
- Ensure ``execution_timeout`` as timedelta (#23655)
- Don't run pre-migration checks for downgrade (#23634)
- Add index for event column in log table (#23625)
- Implement ``send_callback`` method for ``CeleryKubernetesExecutor`` and
``LocalKubernetesExecutor`` (#23617)
- Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
- Apply specific ID collation to ``root_dag_id`` too (#23536)
- Prevent ``KubernetesJobWatcher`` getting stuck on resource too old
(#23521)
- Fix scheduler crash when expanding with mapped task that returned none
(#23486)
- Fix broken dagrun links when many runs start at the same time (#23462)
- Fix: Exception when parsing log #20966 (#23301)
- Handle invalid date parsing in webserver views. (#23161)
- Pools with negative open slots should not block other pools (#23143)
- Move around overflow, position and padding (#23044)
- Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
- Only count bad refs when ``moved`` table exists (#23491)
- Visually distinguish task group summary (#23488)
- Remove color change for highly nested groups (#23482)
- Optimize 2.3.0 pre-upgrade check queries (#23458)
- Add backward compatibility for ``core__sql_alchemy_conn__cmd`` (#23441)
- Fix literal cross product expansion (#23434)
- Fix broken task instance link in xcom list (#23367)
- Fix connection test button (#23345)
- fix cli ``airflow dags show`` for mapped operator (#23339)
- Hide some task instance attributes (#23338)
- Don't show grid actions if server would reject with permission denied
(#23332)
- Use run_id for ``ti.mark_success_url`` (#23330)
- Fix update user auth stats (#23314)
- Use ``<Time />`` in Mapped Instance table (#23313)
- Fix duplicated Kubernetes DeprecationWarnings (#23302)
- Store grid view selection in url params (#23290)
- Remove custom signal handling in Triggerer (#23274)
- Override pool for TaskInstance when pool is passed from cli. (#23258)
- Show warning if '/' is used in a DAG run ID (#23106)
- Use kubernetes queue in kubernetes hybrid executors (#23048)
- Add tags inside try block. (#21784)
Cheers,
Ephraim
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Jed Cunningham <je...@apache.org>.
+1 (binding) - tested with the helm chart.
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Elad Kalif <el...@apache.org>.
+1 binding
On Mon, May 23, 2022 at 1:11 PM Ash Berlin-Taylor <as...@apache.org> wrote:
> +1 (binding)
>
> On Mon, May 23 2022 at 11:05:50 +0100, Kaxil Naik <ka...@gmail.com>
> wrote:
>
> +1 (binding)
>
> On Sun, 22 May 2022 at 23:47, Jarek Potiuk <ja...@potiuk.com> wrote:
>
>> +1 (binding) - run it locally in a few combinations, tested all fixes
>> I've been involved with from
>> https://github.com/apache/airflow/issues/23852, checked signatures,
>> checksums, licences. All looks good!
>>
>> On Sun, May 22, 2022 at 10:31 PM Jarek Potiuk <ja...@potiuk.com> wrote:
>> >
>> > All images are also refreshed. In the meantime Gabriel Machado found
>> > an issue with constraints for rc1 (thanks!) - cncf.kubernetes provider
>> > was set to 3.1.2. I fixed it so it should be ok now. We can fix
>> > constraints this way as it does not change the package released) and
>> > the images generated contain 4.0.2 (I am investigating why it was
>> > downgraded and we will solve those for the future).
>> >
>> > BTW,. This is the first time when we also release "slim" RC images - so
>> > it would be great if those who wanted to use the slim images will test
>> > them too.
>> >
>> >
>> >
>> > J.
>> >
>> > On Sun, May 22, 2022 at 12:40 AM Ephraim Anierobi
>> > <ep...@apache.org> wrote:
>> > >
>> > > Hey fellow Airflowers,
>> > >
>> > > I have cut Airflow 2.3.1rc1. This email is calling a vote on the
>> release,
>> > > which will last at least 72 hours, from Saturday, May 21, 2022, at
>> 10:40 pm UTC
>> > > until Tuesday, May 24, 2022, at 10:40 pm UTC, and until 3 binding +1
>> votes have been received.
>> > >
>> > > Status of testing of the release is kept in:
>> https://github.com/apache/airflow/issues/23852
>> > >
>> > > Consider this my (binding) +1.
>> > >
>> > > Airflow 2.3.1rc1 is available at:
>> > > https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/
>> > >
>> > > *apache-airflow-2.3.1-source.tar.gz* is a source release that comes
>> with INSTALL instructions.
>> > > *apache-airflow-2.3.1.tar.gz* is the binary Python "sdist" release.
>> > > *apache_airflow-2.3.1-py3-none-any.whl* is the binary Python wheel
>> "binary" release.
>> > >
>> > > Public keys are available at:
>> > > https://dist.apache.org/repos/dist/release/airflow/KEYS
>> > >
>> > > Please vote accordingly:
>> > >
>> > > [ ] +1 approve
>> > > [ ] +0 no opinion
>> > > [ ] -1 disapprove with the reason
>> > >
>> > > Only votes from PMC members are binding, but all members of the
>> community
>> > > are encouraged to test the release and vote with "(non-binding)".
>> > >
>> > > The test procedure for PMCs and Contributors who would like to test
>> this RC are described in
>> > >
>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
>> > >
>> > > Please note that the version number excludes the `rcX` string, so
>> it's now
>> > > simply 2.3.1. This will allow us to rename the artifact without
>> modifying
>> > > the artifact checksums when we actually release.
>> > >
>> > > Release Notes:
>> https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst
>> > >
>> > > Changes since 2.3.0:
>> > >
>> > > *Bug Fixes*:
>> > >
>> > > - Automatically reschedule stalled queued tasks in ``CeleryExecutor``
>> (#23690)
>> > > - Fix expand/collapse all buttons (#23590)
>> > > - Grid view status filters (#23392)
>> > > - Expand/collapse all groups (#23487)
>> > > - Fix retrieval of deprecated non-config values (#23723)
>> > > - Fix secrets rendered in UI when task is not executed. (#22754)
>> > > - Fix provider import error matching (#23825)
>> > > - Fix regression in ignoring symlinks (#23535)
>> > > - Fix ``dag-processor`` fetch metadata database config (#23575)
>> > > - Fix auto upstream dep when expanding non-templated field (#23771)
>> > > - Fix task log is not captured (#23684)
>> > > - Add ``reschedule`` to the serialized fields for the
>> ``BaseSensorOperator`` (#23674)
>> > > - Modify db clean to also catch the ProgrammingError exception
>> (#23699)
>> > > - Remove titles from link buttons (#23736)
>> > > - Fix grid details header text overlap (#23728)
>> > > - Ensure ``execution_timeout`` as timedelta (#23655)
>> > > - Don't run pre-migration checks for downgrade (#23634)
>> > > - Add index for event column in log table (#23625)
>> > > - Implement ``send_callback`` method for ``CeleryKubernetesExecutor``
>> and ``LocalKubernetesExecutor`` (#23617)
>> > > - Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
>> > > - Apply specific ID collation to ``root_dag_id`` too (#23536)
>> > > - Prevent ``KubernetesJobWatcher`` getting stuck on resource too old
>> (#23521)
>> > > - Fix scheduler crash when expanding with mapped task that returned
>> none (#23486)
>> > > - Fix broken dagrun links when many runs start at the same time
>> (#23462)
>> > > - Fix: Exception when parsing log #20966 (#23301)
>> > > - Handle invalid date parsing in webserver views. (#23161)
>> > > - Pools with negative open slots should not block other pools (#23143)
>> > > - Move around overflow, position and padding (#23044)
>> > > - Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
>> > > - Only count bad refs when ``moved`` table exists (#23491)
>> > > - Visually distinguish task group summary (#23488)
>> > > - Remove color change for highly nested groups (#23482)
>> > > - Optimize 2.3.0 pre-upgrade check queries (#23458)
>> > > - Add backward compatibility for ``core__sql_alchemy_conn__cmd``
>> (#23441)
>> > > - Fix literal cross product expansion (#23434)
>> > > - Fix broken task instance link in xcom list (#23367)
>> > > - Fix connection test button (#23345)
>> > > - fix cli ``airflow dags show`` for mapped operator (#23339)
>> > > - Hide some task instance attributes (#23338)
>> > > - Don't show grid actions if server would reject with permission
>> denied (#23332)
>> > > - Use run_id for ``ti.mark_success_url`` (#23330)
>> > > - Fix update user auth stats (#23314)
>> > > - Use ``<Time />`` in Mapped Instance table (#23313)
>> > > - Fix duplicated Kubernetes DeprecationWarnings (#23302)
>> > > - Store grid view selection in url params (#23290)
>> > > - Remove custom signal handling in Triggerer (#23274)
>> > > - Override pool for TaskInstance when pool is passed from cli.
>> (#23258)
>> > > - Show warning if '/' is used in a DAG run ID (#23106)
>> > > - Use kubernetes queue in kubernetes hybrid executors (#23048)
>> > > - Add tags inside try block. (#21784)
>> > >
>> > > Cheers,
>> > > Ephraim
>>
>
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Ash Berlin-Taylor <as...@apache.org>.
+1 (binding)
On Mon, May 23 2022 at 11:05:50 +0100, Kaxil Naik <ka...@gmail.com>
wrote:
> +1 (binding)
>
> On Sun, 22 May 2022 at 23:47, Jarek Potiuk <jarek@potiuk.com
> <ma...@potiuk.com>> wrote:
>> +1 (binding) - run it locally in a few combinations, tested all fixes
>> I've been involved with from
>> <https://github.com/apache/airflow/issues/23852>, checked signatures,
>> checksums, licences. All looks good!
>>
>> On Sun, May 22, 2022 at 10:31 PM Jarek Potiuk <jarek@potiuk.com
>> <ma...@potiuk.com>> wrote:
>> >
>> > All images are also refreshed. In the meantime Gabriel Machado
>> found
>> > an issue with constraints for rc1 (thanks!) - cncf.kubernetes
>> provider
>> > was set to 3.1.2. I fixed it so it should be ok now. We can fix
>> > constraints this way as it does not change the package released)
>> and
>> > the images generated contain 4.0.2 (I am investigating why it was
>> > downgraded and we will solve those for the future).
>> >
>> > BTW,. This is the first time when we also release "slim" RC
>> images - so
>> > it would be great if those who wanted to use the slim images will
>> test
>> > them too.
>> >
>> >
>> >
>> > J.
>> >
>> > On Sun, May 22, 2022 at 12:40 AM Ephraim Anierobi
>> > <ephraimanierobi@apache.org <ma...@apache.org>>
>> wrote:
>> > >
>> > > Hey fellow Airflowers,
>> > >
>> > > I have cut Airflow 2.3.1rc1. This email is calling a vote on
>> the release,
>> > > which will last at least 72 hours, from Saturday, May 21, 2022,
>> at 10:40 pm UTC
>> > > until Tuesday, May 24, 2022, at 10:40 pm UTC, and until 3
>> binding +1 votes have been received.
>> > >
>> > > Status of testing of the release is kept in:
>> <https://github.com/apache/airflow/issues/23852>
>> > >
>> > > Consider this my (binding) +1.
>> > >
>> > > Airflow 2.3.1rc1 is available at:
>> > > <https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/>
>> > >
>> > > *apache-airflow-2.3.1-source.tar.gz* is a source release that
>> comes with INSTALL instructions.
>> > > *apache-airflow-2.3.1.tar.gz* is the binary Python "sdist"
>> release.
>> > > *apache_airflow-2.3.1-py3-none-any.whl* is the binary Python
>> wheel "binary" release.
>> > >
>> > > Public keys are available at:
>> > > <https://dist.apache.org/repos/dist/release/airflow/KEYS>
>> > >
>> > > Please vote accordingly:
>> > >
>> > > [ ] +1 approve
>> > > [ ] +0 no opinion
>> > > [ ] -1 disapprove with the reason
>> > >
>> > > Only votes from PMC members are binding, but all members of the
>> community
>> > > are encouraged to test the release and vote with
>> "(non-binding)".
>> > >
>> > > The test procedure for PMCs and Contributors who would like to
>> test this RC are described in
>> > >
>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
>> <https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md%5C#verify-the-release-candidate-by-pmcs>
>> > >
>> > > Please note that the version number excludes the `rcX` string,
>> so it's now
>> > > simply 2.3.1. This will allow us to rename the artifact without
>> modifying
>> > > the artifact checksums when we actually release.
>> > >
>> > > Release Notes:
>> <https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst>
>> > >
>> > > Changes since 2.3.0:
>> > >
>> > > *Bug Fixes*:
>> > >
>> > > - Automatically reschedule stalled queued tasks in
>> ``CeleryExecutor`` (#23690)
>> > > - Fix expand/collapse all buttons (#23590)
>> > > - Grid view status filters (#23392)
>> > > - Expand/collapse all groups (#23487)
>> > > - Fix retrieval of deprecated non-config values (#23723)
>> > > - Fix secrets rendered in UI when task is not executed. (#22754)
>> > > - Fix provider import error matching (#23825)
>> > > - Fix regression in ignoring symlinks (#23535)
>> > > - Fix ``dag-processor`` fetch metadata database config (#23575)
>> > > - Fix auto upstream dep when expanding non-templated field
>> (#23771)
>> > > - Fix task log is not captured (#23684)
>> > > - Add ``reschedule`` to the serialized fields for the
>> ``BaseSensorOperator`` (#23674)
>> > > - Modify db clean to also catch the ProgrammingError exception
>> (#23699)
>> > > - Remove titles from link buttons (#23736)
>> > > - Fix grid details header text overlap (#23728)
>> > > - Ensure ``execution_timeout`` as timedelta (#23655)
>> > > - Don't run pre-migration checks for downgrade (#23634)
>> > > - Add index for event column in log table (#23625)
>> > > - Implement ``send_callback`` method for
>> ``CeleryKubernetesExecutor`` and ``LocalKubernetesExecutor`` (#23617)
>> > > - Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
>> > > - Apply specific ID collation to ``root_dag_id`` too (#23536)
>> > > - Prevent ``KubernetesJobWatcher`` getting stuck on resource
>> too old (#23521)
>> > > - Fix scheduler crash when expanding with mapped task that
>> returned none (#23486)
>> > > - Fix broken dagrun links when many runs start at the same time
>> (#23462)
>> > > - Fix: Exception when parsing log #20966 (#23301)
>> > > - Handle invalid date parsing in webserver views. (#23161)
>> > > - Pools with negative open slots should not block other pools
>> (#23143)
>> > > - Move around overflow, position and padding (#23044)
>> > > - Change approach to finding bad rows to LEFT OUTER JOIN.
>> (#23528)
>> > > - Only count bad refs when ``moved`` table exists (#23491)
>> > > - Visually distinguish task group summary (#23488)
>> > > - Remove color change for highly nested groups (#23482)
>> > > - Optimize 2.3.0 pre-upgrade check queries (#23458)
>> > > - Add backward compatibility for
>> ``core__sql_alchemy_conn__cmd`` (#23441)
>> > > - Fix literal cross product expansion (#23434)
>> > > - Fix broken task instance link in xcom list (#23367)
>> > > - Fix connection test button (#23345)
>> > > - fix cli ``airflow dags show`` for mapped operator (#23339)
>> > > - Hide some task instance attributes (#23338)
>> > > - Don't show grid actions if server would reject with
>> permission denied (#23332)
>> > > - Use run_id for ``ti.mark_success_url`` (#23330)
>> > > - Fix update user auth stats (#23314)
>> > > - Use ``<Time />`` in Mapped Instance table (#23313)
>> > > - Fix duplicated Kubernetes DeprecationWarnings (#23302)
>> > > - Store grid view selection in url params (#23290)
>> > > - Remove custom signal handling in Triggerer (#23274)
>> > > - Override pool for TaskInstance when pool is passed from cli.
>> (#23258)
>> > > - Show warning if '/' is used in a DAG run ID (#23106)
>> > > - Use kubernetes queue in kubernetes hybrid executors (#23048)
>> > > - Add tags inside try block. (#21784)
>> > >
>> > > Cheers,
>> > > Ephraim
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Kaxil Naik <ka...@gmail.com>.
+1 (binding)
On Sun, 22 May 2022 at 23:47, Jarek Potiuk <ja...@potiuk.com> wrote:
> +1 (binding) - run it locally in a few combinations, tested all fixes
> I've been involved with from
> https://github.com/apache/airflow/issues/23852, checked signatures,
> checksums, licences. All looks good!
>
> On Sun, May 22, 2022 at 10:31 PM Jarek Potiuk <ja...@potiuk.com> wrote:
> >
> > All images are also refreshed. In the meantime Gabriel Machado found
> > an issue with constraints for rc1 (thanks!) - cncf.kubernetes provider
> > was set to 3.1.2. I fixed it so it should be ok now. We can fix
> > constraints this way as it does not change the package released) and
> > the images generated contain 4.0.2 (I am investigating why it was
> > downgraded and we will solve those for the future).
> >
> > BTW,. This is the first time when we also release "slim" RC images - so
> > it would be great if those who wanted to use the slim images will test
> > them too.
> >
> >
> >
> > J.
> >
> > On Sun, May 22, 2022 at 12:40 AM Ephraim Anierobi
> > <ep...@apache.org> wrote:
> > >
> > > Hey fellow Airflowers,
> > >
> > > I have cut Airflow 2.3.1rc1. This email is calling a vote on the
> release,
> > > which will last at least 72 hours, from Saturday, May 21, 2022, at
> 10:40 pm UTC
> > > until Tuesday, May 24, 2022, at 10:40 pm UTC, and until 3 binding +1
> votes have been received.
> > >
> > > Status of testing of the release is kept in:
> https://github.com/apache/airflow/issues/23852
> > >
> > > Consider this my (binding) +1.
> > >
> > > Airflow 2.3.1rc1 is available at:
> > > https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/
> > >
> > > *apache-airflow-2.3.1-source.tar.gz* is a source release that comes
> with INSTALL instructions.
> > > *apache-airflow-2.3.1.tar.gz* is the binary Python "sdist" release.
> > > *apache_airflow-2.3.1-py3-none-any.whl* is the binary Python wheel
> "binary" release.
> > >
> > > Public keys are available at:
> > > https://dist.apache.org/repos/dist/release/airflow/KEYS
> > >
> > > Please vote accordingly:
> > >
> > > [ ] +1 approve
> > > [ ] +0 no opinion
> > > [ ] -1 disapprove with the reason
> > >
> > > Only votes from PMC members are binding, but all members of the
> community
> > > are encouraged to test the release and vote with "(non-binding)".
> > >
> > > The test procedure for PMCs and Contributors who would like to test
> this RC are described in
> > >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
> > >
> > > Please note that the version number excludes the `rcX` string, so it's
> now
> > > simply 2.3.1. This will allow us to rename the artifact without
> modifying
> > > the artifact checksums when we actually release.
> > >
> > > Release Notes:
> https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst
> > >
> > > Changes since 2.3.0:
> > >
> > > *Bug Fixes*:
> > >
> > > - Automatically reschedule stalled queued tasks in ``CeleryExecutor``
> (#23690)
> > > - Fix expand/collapse all buttons (#23590)
> > > - Grid view status filters (#23392)
> > > - Expand/collapse all groups (#23487)
> > > - Fix retrieval of deprecated non-config values (#23723)
> > > - Fix secrets rendered in UI when task is not executed. (#22754)
> > > - Fix provider import error matching (#23825)
> > > - Fix regression in ignoring symlinks (#23535)
> > > - Fix ``dag-processor`` fetch metadata database config (#23575)
> > > - Fix auto upstream dep when expanding non-templated field (#23771)
> > > - Fix task log is not captured (#23684)
> > > - Add ``reschedule`` to the serialized fields for the
> ``BaseSensorOperator`` (#23674)
> > > - Modify db clean to also catch the ProgrammingError exception (#23699)
> > > - Remove titles from link buttons (#23736)
> > > - Fix grid details header text overlap (#23728)
> > > - Ensure ``execution_timeout`` as timedelta (#23655)
> > > - Don't run pre-migration checks for downgrade (#23634)
> > > - Add index for event column in log table (#23625)
> > > - Implement ``send_callback`` method for ``CeleryKubernetesExecutor``
> and ``LocalKubernetesExecutor`` (#23617)
> > > - Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
> > > - Apply specific ID collation to ``root_dag_id`` too (#23536)
> > > - Prevent ``KubernetesJobWatcher`` getting stuck on resource too old
> (#23521)
> > > - Fix scheduler crash when expanding with mapped task that returned
> none (#23486)
> > > - Fix broken dagrun links when many runs start at the same time
> (#23462)
> > > - Fix: Exception when parsing log #20966 (#23301)
> > > - Handle invalid date parsing in webserver views. (#23161)
> > > - Pools with negative open slots should not block other pools (#23143)
> > > - Move around overflow, position and padding (#23044)
> > > - Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
> > > - Only count bad refs when ``moved`` table exists (#23491)
> > > - Visually distinguish task group summary (#23488)
> > > - Remove color change for highly nested groups (#23482)
> > > - Optimize 2.3.0 pre-upgrade check queries (#23458)
> > > - Add backward compatibility for ``core__sql_alchemy_conn__cmd``
> (#23441)
> > > - Fix literal cross product expansion (#23434)
> > > - Fix broken task instance link in xcom list (#23367)
> > > - Fix connection test button (#23345)
> > > - fix cli ``airflow dags show`` for mapped operator (#23339)
> > > - Hide some task instance attributes (#23338)
> > > - Don't show grid actions if server would reject with permission
> denied (#23332)
> > > - Use run_id for ``ti.mark_success_url`` (#23330)
> > > - Fix update user auth stats (#23314)
> > > - Use ``<Time />`` in Mapped Instance table (#23313)
> > > - Fix duplicated Kubernetes DeprecationWarnings (#23302)
> > > - Store grid view selection in url params (#23290)
> > > - Remove custom signal handling in Triggerer (#23274)
> > > - Override pool for TaskInstance when pool is passed from cli. (#23258)
> > > - Show warning if '/' is used in a DAG run ID (#23106)
> > > - Use kubernetes queue in kubernetes hybrid executors (#23048)
> > > - Add tags inside try block. (#21784)
> > >
> > > Cheers,
> > > Ephraim
>
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Jarek Potiuk <ja...@potiuk.com>.
+1 (binding) - run it locally in a few combinations, tested all fixes
I've been involved with from
https://github.com/apache/airflow/issues/23852, checked signatures,
checksums, licences. All looks good!
On Sun, May 22, 2022 at 10:31 PM Jarek Potiuk <ja...@potiuk.com> wrote:
>
> All images are also refreshed. In the meantime Gabriel Machado found
> an issue with constraints for rc1 (thanks!) - cncf.kubernetes provider
> was set to 3.1.2. I fixed it so it should be ok now. We can fix
> constraints this way as it does not change the package released) and
> the images generated contain 4.0.2 (I am investigating why it was
> downgraded and we will solve those for the future).
>
> BTW,. This is the first time when we also release "slim" RC images - so
> it would be great if those who wanted to use the slim images will test
> them too.
>
>
>
> J.
>
> On Sun, May 22, 2022 at 12:40 AM Ephraim Anierobi
> <ep...@apache.org> wrote:
> >
> > Hey fellow Airflowers,
> >
> > I have cut Airflow 2.3.1rc1. This email is calling a vote on the release,
> > which will last at least 72 hours, from Saturday, May 21, 2022, at 10:40 pm UTC
> > until Tuesday, May 24, 2022, at 10:40 pm UTC, and until 3 binding +1 votes have been received.
> >
> > Status of testing of the release is kept in: https://github.com/apache/airflow/issues/23852
> >
> > Consider this my (binding) +1.
> >
> > Airflow 2.3.1rc1 is available at:
> > https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/
> >
> > *apache-airflow-2.3.1-source.tar.gz* is a source release that comes with INSTALL instructions.
> > *apache-airflow-2.3.1.tar.gz* is the binary Python "sdist" release.
> > *apache_airflow-2.3.1-py3-none-any.whl* is the binary Python wheel "binary" release.
> >
> > Public keys are available at:
> > https://dist.apache.org/repos/dist/release/airflow/KEYS
> >
> > Please vote accordingly:
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove with the reason
> >
> > Only votes from PMC members are binding, but all members of the community
> > are encouraged to test the release and vote with "(non-binding)".
> >
> > The test procedure for PMCs and Contributors who would like to test this RC are described in
> > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
> >
> > Please note that the version number excludes the `rcX` string, so it's now
> > simply 2.3.1. This will allow us to rename the artifact without modifying
> > the artifact checksums when we actually release.
> >
> > Release Notes: https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst
> >
> > Changes since 2.3.0:
> >
> > *Bug Fixes*:
> >
> > - Automatically reschedule stalled queued tasks in ``CeleryExecutor`` (#23690)
> > - Fix expand/collapse all buttons (#23590)
> > - Grid view status filters (#23392)
> > - Expand/collapse all groups (#23487)
> > - Fix retrieval of deprecated non-config values (#23723)
> > - Fix secrets rendered in UI when task is not executed. (#22754)
> > - Fix provider import error matching (#23825)
> > - Fix regression in ignoring symlinks (#23535)
> > - Fix ``dag-processor`` fetch metadata database config (#23575)
> > - Fix auto upstream dep when expanding non-templated field (#23771)
> > - Fix task log is not captured (#23684)
> > - Add ``reschedule`` to the serialized fields for the ``BaseSensorOperator`` (#23674)
> > - Modify db clean to also catch the ProgrammingError exception (#23699)
> > - Remove titles from link buttons (#23736)
> > - Fix grid details header text overlap (#23728)
> > - Ensure ``execution_timeout`` as timedelta (#23655)
> > - Don't run pre-migration checks for downgrade (#23634)
> > - Add index for event column in log table (#23625)
> > - Implement ``send_callback`` method for ``CeleryKubernetesExecutor`` and ``LocalKubernetesExecutor`` (#23617)
> > - Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
> > - Apply specific ID collation to ``root_dag_id`` too (#23536)
> > - Prevent ``KubernetesJobWatcher`` getting stuck on resource too old (#23521)
> > - Fix scheduler crash when expanding with mapped task that returned none (#23486)
> > - Fix broken dagrun links when many runs start at the same time (#23462)
> > - Fix: Exception when parsing log #20966 (#23301)
> > - Handle invalid date parsing in webserver views. (#23161)
> > - Pools with negative open slots should not block other pools (#23143)
> > - Move around overflow, position and padding (#23044)
> > - Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
> > - Only count bad refs when ``moved`` table exists (#23491)
> > - Visually distinguish task group summary (#23488)
> > - Remove color change for highly nested groups (#23482)
> > - Optimize 2.3.0 pre-upgrade check queries (#23458)
> > - Add backward compatibility for ``core__sql_alchemy_conn__cmd`` (#23441)
> > - Fix literal cross product expansion (#23434)
> > - Fix broken task instance link in xcom list (#23367)
> > - Fix connection test button (#23345)
> > - fix cli ``airflow dags show`` for mapped operator (#23339)
> > - Hide some task instance attributes (#23338)
> > - Don't show grid actions if server would reject with permission denied (#23332)
> > - Use run_id for ``ti.mark_success_url`` (#23330)
> > - Fix update user auth stats (#23314)
> > - Use ``<Time />`` in Mapped Instance table (#23313)
> > - Fix duplicated Kubernetes DeprecationWarnings (#23302)
> > - Store grid view selection in url params (#23290)
> > - Remove custom signal handling in Triggerer (#23274)
> > - Override pool for TaskInstance when pool is passed from cli. (#23258)
> > - Show warning if '/' is used in a DAG run ID (#23106)
> > - Use kubernetes queue in kubernetes hybrid executors (#23048)
> > - Add tags inside try block. (#21784)
> >
> > Cheers,
> > Ephraim
Re: [VOTE] Release Airflow 2.3.1 from 2.3.1rc1
Posted by Jarek Potiuk <ja...@potiuk.com>.
All images are also refreshed. In the meantime Gabriel Machado found
an issue with constraints for rc1 (thanks!) - cncf.kubernetes provider
was set to 3.1.2. I fixed it so it should be ok now. We can fix
constraints this way as it does not change the package released) and
the images generated contain 4.0.2 (I am investigating why it was
downgraded and we will solve those for the future).
BTW,. This is the first time when we also release "slim" RC images - so
it would be great if those who wanted to use the slim images will test
them too.
J.
On Sun, May 22, 2022 at 12:40 AM Ephraim Anierobi
<ep...@apache.org> wrote:
>
> Hey fellow Airflowers,
>
> I have cut Airflow 2.3.1rc1. This email is calling a vote on the release,
> which will last at least 72 hours, from Saturday, May 21, 2022, at 10:40 pm UTC
> until Tuesday, May 24, 2022, at 10:40 pm UTC, and until 3 binding +1 votes have been received.
>
> Status of testing of the release is kept in: https://github.com/apache/airflow/issues/23852
>
> Consider this my (binding) +1.
>
> Airflow 2.3.1rc1 is available at:
> https://dist.apache.org/repos/dist/dev/airflow/2.3.1rc1/
>
> *apache-airflow-2.3.1-source.tar.gz* is a source release that comes with INSTALL instructions.
> *apache-airflow-2.3.1.tar.gz* is the binary Python "sdist" release.
> *apache_airflow-2.3.1-py3-none-any.whl* is the binary Python wheel "binary" release.
>
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> Please vote accordingly:
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Only votes from PMC members are binding, but all members of the community
> are encouraged to test the release and vote with "(non-binding)".
>
> The test procedure for PMCs and Contributors who would like to test this RC are described in
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmcs
>
> Please note that the version number excludes the `rcX` string, so it's now
> simply 2.3.1. This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
>
> Release Notes: https://github.com/apache/airflow/blob/2.3.1rc1/RELEASE_NOTES.rst
>
> Changes since 2.3.0:
>
> *Bug Fixes*:
>
> - Automatically reschedule stalled queued tasks in ``CeleryExecutor`` (#23690)
> - Fix expand/collapse all buttons (#23590)
> - Grid view status filters (#23392)
> - Expand/collapse all groups (#23487)
> - Fix retrieval of deprecated non-config values (#23723)
> - Fix secrets rendered in UI when task is not executed. (#22754)
> - Fix provider import error matching (#23825)
> - Fix regression in ignoring symlinks (#23535)
> - Fix ``dag-processor`` fetch metadata database config (#23575)
> - Fix auto upstream dep when expanding non-templated field (#23771)
> - Fix task log is not captured (#23684)
> - Add ``reschedule`` to the serialized fields for the ``BaseSensorOperator`` (#23674)
> - Modify db clean to also catch the ProgrammingError exception (#23699)
> - Remove titles from link buttons (#23736)
> - Fix grid details header text overlap (#23728)
> - Ensure ``execution_timeout`` as timedelta (#23655)
> - Don't run pre-migration checks for downgrade (#23634)
> - Add index for event column in log table (#23625)
> - Implement ``send_callback`` method for ``CeleryKubernetesExecutor`` and ``LocalKubernetesExecutor`` (#23617)
> - Fix ``PythonVirtualenvOperator`` templated_fields (#23559)
> - Apply specific ID collation to ``root_dag_id`` too (#23536)
> - Prevent ``KubernetesJobWatcher`` getting stuck on resource too old (#23521)
> - Fix scheduler crash when expanding with mapped task that returned none (#23486)
> - Fix broken dagrun links when many runs start at the same time (#23462)
> - Fix: Exception when parsing log #20966 (#23301)
> - Handle invalid date parsing in webserver views. (#23161)
> - Pools with negative open slots should not block other pools (#23143)
> - Move around overflow, position and padding (#23044)
> - Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
> - Only count bad refs when ``moved`` table exists (#23491)
> - Visually distinguish task group summary (#23488)
> - Remove color change for highly nested groups (#23482)
> - Optimize 2.3.0 pre-upgrade check queries (#23458)
> - Add backward compatibility for ``core__sql_alchemy_conn__cmd`` (#23441)
> - Fix literal cross product expansion (#23434)
> - Fix broken task instance link in xcom list (#23367)
> - Fix connection test button (#23345)
> - fix cli ``airflow dags show`` for mapped operator (#23339)
> - Hide some task instance attributes (#23338)
> - Don't show grid actions if server would reject with permission denied (#23332)
> - Use run_id for ``ti.mark_success_url`` (#23330)
> - Fix update user auth stats (#23314)
> - Use ``<Time />`` in Mapped Instance table (#23313)
> - Fix duplicated Kubernetes DeprecationWarnings (#23302)
> - Store grid view selection in url params (#23290)
> - Remove custom signal handling in Triggerer (#23274)
> - Override pool for TaskInstance when pool is passed from cli. (#23258)
> - Show warning if '/' is used in a DAG run ID (#23106)
> - Use kubernetes queue in kubernetes hybrid executors (#23048)
> - Add tags inside try block. (#21784)
>
> Cheers,
> Ephraim