You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Kaxil Naik <ka...@gmail.com> on 2021/07/01 15:12:04 UTC

Re: [VOTE] Release Airflow 2.1.1 from RC1

+1 (binding)

On Tue, Jun 29, 2021, 16:03 Xinbin Huang <bi...@gmail.com> wrote:

> +1 (non-binding)
>
> On Tue, Jun 29, 2021 at 8:00 AM Jed Cunningham <je...@astronomer.io.invalid>
> wrote:
>
>> +1 (non-binding)
>>
>> On Tue, Jun 29, 2021 at 3:50 AM Ash Berlin-Taylor <as...@apache.org> wrote:
>>
>>> +1 (binding) because I didn't actually cast it yet :D
>>>
>>> I think since the CeleryKubernetesExecutor behaviour is not a regression
>>> from 2.1.0, combined with Kaxil finding a workaround that it is worth
>>> carrying on with the 2.1.1 release, and we will follow up soon-ish with a
>>> 2.1.2
>>>
>>> On Mon, Jun 28 2021 at 09:55:58 -0700, Daniel Standish <
>>> dpstandish@gmail.com> wrote:
>>>
>>> I am not sure if this would block release, but I think
>>> CeleryKubernetesExecutor remains broken in this release if this issue is
>>> correct:
>>> https://github.com/apache/airflow/issues/16326#issuecomment-869597105
>>>
>>> It was already broken in 2.1.0 so maybe that renders it a non-blocker?
>>>
>>>
>>> On Mon, Jun 28, 2021 at 8:59 AM Elad Kalif <el...@apache.org> wrote:
>>>
>>>> +1 (non-binding)
>>>>
>>>> On Mon, Jun 28, 2021 at 6:08 PM James Timmins
>>>> <ja...@astronomer.io.invalid> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>> On Jun 26, 2021, 4:16 AM -0700, Jarek Potiuk <ja...@potiuk.com>,
>>>>> wrote:
>>>>>
>>>>> For convenience of people testing the release, I've also pushed
>>>>> 2.1.1rc1 docker images to our DockerHub:
>>>>>
>>>>> Those images are available for everyone to test (they also contain the
>>>>> latest provider packages released in June):
>>>>>
>>>>> docker pull apache/airflow:2.1.1rc1-python3.6
>>>>> docker pull apache/airflow:2.1.1rc1-python3.7
>>>>> docker pull apache/airflow:2.1.1rc1-python3.8
>>>>> docker pull apache/airflow:2.1.1rc1 # python 3.6
>>>>>
>>>>> I am also adding step to make it "default" as part of our release
>>>>> process in the future: https://github.com/apache/airflow/pull/16674
>>>>>
>>>>> J.
>>>>>
>>>>> On Sat, Jun 26, 2021 at 1:02 PM Ephraim Anierobi
>>>>> <ep...@gmail.com> wrote:
>>>>>
>>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>>
>>>>>
>>>>> From: Jarek Potiuk
>>>>> Sent: Saturday, June 26, 2021 11:07 AM
>>>>> To: dev@airflow.apache.org
>>>>> Subject: Re: [VOTE] Release Airflow 2.1.1 from RC1
>>>>>
>>>>>
>>>>>
>>>>> +1 (binding) - tested signatures/licences/code, installed it in
>>>>>
>>>>> breeze including all the latest released providers and run a few
>>>>>
>>>>> workflows. All seems good.
>>>>>
>>>>>
>>>>>
>>>>> Two tiny issues:
>>>>>
>>>>>
>>>>>
>>>>> * .rat-excludes is missing in the sources. This is quite likely fine
>>>>>
>>>>> but we need to change our verification instructions a bit to take
>>>>>
>>>>> .rat-excludes from Airflow sources.
>>>>>
>>>>> * setup.cfg misses license but I think this might be expected as it is
>>>>>
>>>>> likely automatically stripped-off any comments (?) - we should add it
>>>>>
>>>>> to .rat-excludes then.
>>>>>
>>>>>
>>>>>
>>>>> J.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 26, 2021 at 8:30 AM Ash Berlin-Taylor <as...@apache.org>
>>>>> wrote:
>>>>>
>>>>>
>>>>>
>>>>> Hey fellow Airflowers,
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (I am sending this on behalf of James, as timezones are tricky and he
>>>>> is not yet a PMC member so cannot sign the release himself.)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> We've have cut Airflow 2.1.1 RC1. This email is calling a vote on the
>>>>> release, which will last for 72 hours, from Tuesday, June 29, 2021 at
>>>>> 06:30am UTC or until 3 binding +1 votes have been received.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Consider this my [James] (non-binding) +1. As I’m not a member of the
>>>>> PMC, Ash signed the distribution.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Airflow 2.1.1 RC1 is available at:
>>>>> https://dist.apache.org/repos/dist/dev/airflow/2.1.1rc1/
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> apache-airflow-2.1.1-source.tar.gz is a source release that comes with
>>>>> INSTALL instructions.
>>>>>
>>>>>
>>>>> apache-airflow-2.1.1-bin.tar.gz is the binary Python "sdist" release.
>>>>>
>>>>>
>>>>> apache_airflow-2.1.1-py3-none-any.whl is the binary Python wheel
>>>>> "binary" release.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Public keys are available at:
>>>>>
>>>>>
>>>>> https://dist.apache.org/repos/dist/release/airflow/KEYS
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Only votes from PMC members are binding, but all members of the
>>>>> community are encouraged to test the release and vote with "(non-binding)".
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> The test procedure for PMCs and Contributors who would like to test
>>>>> this RC are described in
>>>>>
>>>>>
>>>>>
>>>>> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md#verify-the-release-candidate-by-pmcs
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Please note that the version number excludes the `rcX` string, so it's
>>>>> now
>>>>>
>>>>>
>>>>> simply 2.1.1. This will allow us to rename the artifact without
>>>>> modifying
>>>>>
>>>>>
>>>>> the artifact checksums when we actually release.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Changes since 2.1.1 below.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>>
>>>>> James
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Bug Fixes
>>>>>
>>>>>
>>>>> """""""""
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> - Don't crash attempting to mask secrets in dict with non-string keys
>>>>> (#16601)
>>>>>
>>>>>
>>>>> - Always install sphinx_airflow_theme from ``PyPI`` (#16594)
>>>>>
>>>>>
>>>>> - Remove limitation for elasticsearch library (#16553)
>>>>>
>>>>>
>>>>> - Adding extra requirements for build and runtime of the PROD image.
>>>>> (#16170)
>>>>>
>>>>>
>>>>> - Cattrs 1.7.0 released by the end of May 2021 break lineage usage
>>>>> (#16173)
>>>>>
>>>>>
>>>>> - Removes unnecessary packages from setup_requires (#16139)
>>>>>
>>>>>
>>>>> - Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
>>>>>
>>>>>
>>>>> - Improvements for Docker Image docs (#14843)
>>>>>
>>>>>
>>>>> - Ensure that ``dag_run.conf`` is a dict (#15057)
>>>>>
>>>>>
>>>>> - Fix CLI connections import and migrate logic from secrets to
>>>>> Connection model (#15425)
>>>>>
>>>>>
>>>>> - Fix Dag Details start date bug (#16206)
>>>>>
>>>>>
>>>>> - Fix DAG run state not updated while DAG is paused (#16343)
>>>>>
>>>>>
>>>>> - Allow null value for operator field in task_instance schema(REST
>>>>> API) (#16516)
>>>>>
>>>>>
>>>>> - Avoid recursion going too deep when redacting logs (#16491)
>>>>>
>>>>>
>>>>> - Backfill: Don't create a DagRun if no tasks match task regex (#16461)
>>>>>
>>>>>
>>>>> - Tree View UI for larger DAGs & more consistent spacing in Tree View
>>>>> (#16522)
>>>>>
>>>>>
>>>>> - Correctly handle None returns from Query.scalar() (#16345)
>>>>>
>>>>>
>>>>> - Adding ``only_active`` parameter to /dags endpoint (#14306)
>>>>>
>>>>>
>>>>> - Don't show stale Serialized DAGs if they are deleted in DB (#16368)
>>>>>
>>>>>
>>>>> - Make REST API List DAGs endpoint consistent with UI/CLI behaviour
>>>>> (#16318)
>>>>>
>>>>>
>>>>> - Support remote logging in elasticsearch with ``filebeat 7`` (#14625)
>>>>>
>>>>>
>>>>> - Queue tasks with higher priority and earlier execution_date first.
>>>>> (#15210)
>>>>>
>>>>>
>>>>> - Make task ID on legend have enough width and width of line chart to
>>>>> be 100%. (#15915)
>>>>>
>>>>>
>>>>> - Fix normalize-url vulnerability (#16375)
>>>>>
>>>>>
>>>>> - Validate retries value on init for better errors (#16415)
>>>>>
>>>>>
>>>>> - add num_runs query param for tree refresh (#16437)
>>>>>
>>>>>
>>>>> - Fix templated default/example values in config ref docs (#16442)
>>>>>
>>>>>
>>>>> - Add ``passphrase`` and ``private_key`` to default sensitive field
>>>>> names (#16392)
>>>>>
>>>>>
>>>>> - Fix tasks in an infinite slots pool were never scheduled (#15247)
>>>>>
>>>>>
>>>>> - Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
>>>>>
>>>>>
>>>>> - Don't fail to log if we can't redact something (#16118)
>>>>>
>>>>>
>>>>> - Set max tree width to 1200 pixels (#16067)
>>>>>
>>>>>
>>>>> - Fill the "job_id" field for ``airflow task run`` without
>>>>> ``--local``/``--raw`` for KubeExecutor (#16108)
>>>>>
>>>>>
>>>>> - Fixes problem where conf variable was used before initialization
>>>>> (#16088)
>>>>>
>>>>>
>>>>> - Fix apply defaults for task decorator (#16085)
>>>>>
>>>>>
>>>>> - Parse recently modified files even if just parsed (#16075)
>>>>>
>>>>>
>>>>> - Ensure that we don't try to mask empty string in logs (#16057)
>>>>>
>>>>>
>>>>> - Don't die when masking ``log.exception`` when there is no exception
>>>>> (#16047)
>>>>>
>>>>>
>>>>> - Restores apply_defaults import in base_sensor_operator (#16040)
>>>>>
>>>>>
>>>>> - Fix auto-refresh in tree view When webserver ui is not in ``/``
>>>>> (#16018)
>>>>>
>>>>>
>>>>> - Fix dag.clear() to set multiple dags to running when necessary
>>>>> (#15382)
>>>>>
>>>>>
>>>>> - Fix Celery executor getting stuck randomly because of reset_signals
>>>>> in multiprocessing (#15989)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> +48 660 796 129
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> +48 660 796 129
>>>>>
>>>>>