You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@liminal.apache.org by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/09/12 19:01:34 UTC
[GitHub] [incubator-liminal] dependabot[bot] opened a new pull request, #112: Bump apache-airflow from 2.1.2 to 2.7.1
dependabot[bot] opened a new pull request, #112:
URL: https://github.com/apache/incubator-liminal/pull/112
Bumps [apache-airflow](https://github.com/apache/airflow) from 2.1.2 to 2.7.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/apache/airflow/releases">apache-airflow's releases</a>.</em></p>
<blockquote>
<h2>Apache Airflow 2.7.1</h2>
<h2>Significant Changes</h2>
<h2>CronTriggerTimetable is now less aggressive when trying to skip a run (<a href="https://redirect.github.com/apache/airflow/issues/33404">#33404</a>)</h2>
<p>When setting <code>catchup=False</code>, CronTriggerTimetable no longer skips a run if
the scheduler does not query the timetable immediately after the previous run
has been triggered.</p>
<p>This should not affect scheduling in most cases, but can change the behaviour if
a DAG is paused-unpaused to manually skip a run. Previously, the timetable (with
<code>catchup=False</code>) would only start a run after a DAG is unpaused, but with this
change, the scheduler would try to look at little bit back to schedule the
previous run that covers a part of the period when the DAG was paused. This
means you will need to keep a DAG paused longer (namely, for the entire cron
period to pass) to really skip a run.</p>
<p>Note that this is also the behaviour exhibited by various other cron-based
scheduling tools, such as <code>anacron</code>.</p>
<h2><code>conf.set()</code> becomes case insensitive to match <code>conf.get()</code> behavior (<a href="https://redirect.github.com/apache/airflow/issues/33452">#33452</a>)</h2>
<p>Also, <code>conf.get()</code> will now break if used with non-string parameters.</p>
<p><code>conf.set(section, key, value)</code> used to be case sensitive, i.e. <code>conf.set("SECTION", "KEY", value)</code>
and <code>conf.set("section", "key", value)</code> were stored as two distinct configurations.
This was inconsistent with the behavior of <code>conf.get(section, key)</code>, which was always converting the section and key to lower case.</p>
<p>As a result, configuration options set with upper case characters in the section or key were unreachable.
That's why we are now converting section and key to lower case in <code>conf.set</code> too.</p>
<p>We also changed a bit the behavior of <code>conf.get()</code>. It used to allow objects that are not strings in the section or key.
Doing this will now result in an exception. For instance, <code>conf.get("section", 123)</code> needs to be replaced with <code>conf.get("section", "123")</code>.</p>
<h2>Bug Fixes</h2>
<ul>
<li>Ensure that tasks wait for running indirect setup (<a href="https://redirect.github.com/apache/airflow/issues/33903">#33903</a>)</li>
<li>Respect "soft_fail" for core async sensors (<a href="https://redirect.github.com/apache/airflow/issues/33403">#33403</a>)</li>
<li>Differentiate 0 and unset as a default param values (<a href="https://redirect.github.com/apache/airflow/issues/33965">#33965</a>)</li>
<li>Raise 404 from Variable PATCH API if variable is not found (<a href="https://redirect.github.com/apache/airflow/issues/33885">#33885</a>)</li>
<li>Fix <code>MappedTaskGroup</code> tasks not respecting upstream dependency (<a href="https://redirect.github.com/apache/airflow/issues/33732">#33732</a>)</li>
<li>Add limit 1 if required first value from query result (<a href="https://redirect.github.com/apache/airflow/issues/33672">#33672</a>)</li>
<li>Fix UI DAG counts including deleted DAGs (<a href="https://redirect.github.com/apache/airflow/issues/33778">#33778</a>)</li>
<li>Fix cleaning zombie RESTARTING tasks (<a href="https://redirect.github.com/apache/airflow/issues/33706">#33706</a>)</li>
<li><code>SECURITY_MANAGER_CLASS</code> should be a reference to class, not a string (<a href="https://redirect.github.com/apache/airflow/issues/33690">#33690</a>)</li>
<li>Add back <code>get_url_for_login</code> in security manager (<a href="https://redirect.github.com/apache/airflow/issues/33660">#33660</a>)</li>
<li>Fix <code>2.7.0 db</code> migration job errors (<a href="https://redirect.github.com/apache/airflow/issues/33652">#33652</a>)</li>
<li>Set context inside templates (<a href="https://redirect.github.com/apache/airflow/issues/33645">#33645</a>)</li>
<li>Treat dag-defined access_control as authoritative if defined (<a href="https://redirect.github.com/apache/airflow/issues/33632">#33632</a>)</li>
<li>Bind engine before attempting to drop archive tables (<a href="https://redirect.github.com/apache/airflow/issues/33622">#33622</a>)</li>
<li>Add a fallback in case no first name and last name are set (<a href="https://redirect.github.com/apache/airflow/issues/33617">#33617</a>)</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/apache/airflow/blob/main/RELEASE_NOTES.rst">apache-airflow's changelog</a>.</em></p>
<blockquote>
<h2>Airflow 2.7.1 (2023-09-07)</h2>
<p>Significant Changes
^^^^^^^^^^^^^^^^^^^</p>
<p>CronTriggerTimetable is now less aggressive when trying to skip a run (<a href="https://redirect.github.com/apache/airflow/issues/33404">#33404</a>)
""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""</p>
<p>When setting <code>catchup=False</code>, CronTriggerTimetable no longer skips a run if
the scheduler does not query the timetable immediately after the previous run
has been triggered.</p>
<p>This should not affect scheduling in most cases, but can change the behaviour if
a DAG is paused-unpaused to manually skip a run. Previously, the timetable (with
<code>catchup=False</code>) would only start a run after a DAG is unpaused, but with this
change, the scheduler would try to look at little bit back to schedule the
previous run that covers a part of the period when the DAG was paused. This
means you will need to keep a DAG paused longer (namely, for the entire cron
period to pass) to really skip a run.</p>
<p>Note that this is also the behaviour exhibited by various other cron-based
scheduling tools, such as <code>anacron</code>.</p>
<p><code>conf.set()</code> becomes case insensitive to match <code>conf.get()</code> behavior (<a href="https://redirect.github.com/apache/airflow/issues/33452">#33452</a>)
"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""</p>
<p>Also, <code>conf.get()</code> will now break if used with non-string parameters.</p>
<p><code>conf.set(section, key, value)</code> used to be case sensitive, i.e. <code>conf.set("SECTION", "KEY", value)</code>
and <code>conf.set("section", "key", value)</code> were stored as two distinct configurations.
This was inconsistent with the behavior of <code>conf.get(section, key)</code>, which was always converting the section and key to lower case.</p>
<p>As a result, configuration options set with upper case characters in the section or key were unreachable.
That's why we are now converting section and key to lower case in <code>conf.set</code> too.</p>
<p>We also changed a bit the behavior of <code>conf.get()</code>. It used to allow objects that are not strings in the section or key.
Doing this will now result in an exception. For instance, <code>conf.get("section", 123)</code> needs to be replaced with <code>conf.get("section", "123")</code>.</p>
<p>Bug Fixes
"""""""""</p>
<ul>
<li>Ensure that tasks wait for running indirect setup (<a href="https://redirect.github.com/apache/airflow/issues/33903">#33903</a>)</li>
<li>Respect "soft_fail" for core async sensors (<a href="https://redirect.github.com/apache/airflow/issues/33403">#33403</a>)</li>
<li>Differentiate 0 and unset as a default param values (<a href="https://redirect.github.com/apache/airflow/issues/33965">#33965</a>)</li>
<li>Raise 404 from Variable PATCH API if variable is not found (<a href="https://redirect.github.com/apache/airflow/issues/33885">#33885</a>)</li>
<li>Fix <code>MappedTaskGroup</code> tasks not respecting upstream dependency (<a href="https://redirect.github.com/apache/airflow/issues/33732">#33732</a>)</li>
<li>Add limit 1 if required first value from query result (<a href="https://redirect.github.com/apache/airflow/issues/33672">#33672</a>)</li>
<li>Fix UI DAG counts including deleted DAGs (<a href="https://redirect.github.com/apache/airflow/issues/33778">#33778</a>)</li>
<li>Fix cleaning zombie RESTARTING tasks (<a href="https://redirect.github.com/apache/airflow/issues/33706">#33706</a>)</li>
<li><code>SECURITY_MANAGER_CLASS</code> should be a reference to class, not a string (<a href="https://redirect.github.com/apache/airflow/issues/33690">#33690</a>)</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/apache/airflow/commit/b8c416681c529aad3ef744c193f6e0435c4d0d93"><code>b8c4166</code></a> fixup! Update RELEASE_NOTES.rst</li>
<li><a href="https://github.com/apache/airflow/commit/693b7ed329589c561c5befc7f703ab20df2a0712"><code>693b7ed</code></a> Bring back Pydantic 1 compatibility (<a href="https://redirect.github.com/apache/airflow/issues/34081">#34081</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/c25ba74c0c2e7fc8bbe523461c1599965bdb8652"><code>c25ba74</code></a> Attempt to fix the flaky TestTriggererJob test (<a href="https://redirect.github.com/apache/airflow/issues/34075">#34075</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/79256ebe2f1799318a85400475d9ee7de5e6491c"><code>79256eb</code></a> Remove Pydantic 1 compatibility code (<a href="https://redirect.github.com/apache/airflow/issues/33998">#33998</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/891fae5025e44833afc0fc6f7a5ff34515753e26"><code>891fae5</code></a> Update RELEASE_NOTES.rst</li>
<li><a href="https://github.com/apache/airflow/commit/b5dbf97317c4ea0dde6a2b006d34b694c95d2f9a"><code>b5dbf97</code></a> Ensure that tasks wait for running indirect setup (<a href="https://redirect.github.com/apache/airflow/issues/33903">#33903</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/590412ba589fec20edde698057190f725770a29f"><code>590412b</code></a> Fix typos (double words and it's/its) (<a href="https://redirect.github.com/apache/airflow/issues/33623">#33623</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/d404d3f84a5f6cdc204c758f76514e2829525dd0"><code>d404d3f</code></a> Limit celery by excluding 5.3.2 and 5.3.3 (<a href="https://redirect.github.com/apache/airflow/issues/34031">#34031</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/7cd0748c6017abf8f0da241f0fa86488f32d5e95"><code>7cd0748</code></a> Remove print introduced in PR <a href="https://redirect.github.com/apache/airflow/issues/32261">#32261</a> (<a href="https://redirect.github.com/apache/airflow/issues/34008">#34008</a>)</li>
<li><a href="https://github.com/apache/airflow/commit/de95f982722a84cf80b9124b263aaec559059fee"><code>de95f98</code></a> Upgrade Elasticsearch to 8 (<a href="https://redirect.github.com/apache/airflow/issues/33135">#33135</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/apache/airflow/compare/2.1.2...2.7.1">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/incubator-liminal/network/alerts).
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@liminal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org