You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ep...@apache.org on 2022/03/26 21:48:29 UTC
[airflow] branch v2-2-stable updated (9bd6db7 -> 52499a7)
This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch v2-2-stable
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 9bd6db7 Fix 2.2.4 changelog date and remove dups (#22011)
new 115302d Bump version to 2.2.5
new 4ceaa11 Set X-Frame-Options header to DENY only if X_FRAME_ENABLED is set to true. (#19491)
new 881ac28 Fix: Do not render undefined graph edges (#19684)
new e2a3f2d Fix Tasks getting stuck in scheduled state (#19747)
new c0d66b3 Rename `to_delete` to `to_cancel` in TriggerRunner (#20658)
new c36b860 Fix duplicate trigger creation race condition (#20699)
new be8d081 Truncate stack trace to DAG user code for exceptions raised during execution (#20731)
new a1cde12 fix: Update custom connection field processing (#20883)
new c3dda67 Ensure clear_task_instances sets valid run state (#21116)
new 3b85ac9 Update `ExternalTaskSensorLink` to handle templated `external_dag_id` (#21192)
new f90156e A trigger might use a connection; make sure we mask passwords (#21207)
new 5786ebe Log traceback in trigger excs (#21213)
new af3781e Fix trigger dag redirect from task instance log view (#21239)
new d4f82a8 Fix race condition between triggerer and scheduler (#21316)
new 289ae2f Extend documentation for states of DAGs & tasks and update trigger rules docs (#21382)
new f8d005c Reduce DB load incurred by Stale DAG deactivation (#21399)
new 33f07a6 Fix max_active_runs=1 not scheduling runs when min_file_process_interval is high (#21413)
new 74705a7 Fix Resources __eq__ check (#21442)
new 94f698f Filter out default configs when overrides exist. (#21539)
new a3700c3 Fix logging JDBC SQL error when task fails (#21540)
new 7df6b9a Dispose unused connection pool (#21565)
new 767c1b5 extends typing-extensions to be installed with python 3.8+ #21566 (#21567)
new 06516fc Fix postgres part of pipeline example of tutorial (#21586)
new ab2073e Disable default_pool delete on web ui (#21658)
new 2ac2bf2 Log exception in local executor (#21667)
new 10eb88b Correctly handle multiple '=' in LocalFileSystem secrets. (#21694)
new d31d94e Fix stray order_by(TaskInstance.execution_date) (#21705)
new 9b7d771 Fix filesystem sensor for directories (#21729)
new f214a55 Fix graph autorefresh on page load (#21736)
new f224a4b Correct a couple grammatical errors in docs (#21750)
new b109c96 Fix triggerer --capacity parameter (#21753)
new fb32583 Fix the triggerer capacity test (#21760)
new c3ae2e0 Fix assignment of unassigned triggers (#21770)
new 068d1be Fix incorrect data provided to tries & landing times charts (#21928)
new 91b95ea Change the storage of frame to use threadLocal rather than Dict (#21993)
new 2f58392 DB upgrade is required when updating Airflow (#22061)
new 45d74d6 Add documentation on specifying a DB schema. (#22347)
new 610fc59 adding `on_execute_callback` to callbacks docs (#22362)
new 5b2a39f Update version added for `deactivate_stale_dags_interval` config (#22478)
new d17868e Synchronize setup.py files with new providers
new 17f3273 Remove memorystore, not importable example
new 26c4353 Remove provider tests failing collection because lack of cherry-picks
new e444a0d Limit docs build to apache-airlfow + docker-stack for 2.2 branch
new 51ce2c1 Fix broken links to celery documentation (#22364)
new 6364251 Add back celery intersphinx mapping (#22370)
new 982318f Add `dbt` spelling
new 9a1ad97 Remove tests that are not really needed in 2-2 branch
new d797432 Make v2-2-specific CI workflow
new 449aa48 Remove provider check from pre-commits
new 4fae426 Remove auto-generated LICENSES-ui from pre-commit
new b2f3df7 Fixed dask executor and tests (#22027)
new 0c907f1 Replace timedelta.max with year long timdelta in test_manager (#22527)
new a7bfefe Check and disallow a relative path for sqlite (#22530)
new ed12544 Make regular expressions deep-copyable in Python 3.6
new 6bf3b2c Fixed Dask TLS tests to work on Python 3.6
new dcadb25 Remove cache timeout limit
new 3d2c02e Add the new Airflow Trove Classifier to setup.cfg (#22241)
new d39197f Remove RefreshConfiguration workaround for K8s token refreshing (#20759)
new 24c84f0 Fix handling some None parameters in kubernetes 23 libs. (#21905)
new cb9cdf5 Update Kubernetes library version (#18797)
new 52499a7 Add 2.2.5 to CHANGELOG.txt and UPDATING.md
The 61 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/build-images.yml | 340 -----
.github/workflows/ci.yml | 118 +-
.github/workflows/codeql-analysis.yml | 109 --
.github/workflows/label_when_reviewed.yml | 28 -
.../workflows/label_when_reviewed_workflow_run.yml | 177 ---
.github/workflows/stale.yml | 49 -
.pre-commit-config.yaml | 8 -
CHANGELOG.txt | 54 +
CONTRIBUTING.rst | 18 +-
INSTALL | 18 +-
README.md | 14 +-
UPDATING.md | 7 +
airflow/__init__.py | 10 +
airflow/api/common/experimental/pool.py | 2 +-
airflow/cli/cli_parser.py | 2 +-
airflow/cli/commands/task_command.py | 4 +-
airflow/cli/commands/triggerer_command.py | 1 +
airflow/config_templates/config.yml | 8 +
airflow/config_templates/default_airflow.cfg | 4 +
airflow/configuration.py | 58 +
airflow/dag_processing/manager.py | 43 +-
airflow/dag_processing/processor.py | 11 -
airflow/executors/base_executor.py | 36 +-
airflow/executors/dask_executor.py | 2 +-
airflow/executors/local_executor.py | 4 +-
airflow/jobs/scheduler_job.py | 339 +++--
airflow/jobs/triggerer_job.py | 48 +-
airflow/kubernetes/kube_client.py | 47 +-
airflow/kubernetes/pod_generator_deprecated.py | 9 +-
airflow/kubernetes/refresh_config.py | 124 --
airflow/models/baseoperator.py | 14 +-
airflow/models/dagrun.py | 2 +
airflow/models/pool.py | 19 +-
airflow/models/taskinstance.py | 112 +-
airflow/models/trigger.py | 16 +-
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 231 ++-
airflow/providers/cncf/kubernetes/__init__.py | 27 +
.../backcompat/backwards_compat_converters.py | 22 +-
.../providers/cncf/kubernetes/backcompat/pod.py | 27 +-
.../kubernetes/backcompat/pod_runtime_info_env.py | 18 +-
.../providers/cncf/kubernetes/backcompat/volume.py | 2 -
.../cncf/kubernetes/backcompat/volume_mount.py | 4 -
.../kubernetes/example_dags/example_kubernetes.py | 2 +-
.../providers/cncf/kubernetes/hooks/kubernetes.py | 97 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 517 ++++---
.../cncf/kubernetes/operators/spark_kubernetes.py | 16 +-
airflow/providers/cncf/kubernetes/provider.yaml | 8 +
.../cncf/kubernetes/sensors/spark_kubernetes.py | 15 +-
.../providers/cncf/kubernetes/utils/pod_manager.py | 374 +++++
.../providers/dbt}/__init__.py | 0
.../providers/dbt/cloud}/__init__.py | 0
.../providers/github}/__init__.py | 0
.../example_dags/example_cloud_memorystore.py | 331 -----
airflow/secrets/local_filesystem.py | 7 +-
airflow/sensors/external_task.py | 2 +
airflow/sensors/filesystem.py | 2 +-
airflow/settings.py | 6 +
airflow/task/task_runner/standard_task_runner.py | 18 +-
airflow/utils/log/secrets_masker.py | 7 +-
airflow/utils/operator_resources.py | 4 +
airflow/utils/state.py | 5 +-
airflow/www/app.py | 10 +
airflow/www/extensions/init_security.py | 3 +-
airflow/www/static/js/graph.js | 21 +-
airflow/www/views.py | 47 +-
docs/apache-airflow/best-practices.rst | 67 +
docs/apache-airflow/concepts/dags.rst | 5 +-
docs/apache-airflow/concepts/tasks.rst | 6 +
docs/apache-airflow/dag-run.rst | 27 +-
docs/apache-airflow/executor/celery.rst | 4 +-
docs/apache-airflow/extra-packages-ref.rst | 4 +
docs/apache-airflow/howto/set-config.rst | 4 +
docs/apache-airflow/howto/set-up-database.rst | 10 +
docs/apache-airflow/img/watcher.png | Bin 0 -> 41592 bytes
.../installation/supported-versions.rst | 2 +-
docs/apache-airflow/installation/upgrading.rst | 6 +-
.../logging-monitoring/callbacks.rst | 3 +-
docs/apache-airflow/plugins.rst | 2 +-
docs/apache-airflow/tutorial.rst | 67 +-
docs/docker-stack/README.md | 6 +-
.../extending/add-apt-packages/Dockerfile | 2 +-
.../add-build-essential-extend/Dockerfile | 2 +-
.../extending/add-providers/Dockerfile | 2 +-
.../extending/add-pypi-packages/Dockerfile | 2 +-
.../extending/embedding-dags/Dockerfile | 2 +-
.../extending/writable-directory/Dockerfile | 2 +-
docs/docker-stack/entrypoint.rst | 14 +-
docs/exts/docs_build/third_party_inventories.py | 2 +-
docs/spelling_wordlist.txt | 3 +
licenses/LICENSES-ui.txt | 1515 ++++++++++++++++++++
scripts/ci/pre_commit/pre_commit_setup_cfg_file.sh | 2 +-
scripts/ci/pre_commit/supported_versions.py | 2 +-
setup.cfg | 5 +-
setup.py | 214 +--
tests/always/test_project_structure.py | 355 -----
tests/cli/commands/test_triggerer_command.py | 2 +-
tests/core/test_configuration.py | 46 +
tests/core/test_core_to_contrib.py | 125 --
tests/dag_processing/test_manager.py | 83 +-
tests/dag_processing/test_processor.py | 25 -
tests/executors/test_base_executor.py | 60 +-
tests/executors/test_dask_executor.py | 57 +-
tests/jobs/test_scheduler_job.py | 129 +-
tests/jobs/test_triggerer_job.py | 147 +-
tests/kubernetes/test_client.py | 28 +-
tests/kubernetes/test_refresh_config.py | 37 -
tests/models/test_pool.py | 6 +
tests/models/test_taskinstance.py | 23 +
tests/models/test_trigger.py | 52 +
.../cloud/operators/test_cloud_memorystore.py | 529 -------
.../operators/test_cloud_memorystore_system.py | 51 -
tests/providers/zendesk/hooks/test_zendesk.py | 118 --
tests/secrets/test_local_filesystem.py | 17 +
tests/sensors/test_external_task_sensor.py | 9 +-
tests/sensors/test_filesystem.py | 36 +-
.../task/task_runner/test_standard_task_runner.py | 24 +-
.../test_operator_resources.py} | 24 +-
tests/www/views/test_views_connection.py | 15 +
118 files changed, 4386 insertions(+), 3272 deletions(-)
delete mode 100644 .github/workflows/build-images.yml
delete mode 100644 .github/workflows/codeql-analysis.yml
delete mode 100644 .github/workflows/label_when_reviewed.yml
delete mode 100644 .github/workflows/label_when_reviewed_workflow_run.yml
delete mode 100644 .github/workflows/stale.yml
delete mode 100644 airflow/kubernetes/refresh_config.py
create mode 100644 airflow/providers/cncf/kubernetes/utils/pod_manager.py
copy {tests/timetables => airflow/providers/dbt}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/dbt/cloud}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/github}/__init__.py (100%)
delete mode 100644 airflow/providers/google/cloud/example_dags/example_cloud_memorystore.py
create mode 100644 docs/apache-airflow/img/watcher.png
create mode 100644 licenses/LICENSES-ui.txt
delete mode 100644 tests/always/test_project_structure.py
delete mode 100644 tests/core/test_core_to_contrib.py
delete mode 100644 tests/kubernetes/test_refresh_config.py
delete mode 100644 tests/providers/google/cloud/operators/test_cloud_memorystore.py
delete mode 100644 tests/providers/google/cloud/operators/test_cloud_memorystore_system.py
delete mode 100644 tests/providers/zendesk/hooks/test_zendesk.py
copy tests/{providers/amazon/aws/hooks/test_sqs.py => utils/test_operator_resources.py} (67%)