You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ep...@apache.org on 2023/03/07 14:46:48 UTC
[airflow] branch v2-5-test updated (2ec4d063b6 -> c2625fb75c)
This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch v2-5-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 2ec4d063b6 Sanitize url_for arguments before they are passed (#29039)
new 902bee29ed Fix leak sensitive field via V1EnvVar on exception (#29016)
new 60d616b107 Clarify graph view dynamic task labels (#29042)
new c768036d0d Fix kerberos authentication for the REST API. (#29054)
new 138bc30d81 Handling error on cluster policy itself (#29056)
new 1248051a0c Fix pre-commit warning for exclude in inclusive-language check (#29057)
new 53280dac3c Several improvements to the Params doc (#29062)
new 47da669f46 Capitalize dag to DAG (#29064)
new ad75a7729e Check for run_id url param when linking to graph/gantt views (#29066)
new 200b6ed74b emit dagrun failed duration when timeout (#29076)
new 9a1a9840fc Remove upper bound limitation for `pytest` (#29086)
new 33b6351fea Fix warning in migrations about old config. (#29092)
new e8e1e19863 Explicit a few steps in the release process (#29098)
new 166dc2beda Update set-up-database.rst (#29104)
new 90c645e942 PR: Introduced fix to run tasks on Windows systems (#29107)
new 4c2019b4d7 Fix integration with `codecov` (#29145)
new 359f0c39df Remove poke method to fall back to parent implementation (#29146)
new efa27cc4a4 General cleanup of things around KubernetesExecutor (#29148)
new 1fdaa53c6c Update broken link for VS Code Quick Start guide (#29154)
new 6b9763ba2a Use `pod_name` when patching done KE pods (#29159)
new b4ead09f3d fixed et.c type to etc. (#29163)
new aefabcb2b6 Remove misleading docstring on dagrun_timeout (#29169)
new 44038c5953 Bump ua-parser-js from 0.7.31 to 0.7.33 in /airflow/www (#29172)
new fc99bdddcc Fix dev-mode start-airflow in Breeze (#29225)
new bf30b42357 Fixing Task Duration view in case of manual DAG runs only (#22015) (#29195)
new c87453d489 Clarify that executor interface is public but instances are not (#29200)
new 6b73b5b7a8 Add trigger process to Airflow Docker docs (#29203)
new 29d8980f82 SQLA20: Replace Query(pk).get by `Session.get` (#29205)
new c03294f2ba redirect to the origin page with all the params (#29212)
new 884d922e6a Fix commit title for constraint commits (#29236)
new af42d5954c Update package version for go and python client (#29218)
new 38311e2c20 Clarify description of worker control config (#29247)
new 5217b969d7 Fixed grammatical issue (#29253)
new c629fcccb3 Use `schedule` param rather than `timetable` in Timetables docs (#29255)
new 76d25a2821 Initialize and validate conf early and intentionally (#29257)
new 0fe89eb3ed Change awkward wording about extenibility (#29261)
new acc30def85 Remove `notes` param from TriggerDagRunOperator docstring (#29298)
new e75134ac99 Fixed link to airflow variable in docs (#29338)
new 47196075c3 remove /legacy_tree endpoint (#29359)
new d3a13fc2e1 Missing timezone in next_dagrun in parameterized docs (#29362)
new f48938f249 Increase max height for grid view elements (#29367)
new f0cabe5b76 Remove stderr redirection for get-workflow-info (#29381)
new 52d556c13c Mark Airflow directory in container as safe for git commands (#29386)
new 13fe8e72dd Persist DAG and task doc values in TaskFlow API if explicitly set (#29399)
new d70a9ba7fe Ensure Serialized DAG is deleted (#29407)
new 2a6df3e0b2 Improve health checks in example docker-compose and clarify usage (#29408)
new e1eabff422 Fix Rest API update user output (#29409)
new c754208241 Edgemodifier refactoring w/ labels in TaskGroup edge case (#29410)
new 7eb60a37e5 Bring back fixed tenacity (#29440)
new 5293ff67c2 Remove ssh.rst from private-key check (#29412)
new 5190f951fe datasets, next_run_datasets, remove unnecessary timestamp filter (#29441)
new 7ddfc9ee58 Fix nested fields rendering in mapped operators (#29451)
new b463f8a345 Make `prev_logical_date` variable offset-aware (#29454)
new 0c02cd2929 Use newer setuptools v67.2.0 (#29465)
new 4dca602d6c Use non-deprecated method when unpause DAG in the UI (#29475)
new 63f84df0a0 Change permissions of config/password files created by airflow (#29495)
new 20d648f5ab Do not show version/node in UI traceback for unauthenticated user (#29501)
new fc8665f662 Add Landing Times entry to UI docs (#29511)
new fad72bf0e9 Make options output of breeze command consistent and complete (#29097)
new 3baed4f54f Remove section check from get-value command (#29541)
new 32d006b058 detect is 'docker-compose' existing (#29544)
new 7cf7aa8bef Don't display empty rendered attrs in Task Instance Details page (#29545)
new cfb61e1166 Change expose_hostname default to false (#29547)
new c2625fb75c Update issue triage policy (#29554)
The 63 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.coveragerc | 27 +-
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 2 +-
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 2 +-
.../airflow_helmchart_bug_report.yml | 2 +-
.../airflow_providers_bug_report.yml | 2 +-
.github/ISSUE_TEMPLATE/feature_request.yml | 2 +-
.github/actions/codecov-action | 1 -
.../get-target-branch-build-scripts/action.yml | 1 -
.github/actions/post_tests/action.yml | 20 +-
.github/workflows/build-images.yml | 2 +-
.github/workflows/ci.yml | 42 +-
.github/workflows/codeql-analysis.yml | 2 +-
.github/workflows/release_dockerhub_image.yml | 2 +-
.github/workflows/stale.yml | 19 +
.gitmodules | 3 -
.pre-commit-config.yaml | 3 +-
BREEZE.rst | 39 +-
CONTRIBUTORS_QUICK_START_CODESPACES.rst | 2 +-
Dockerfile.ci | 5 +-
ISSUE_TRIAGE_PROCESS.rst | 22 +-
airflow/__init__.py | 8 +
airflow/api/auth/backend/kerberos_auth.py | 4 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 2 +-
.../api_connexion/endpoints/event_log_endpoint.py | 2 +-
.../endpoints/import_error_endpoint.py | 2 +-
.../endpoints/task_instance_endpoint.py | 8 +-
airflow/api_connexion/openapi/v1.yaml | 2 +-
airflow/cli/commands/config_command.py | 3 -
airflow/cli/commands/standalone_command.py | 3 +-
airflow/config_templates/config.yml | 11 +-
airflow/config_templates/default_airflow.cfg | 11 +-
airflow/configuration.py | 15 +
airflow/dag_processing/processor.py | 2 +-
airflow/decorators/base.py | 4 +-
airflow/decorators/sensor.py | 5 -
airflow/exceptions.py | 4 +
airflow/executors/kubernetes_executor.py | 28 +-
airflow/jobs/local_task_job.py | 6 +-
airflow/jobs/scheduler_job.py | 6 +-
airflow/kubernetes/pod_generator.py | 2 +-
...2_0_0_add_scheduling_decision_to_dagrun_and_.py | 2 +-
airflow/models/abstractoperator.py | 4 +-
airflow/models/dag.py | 39 +-
airflow/models/dagbag.py | 32 +-
airflow/models/dagrun.py | 2 +-
airflow/models/mappedoperator.py | 6 +-
airflow/models/serialized_dag.py | 2 +-
airflow/models/taskmixin.py | 14 +-
airflow/operators/trigger_dagrun.py | 1 -
airflow/utils/edgemodifier.py | 145 +++---
airflow/utils/log/secrets_masker.py | 17 +-
airflow/utils/task_group.py | 18 +-
airflow/www/auth.py | 2 +-
airflow/www/extensions/init_jinja_globals.py | 2 +-
airflow/www/fab_security/sqla/manager.py | 4 +-
airflow/www/static/js/dag/details/Dag.tsx | 3 -
airflow/www/static/js/dag/details/dagRun/index.tsx | 3 -
.../js/dag/details/taskInstance/Logs/LogBlock.tsx | 2 +-
.../static/js/dag/details/taskInstance/index.tsx | 4 -
airflow/www/static/js/dag/grid/index.tsx | 2 +-
airflow/www/static/js/graph.js | 17 +-
airflow/www/static/js/types/api-generated.ts | 2 +-
airflow/www/static/js/utils/useOffsetHeight.tsx | 2 +-
airflow/www/templates/airflow/dag.html | 8 +-
airflow/www/templates/airflow/task.html | 6 +-
airflow/www/views.py | 50 +-
airflow/www/yarn.lock | 6 +-
clients/gen/go.sh | 2 +-
clients/gen/python.sh | 2 +-
codecov.yml | 15 +-
dev/README_RELEASE_AIRFLOW.md | 49 +-
.../src/airflow_breeze/commands/ci_commands.py | 12 +-
.../airflow_breeze/commands/ci_commands_config.py | 2 +
.../airflow_breeze/commands/ci_image_commands.py | 3 +-
.../commands/ci_image_commands_config.py | 1 -
.../commands/kubernetes_commands_config.py | 4 -
.../commands/production_image_commands_config.py | 1 -
.../commands/release_candidate_command.py | 2 +
.../commands/release_management_commands_config.py | 14 +-
.../src/airflow_breeze/commands/setup_commands.py | 117 +++++
.../commands/setup_commands_config.py | 9 +
.../commands/testing_commands_config.py | 1 +
.../src/airflow_breeze/utils/custom_param_types.py | 4 +
.../src/airflow_breeze/utils/github_actions.py | 4 +-
dev/breeze/src/airflow_breeze/utils/path_utils.py | 1 +
dev/breeze/src/airflow_breeze/utils/run_utils.py | 12 +-
.../src/airflow_breeze/utils/selective_checks.py | 36 +-
dev/breeze/tests/test_commands.py | 6 +
dev/provider_packages/prepare_provider_packages.py | 32 +-
.../cluster-policies.rst | 4 +-
.../logging-monitoring/errors.rst | 2 +-
.../logging-monitoring/metrics.rst | 2 +-
.../modules_management.rst | 6 +-
.../production-deployment.rst | 4 +-
.../administration-and-deployment/scheduler.rst | 4 +-
.../security/access-control.rst | 4 +-
.../administration-and-deployment/security/api.rst | 3 +
.../security/kerberos.rst | 4 +-
.../authoring-and-scheduling/timetable.rst | 10 +-
docs/apache-airflow/best-practices.rst | 4 +-
docs/apache-airflow/core-concepts/dag-run.rst | 2 +-
docs/apache-airflow/core-concepts/dags.rst | 2 +-
.../core-concepts/executor/debug.rst | 2 +-
.../core-concepts/executor/kubernetes.rst | 10 +-
docs/apache-airflow/core-concepts/params.rst | 64 +--
docs/apache-airflow/core-concepts/xcoms.rst | 2 +-
docs/apache-airflow/deprecated-rest-api-ref.rst | 4 +-
docs/apache-airflow/faq.rst | 14 +-
docs/apache-airflow/howto/add-dag-tags.rst | 2 +-
docs/apache-airflow/howto/custom-operator.rst | 4 +-
.../apache-airflow/howto/docker-compose/airflow.sh | 11 +-
.../howto/docker-compose/docker-compose.yaml | 40 +-
docs/apache-airflow/howto/docker-compose/index.rst | 1 +
.../howto/dynamic-dag-generation.rst | 10 +-
docs/apache-airflow/howto/set-up-database.rst | 2 +-
docs/apache-airflow/howto/timetable.rst | 18 +-
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/img/landing_times.png | Bin 0 -> 84125 bytes
docs/apache-airflow/public-airflow-interface.rst | 19 +-
docs/apache-airflow/start.rst | 4 +-
docs/apache-airflow/templates-ref.rst | 4 +-
docs/apache-airflow/tutorial/fundamentals.rst | 2 +-
docs/apache-airflow/tutorial/taskflow.rst | 2 +-
docs/apache-airflow/ui.rst | 18 +-
docs/conf.py | 1 +
images/breeze/output-commands-hash.txt | 16 +-
images/breeze/output_build-docs.svg | 115 ++---
images/breeze/output_ci-image.svg | 34 +-
images/breeze/output_ci-image_build.svg | 296 ++++++------
images/breeze/output_ci-image_pull.svg | 62 +--
images/breeze/output_ci-image_verify.svg | 34 +-
images/breeze/output_ci.svg | 90 ++--
.../breeze/output_ci_find-newer-dependencies.svg | 56 +--
images/breeze/output_ci_fix-ownership.svg | 22 +-
images/breeze/output_ci_free-space.svg | 20 +-
images/breeze/output_ci_get-workflow-info.svg | 20 +-
images/breeze/output_ci_resource-check.svg | 16 +-
images/breeze/output_ci_selective-check.svg | 38 +-
images/breeze/output_cleanup.svg | 26 +-
images/breeze/output_compile-www-assets.svg | 24 +-
images/breeze/output_exec.svg | 16 +-
images/breeze/output_k8s.svg | 58 +--
images/breeze/output_k8s_build-k8s-image.svg | 50 +-
images/breeze/output_k8s_configure-cluster.svg | 58 +--
images/breeze/output_k8s_create-cluster.svg | 62 +--
images/breeze/output_k8s_delete-cluster.svg | 32 +-
images/breeze/output_k8s_deploy-airflow.svg | 68 +--
images/breeze/output_k8s_k9s.svg | 30 +-
images/breeze/output_k8s_logs.svg | 34 +-
images/breeze/output_k8s_run-complete-tests.svg | 88 ++--
images/breeze/output_k8s_setup-env.svg | 22 +-
images/breeze/output_k8s_shell.svg | 38 +-
images/breeze/output_k8s_status.svg | 34 +-
images/breeze/output_k8s_tests.svg | 66 +--
images/breeze/output_k8s_upload-k8s-image.svg | 56 +--
images/breeze/output_prod-image.svg | 74 +--
images/breeze/output_prod-image_build.svg | 192 ++++----
images/breeze/output_prod-image_pull.svg | 60 +--
images/breeze/output_prod-image_verify.svg | 34 +-
images/breeze/output_release-management.svg | 36 +-
...put_release-management_generate-constraints.svg | 62 +--
...t_release-management_generate-issue-content.svg | 64 +--
..._release-management_prepare-airflow-package.svg | 28 +-
...e-management_prepare-provider-documentation.svg | 65 +--
...elease-management_prepare-provider-packages.svg | 30 +-
...tput_release-management_release-prod-images.svg | 46 +-
...release-management_verify-provider-packages.svg | 140 +++---
images/breeze/output_setup.svg | 9 +-
images/breeze/output_setup_autocomplete.svg | 24 +-
images/breeze/output_setup_config.svg | 40 +-
images/breeze/output_setup_self-upgrade.svg | 18 +-
images/breeze/output_setup_version.svg | 16 +-
images/breeze/output_stop.svg | 22 +-
images/breeze/output_testing.svg | 24 +-
.../breeze/output_testing_docker-compose-tests.svg | 32 +-
images/breeze/output_testing_helm-tests.svg | 34 +-
images/breeze/output_testing_integration-tests.svg | 70 +--
images/breeze/output_testing_tests.svg | 90 ++--
newsfragments/29547.significant.rst | 3 +
pyproject.toml | 2 +-
scripts/ci/constraints/ci_commit_constraints.sh | 2 +-
.../pre_commit_compile_www_assets_dev.py | 7 +-
scripts/docker/entrypoint_ci.sh | 5 +-
scripts/in_container/run_ci_tests.sh | 1 -
.../in_container/run_prepare_airflow_packages.sh | 7 +
setup.cfg | 2 +-
setup.py | 10 +-
tests/always/test_connection.py | 2 +-
.../endpoints/test_task_instance_endpoint.py | 10 +-
tests/cli/commands/test_config_command.py | 12 +-
tests/cli/commands/test_dag_command.py | 2 +-
tests/conftest.py | 2 +-
tests/dag_processing/test_manager.py | 2 +-
tests/decorators/test_python.py | 25 +-
tests/executors/test_kubernetes_executor.py | 11 +-
tests/jobs/test_scheduler_job.py | 15 +-
tests/models/test_dag.py | 210 ++++++---
tests/models/test_mappedoperator.py | 10 +-
tests/models/test_serialized_dag.py | 14 +-
tests/models/test_variable.py | 2 +-
tests/test_utils/mock_operators.py | 41 +-
tests/utils/test_edgemodifier.py | 501 +++++++++++++++++++++
tests/www/views/test_views_connection.py | 2 +-
tests/www/views/test_views_tasks.py | 13 +
204 files changed, 3040 insertions(+), 2003 deletions(-)
delete mode 160000 .github/actions/codecov-action
create mode 100644 docs/apache-airflow/img/landing_times.png
create mode 100644 newsfragments/29547.significant.rst