You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2021/09/11 20:26:02 UTC
[airflow] branch v2-1-stable updated (2b80c1e -> 9168a0b)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch v2-1-stable
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 2b80c1e Bump ``sphinxcontrib-spelling`` and minor improvements (#16675)
add 4d63c0f Improve cross-links to operators and hooks references (#17622)
add 0f3cbb0 Doc: Fix replacing Airflow version for Docker stack (#17711)
add 4f2486f Bump `pip` version to `21.2.4` (#17746)
add c0572c7 make the providers operators/hooks reference much more usable (#17768)
add 4f560d3 Update description about the new ``connection-types`` provider meta-data
add f312e17 Improve discoverability of Provider packages' functionality
add a334ad4 Fix constraint generation properly (#17964)
add 61332ba Suggest to use secrets backend for variable when it contains sensitive data (#17319)
add 2690c79 Improve the description of how to handle dynamic task generation (#17963)
add bc5e75f Reapply "Build CI images for the merge result of a PR, not the tip of the PR (#18060)" (#18086)
add ecae2ae Fix building documentation broken by upgrade of dnspython (#18046)
add 92899ca Add Python2 to installed packages (#18037)
add 6c2ae7d Fix constraints generation scripts. (#18094)
add fada02f Eager upgrade for Airflow 2.1. should now include celery 4 limit
add ae06868 Move instriuctions of constraint/image refreshing to dev
add c11d368 Sane detection of the host/port in entrypoint prod (#17847)
add 59bf5b5 Do not delete running DAG from the UI (#17630)
add 34fbe0d Add root to tree refresh url (#17633)
add 6866a7c Fix wrong query on running tis (#17631)
add 8ecc710 Increase width for Run column (#17817)
add d5ec5c7 Improve graph view load time for dags with open groups (#17821)
add a8bbb83 Only show Pause/Unpause tooltip on hover (#17957)
add 9f98a7d Limit colorlog version (6.x is incompatible) (#18099)
add f9c337f Fix Sentry handler from LocalTaskJob causing error (#18119)
add 6c59622 Fixes incorrect parameter passed to views (#18083) (#18085)
add d338aa7 Fix Clear task instances endpoint resets all DAG runs bug (#17961)
add 19f32fd Improve dag/task concurrency check (#17786)
add 24ead01 Hide variable import form if user lacks permission (#18000)
add c2298bc Fix log links on graph TI modal (#17862)
add 464e1e1 Avoid endless redirect loop when user has no roles (#17613)
add 8a1990b Avoid redirect loop for users with no permissions (#17838)
add ac6d99f Fix max_active_runs not allowing moving of queued dagruns to running (#17945)
add c1723ac Fix DagRun execution order from queued to running not being properly followed (#18061)
add 247382f Limit the number of queued dagruns created by the Scheduler (#18065)
add f5f70e0 Fix deprecation error message rather than silencing it (#18126)
add 0ee20ff Update version added fields in airflow/config_templates/config.yml (#18128)
add a3728cf Do not let create_dagrun overwrite explicit run_id (#17728)
add 58b562c Bump version to 2.1.4
add 9bb26b7 Fixes warm shutdown for celery worker. (#18068)
add ccdc121 Regression on pid reset to allow task start after heartbeat (#17333)
add 1621890 Add Changelog for 2.1.4
add 1f938d6 Improves quick-start docker-compose warnings and documentation
add e4df035 Fix spelling mistake
add 7763949 Fix missing `create_dummy_dag` fixture
add af0e684 Fix `TestSecurity.test_current_user_has_permissions` (#17916)
add bae5be0 Separate Installing from sources section and add more details (#18171)
add 9168a0b Clearly document no breaking change for ``>=2.1.2, <=2.1.4``
No new revisions were added by this update.
Summary of changes:
.github/workflows/build-images.yml | 41 ++-
CHANGELOG.txt | 42 +++
CI.rst | 408 ++++++++++-----------
CONTRIBUTING.rst | 39 --
Dockerfile | 12 +-
Dockerfile.ci | 9 +-
IMAGES.rst | 2 +-
README.md | 16 +-
UPDATING.md | 15 +
airflow/api/common/experimental/delete_dag.py | 11 +-
.../endpoints/task_instance_endpoint.py | 2 +-
airflow/config_templates/config.yml | 136 +++----
airflow/config_templates/default_airflow.cfg | 4 +
airflow/configuration.py | 4 +-
airflow/jobs/scheduler_job.py | 28 +-
...5d12_add_max_active_runs_column_to_dagmodel_.py | 59 +++
...6fe78_add_index_on_state_dag_id_for_queued_.py} | 34 +-
airflow/models/dag.py | 39 +-
airflow/models/dagrun.py | 51 ++-
airflow/models/taskinstance.py | 1 +
airflow/providers/airbyte/provider.yaml | 2 +-
airflow/providers/amazon/provider.yaml | 2 +-
airflow/providers/apache/cassandra/provider.yaml | 2 +-
airflow/providers/apache/drill/provider.yaml | 2 +-
airflow/providers/apache/druid/provider.yaml | 2 +-
airflow/providers/apache/hdfs/provider.yaml | 2 +-
airflow/providers/apache/hive/provider.yaml | 2 +-
airflow/providers/apache/livy/provider.yaml | 2 +-
airflow/providers/apache/pig/provider.yaml | 2 +-
airflow/providers/apache/spark/provider.yaml | 2 +-
airflow/providers/apache/sqoop/provider.yaml | 2 +-
airflow/providers/asana/provider.yaml | 2 +-
airflow/providers/cloudant/provider.yaml | 2 +-
airflow/providers/cncf/kubernetes/provider.yaml | 2 +-
airflow/providers/databricks/provider.yaml | 2 +-
airflow/providers/dingding/provider.yaml | 2 +-
airflow/providers/discord/provider.yaml | 2 +-
airflow/providers/docker/provider.yaml | 2 +-
airflow/providers/elasticsearch/provider.yaml | 2 +-
airflow/providers/exasol/provider.yaml | 2 +-
airflow/providers/facebook/provider.yaml | 2 +-
airflow/providers/ftp/provider.yaml | 2 +-
airflow/providers/google/provider.yaml | 2 +-
airflow/providers/grpc/provider.yaml | 2 +-
airflow/providers/hashicorp/provider.yaml | 2 +-
airflow/providers/http/provider.yaml | 2 +-
airflow/providers/imap/provider.yaml | 2 +-
airflow/providers/jdbc/provider.yaml | 2 +-
airflow/providers/jenkins/provider.yaml | 2 +-
airflow/providers/jira/provider.yaml | 2 +-
airflow/providers/microsoft/azure/provider.yaml | 2 +-
airflow/providers/microsoft/mssql/provider.yaml | 2 +-
airflow/providers/mongo/provider.yaml | 2 +-
airflow/providers/mysql/provider.yaml | 2 +-
airflow/providers/neo4j/provider.yaml | 2 +-
airflow/providers/odbc/provider.yaml | 2 +-
airflow/providers/opsgenie/provider.yaml | 2 +-
airflow/providers/oracle/provider.yaml | 2 +-
airflow/providers/postgres/provider.yaml | 2 +-
airflow/providers/presto/provider.yaml | 2 +-
airflow/providers/qubole/provider.yaml | 2 +-
airflow/providers/redis/provider.yaml | 2 +-
airflow/providers/salesforce/provider.yaml | 3 +-
airflow/providers/samba/provider.yaml | 2 +-
airflow/providers/segment/provider.yaml | 2 +-
airflow/providers/sftp/provider.yaml | 2 +-
airflow/providers/slack/provider.yaml | 2 +-
airflow/providers/snowflake/provider.yaml | 2 +-
airflow/providers/sqlite/provider.yaml | 2 +-
airflow/providers/ssh/provider.yaml | 2 +-
airflow/providers/tableau/provider.yaml | 2 +-
airflow/providers/trino/provider.yaml | 2 +-
airflow/providers/vertica/provider.yaml | 2 +-
airflow/providers/yandex/provider.yaml | 2 +-
airflow/sentry.py | 15 +-
airflow/www/auth.py | 17 +-
airflow/www/security.py | 6 +
airflow/www/static/js/dag.js | 2 +
airflow/www/static/js/dags.js | 8 +-
airflow/www/static/js/graph.js | 20 +-
airflow/www/static/js/tree.js | 3 +-
airflow/www/templates/airflow/dags.html | 2 +-
.../{circles.html => no_roles_permissions.html} | 22 +-
airflow/www/templates/airflow/tree.html | 1 +
airflow/www/templates/airflow/variable_list.html | 2 +
airflow/www/views.py | 14 +
chart/templates/workers/worker-deployment.yaml | 3 +
dev/REFRESHING_CI_CACHE.md | 94 +++++
.../refresh_images.sh | 27 +-
.../logging/cloud-watch-task-handlers.rst | 2 +-
.../logging/s3-task-handler.rst | 2 +-
.../index.rst | 2 +-
.../{logging.rst => logging/index.rst} | 6 +-
.../redirects.txt | 1 +
.../logging/gcs.rst | 2 +-
.../logging/index.rst | 4 +-
.../logging/stackdriver.rst | 2 +-
.../index.rst | 2 +-
.../{logging.rst => logging/index.rst} | 2 +-
.../redirects.txt | 1 +
.../auth-backends.rst} | 28 +-
.../apache.rst => core-extensions/connections.rst} | 33 +-
.../extra-links.rst} | 28 +-
.../core-extensions}/index.rst | 10 +-
.../software.rst => core-extensions/logging.rst} | 26 +-
.../secrets-backends.rst} | 34 +-
.../howto/create-update-providers.rst | 17 +-
docs/apache-airflow-providers/index.rst | 239 +++++++-----
.../operators-and-hooks-ref/apache.rst | 8 +-
.../operators-and-hooks-ref/aws.rst | 8 +-
.../operators-and-hooks-ref/azure.rst | 8 +-
.../operators-and-hooks-ref/google.rst | 8 +-
.../operators-and-hooks-ref/index.rst | 4 +-
.../operators-and-hooks-ref/protocol.rst | 8 +-
.../operators-and-hooks-ref/services.rst | 8 +-
.../operators-and-hooks-ref/software.rst | 8 +-
docs/apache-airflow/best-practices.rst | 149 +++++++-
docs/apache-airflow/concepts/connections.rst | 10 +
docs/apache-airflow/concepts/operators.rst | 18 +-
docs/apache-airflow/howto/connection.rst | 12 +-
docs/apache-airflow/howto/define_extra_link.rst | 7 +-
docs/apache-airflow/index.rst | 1 +
docs/apache-airflow/installation.rst | 17 -
docs/apache-airflow/installing-from-sources.rst | 114 ++++++
.../logging-monitoring/logging-tasks.rst | 11 +-
docs/apache-airflow/migrations-ref.rst | 6 +-
docs/apache-airflow/operators-and-hooks-ref.rst | 7 +-
docs/apache-airflow/security/index.rst | 2 -
.../security/secrets/secrets-backend/index.rst | 26 +-
docs/apache-airflow/start/docker-compose.yaml | 67 +++-
docs/apache-airflow/start/docker.rst | 56 ++-
docs/build_docs.py | 75 +++-
docs/conf.py | 7 +
docs/docker-stack/build-arg-ref.rst | 78 ++--
docs/docker-stack/build.rst | 2 +-
docs/docker-stack/entrypoint.rst | 41 +++
docs/docker-stack/index.rst | 10 +-
.../exts/auth_backend.rst.jinja2 | 13 +-
.../exts/connections.rst.jinja2 | 17 +-
docs/exts/exampleinclude.py | 6 +
.../exts/extra_links.rst.jinja2 | 13 +-
.../exts/logging.rst.jinja2 | 17 +-
docs/exts/operators_and_hooks_ref.py | 246 +++++++++++--
.../exts/secret_backend.rst.jinja2 | 13 +-
docs/helm-chart/manage-logs.rst | 2 +-
scripts/ci/docker-compose/_docker.env | 1 +
scripts/ci/libraries/_build_images.sh | 68 ++--
scripts/ci/libraries/_initialization.sh | 13 +-
scripts/ci/selective_ci_checks.sh | 21 +-
scripts/in_container/prod/entrypoint_prod.sh | 25 +-
scripts/in_container/run_generate_constraints.sh | 49 ++-
setup.cfg | 2 +-
setup.py | 9 +-
tests/api/common/experimental/test_delete_dag.py | 29 +-
tests/conftest.py | 72 +++-
tests/jobs/test_scheduler_job.py | 257 +++++++++++++
tests/models/test_dag.py | 34 +-
tests/www/test_security.py | 21 ++
tests/www/views/test_views_acl.py | 57 +++
tests/www/views/test_views_base.py | 2 +-
tests/www/views/test_views_variable.py | 35 +-
161 files changed, 2527 insertions(+), 1010 deletions(-)
create mode 100644 airflow/migrations/versions/092435bf5d12_add_max_active_runs_column_to_dagmodel_.py
copy airflow/migrations/versions/{2e541a1dcfed_task_duration.py => ccde3e26fe78_add_index_on_state_dag_id_for_queued_.py} (55%)
copy airflow/www/templates/airflow/{circles.html => no_roles_permissions.html} (59%)
create mode 100644 dev/REFRESHING_CI_CACHE.md
copy scripts/ci/constraints/ci_generate_constraints.sh => dev/refresh_images.sh (58%)
rename docs/apache-airflow-providers-elasticsearch/{logging.rst => logging/index.rst} (98%)
create mode 100644 docs/apache-airflow-providers-elasticsearch/redirects.txt
rename docs/apache-airflow-providers-microsoft-azure/{logging.rst => logging/index.rst} (98%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/protocol.rst => core-extensions/auth-backends.rst} (57%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/apache.rst => core-extensions/connections.rst} (52%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/extra-links.rst} (58%)
copy docs/{apache-airflow-providers-amazon/secrets-backends => apache-airflow-providers/core-extensions}/index.rst (80%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/logging.rst} (67%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/apache.rst => core-extensions/secrets-backends.rst} (50%)
create mode 100644 docs/apache-airflow/installing-from-sources.rst
copy airflow/www/templates/airflow/noaccess.html => docs/exts/auth_backend.rst.jinja2 (76%)
copy airflow/www/templates/airflow/ti_code.html => docs/exts/connections.rst.jinja2 (72%)
copy airflow/www/templates/airflow/noaccess.html => docs/exts/extra_links.rst.jinja2 (75%)
copy airflow/www/templates/airflow/variable_edit.html => docs/exts/logging.rst.jinja2 (74%)
copy airflow/www/templates/airflow/noaccess.html => docs/exts/secret_backend.rst.jinja2 (76%)