You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ur...@apache.org on 2021/09/07 12:16:32 UTC

[airflow] branch aip-39-docs updated (9238ce6 -> a4cb8f5)

This is an automated email from the ASF dual-hosted git repository.

uranusjr pushed a change to branch aip-39-docs
in repository https://gitbox.apache.org/repos/asf/airflow.git.


 discard 9238ce6  Mention data interval and add timetable how-to
     add f38ebaf  Make output from users cli command more consistent (#17642)
     add 29aab64  Adds secrets backend/logging/auth information to provider yaml (#17625)
     add 84df864  Fix wrong query on running tis (#17631)
     add 1d3c729  Only run 2.2.0 providers commands for Airflow >= 2.2.0 (#17647)
     add 0282f41  Forces rebuilding the image for cache pushing (#17635)
     add e99624d  Speed up tests that use BackfillJob (#17648)
     add c22ed08  Chart: use serviceaccount template for log reader rolebinding (#17645)
     add 808fb2a  Add Changelog updates for 2.1.3 (#17644)
     add 495535b  Update pre-commit checks-flynt to 0.66 (#17672)
     add dfdffa6  Fix link to generating constraints in BREEZE.rst (#17670)
     add 7c96800  Dev: Remove duplicate step to push Docker Image (#17674)
     add 1cd3d8f  Update docs on syncing forks (#17675)
     add d8c0cfe  Have the dag_maker fixture (optionally) give SerializedDAGs (#17577)
     add 6868ca4  Avoid endless redirect loop when user has no roles (#17613)
     add cbd9ad2  Remove the use of multiprocessing in TestLocalTaskJob and Improve Tests (#17581)
     add 83a2858  Docs: Make ``DAG.is_active`` read-only in API (#17667)
     add be9911c  Renames main workflow to `Tests` (#17650)
     add 4e59741  Remove legacy image convention (#17692)
     add 9863811  Chart: fix running with uid 0 (#17688)
     add 9b2e593  Fix sqlite hook - insert and replace functions (#17695)
     add 9922287  Replace execution_date with run_id in airflow tasks run command (#16666)
     add 0016007  hdfs provider: allow SSL webhdfs connections (#17637)
     add c698204  Add steps for building release package without breeze. (#17702)
     add 09828a5  docs(impersonation): update note so avoid misintrepretation (#17701)
     add 79c1a0e  Add ``Scribd`` to INTHEWILD.md (#17685)
     add b6c20a8  docs(dagowner): describe dag owner more carefully (#17699)
     add d5a6dc7  Minor doc formatting fix (#17704)
     add 87e64fa  Clearly document no breaking change for 2.1.2 and 2.1.3 (#17706)
     add 32475fa  Sync DB Migrations with Airflow 2.1.3 (#17703)
     add 6040125  Adding support for multiple task-ids in the external task sensor (#17339)
     add b99d029  Add `v2-*-stable` to codecov branches (#17707)
     add fbf5163  Add a note about XCOMs push condition for K8sPodOperator docs (#17690)
     add d26b862  Add optional SQL parameters in ``RedshiftToS3Operator`` (#17640)
     add 3b41bb4  Doc: Replace deprecated param from docstrings (#17709)
     add bee48f3  Implemented Basic EKS Integration (#16571)
     add b68d193  Add error check for config_file parameter in GKEStartPodOperator (#17700)
     add 95b2685  Use `dag_maker` fixture in some test files under tests/models (#17556)
     add 8cdda20  Doc: Fix replacing Airflow version for Docker stack (#17711)
     add 6ba538f  Doc: Update Upgrade to 2 docs with Airflow 1.10.x EOL dates (#17710)
     add 4da4c18  Add support for configs, secrets, networks and replicas for DockerSwarmOperator (#17474)
     add b5e6661  Improve description of Python compatibility approach (#17721)
     add 02fbe44  Fix instructions of release to get proper path in shasum file (#17716)
     add 76ed2a4  Import Hooks lazily individually in providers manager (#17682)
     add 50771e0  Do not let create_dagrun overwrite explicit run_id (#17728)
     add 35a6c30  Rename ``task_concurrency`` to ``max_active_tis_per_dag`` (#17708)
     add e107891  Extend init_containers defined in pod_override (#17537)
     add 12709bf  Added table to view providers in Airflow ui under admin tab (#15385)
     add 35b8f50  Make sure "podcution-readiness` of docker-compose is well explained (#17731)
     add af9dc8b  Remove ``[core] store_dag_code`` & use DB to get Dag Code (#16342)
     add f654db8  Fix clean-logs after improper skipping of lost+found (#17739)
     add 83678b6  Fix comment in Helm Chart for worker ``logGroomerSidecar`` (#17742)
     add 8fde9a4  Rename ``none_failed_or_skipped`` by ``none_failed_min_one_success`` trigger rule (#17683)
     add 65684dd  Add logical_date to OpenAPI DAGRun schema (#17122)
     add 5d90bcb  Remove Marshmallow schema warnings (#17753)
     add 22e87b3  Separate infer_data_interval for data interval timetables (#17755)
     add 00dc3c4  Chart: Add loadBalancerSourceRanges in webserver and flower services (#17666)
     add 4fb184b  Add links to provider's documentation (#17736)
     add ebf3b4a  Bump `pip` version to `21.2.4` (#17746)
     add e21b54a  Ensure ``DateTimeTrigger`` receives a datetime object (#17747)
     add d04aa13  [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)
     add 02a33b5  Fetching and logging livy session logs for LivyOperrator (#17393)
     add d39ca78  Add triggerer to `docker-compose.yaml` file (#17745)
     add c4d043d  Fix failing main spellcheck build (#17761)
     add 3b99225  Chart docs: Format ``loadBalancerSourceRanges`` using code-block (#17763)
     add 73d2b72  Fix using XCom with ``KubernetesPodOperator`` (#17760)
     add c7f37a9  make the providers operators/hooks reference much more usable (#17768)
     add 11c5ce3  Improve pre-commit documentation (#17770)
     add 6511ce7  Fix ``TimeSensorAsync`` (#17748)
     add ccaff5a  Automatically use utf8mb3_general_ci collation for mysql (#17729)
     add 4ced69b  Remove deprecated metrics from metrics.rst (#17772)
     add 6301faa  Enable Connection creation from Vault parameters (#15013)
     add 5f159cb  Ensure that airflow modules are not imported too early in conftest (#17779)
     add ffb81ea  Improve dag/task concurrency check (#17786)
     add 1a929f7  Fix dag_processing.last_duration metric random holes (#17769)
     add 32bfb2f  Add Triggerer to Helm Chart (#17743)
     add d97e50f  Fix failing Helm Chart docs test (#17789)
     add cb9f0bd  Move Model collation args tests to correct folder (#17791)
     add a0ce41c  Add warning about https configuration in SimpleHttpOperator (#17783)
     add 6fdfa09  Chart: Update the default Airflow version to ``2.1.3`` (#17794)
     add 39a8b2c  Update ``README.md`` to point to Airflow 2.1.3 (#17793)
     add 3a7a65c  feat: Add Loadsmart in the list of companies using it (#17792)
     add be75dcd  Update description about the new ``connection-types`` provider meta-data
     add bcc7665  Improve discoverability of Provider packages' functionality
     add 36c5fd3  Move instriuctions of constraint/image refreshing to dev
     add 0264fea  Remove airflow dependency from http provider
     add 41e3a91  Fix missing whitespace in ``apply_default`` deprecation message (#17799)
     add bb5602c  Prepare release for Kubernetes Provider (#17798)
     add 3d96ad6  Add pre/post execution hooks (#17576)
     add 5019916  Fix: Mysql 5.7 id utf8mb3 (#14535)
     add c32ab51  Use one interpreter for Airflow and gunicorn (#17805)
     add 48b37dc  Fixes unbound variable during remote image check in Breeze (#17807)
     add 83167a6  API documentation spelling fix (#17811)
     add c4fd84a  fix EXTRA_LOGGER_NAMES param and related docs (#17808)
     add 98d45cb  Improves documentation about modules management (#17757)
     add 97f0065  Show all import_errors from zip files (#17759)
     add 806f06b  Fixed numeric list (#17813)
     add c203e77  Show import errors in DAG views (#17818)
     add 06e53f2  Chart: configurable number of retention days for log groomers (#17764)
     add 96f7e3f  Increase width for Run column (#17817)
     add a759499  Update INTHEWILD.md (#17832)
     add 45e61a9  Only show import errors for DAGs a user can access (#17835)
     add ea49c96  Fix typos in docs & ``bug_report`` template (#17809)
     add 7e93828  (docs): update README.md (#17806)
     add bfdda08  Improve graph view load time for dags with open groups (#17821)
     add 933d863  Fix broken MSSQL test (#17797)
     add e18b6a6  Avoid redirect loop for users with no permissions (#17838)
     add 41632e0  Fix provider.yaml errors due to exit(0) in test (#17858)
     add a2fd67d  Update to Celery 5 (#17397)
     add 275e0d1  Sane detection of the host/port in entrypoint prod (#17847)
     add 83f1f07  Fix log links on graph TI modal (#17862)
     add 87769db  Allow omission of `initial_node_count` if `node_pools` is specified (#17820)
     add aa5952e  Gcp ai hyperparameter tuning (#17790)
     add 4990176  Move setting of project ID after activating service account (#17866)
     add eec757d  Add Brent to Committers list (#17873)
     add 220678d  Allow google-auth < 3 and google-api-core < 3 (#17671)
     add 4d48305  Convert issue templates into forms (#17855)
     add 0abbd2d  Secrets backend failover (#16404)
     add 890bd43  Add an Amazon EMR on EKS provider package (#16766)
     add 997c31c  ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)
     add 606b697  Add Brent to ``CODEOWNERS`` (#17877)
     add 95279bd  Add back deleted comment (#17884)
     add e4d3da1  fix wrong documents around upgrade-check.rst (#17903)
     add d0bc11f  replace  to contributing quick start guide (#17908)
     add 42e13e1  Remove all deprecation warnings in providers (#17900)
     add 07405e6  [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)
     add 24aa34b  Fixed button size in "Actions" group. (#17902)
     add b5da846  Fix missing Data Fusion sensor integration (#17914)
     add e9bf127  Add doc warning about connections added via envvars (#17915)
     add 332406d  BugFix: ``TimeSensorAsync`` returns a naive datetime (#17875)
     add a3f9c69  Fix ``DagRunState`` enum query for ``MySQLdb`` driver (#17886)
     add 653c13e  Fix broken XCOM in EKSPodOperator (#17918)
     add 4a0711c  Fix `TestSecurity.test_current_user_has_permissions` (#17916)
     add 18cc31c  Add issue form template for Helm Chat (#17917)
     add 1d71441  Fix saving last choice of backend and other flags between breeze runs (#17913)
     add da99c3f  HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)
     add 0a68588  Add August 2021 Provider's documentation (#17890)
     add 098765e  Allow setting specific cwd for BashOperator (#17751)
     add 9028a78  Separate Managed Services for Airflow (#17926)
     add 3fc57de  Allow custom timetable as a DAG argument (#17414)
     add 2aa443f  Update error message to guide the user into self-help mostly (#17929)
     add 27c1150  Always upgrade to newer dependencies in main (#17939)
     add 5350cc2  Example xcom update (#17749)
     add eda8a51  Fix docs about login for hdfs connections (#17936)
     add dd8b04d  Fix grammar in `traceback.html` (#17942)
     add a29503e  Fix instantiating Vault Secret Backend during configuration (#17935)
     add eebfeec  Update docker.rst (#17882)
     add 1aca908  Adds Github Oauth example with team based authorization (#17896)
     add 9befaee  Fixing bug which restricted the visibility of ImportErrors (#17924)
     add 5007806  Add possibility to run DAGs from system tests and see DAGs logs (#17868)
     add 887ef6b  Add Next Run to UI (#17732)
     add 601f22c  Refactor BranchDayOfWeekOperator, DayOfWeekSensor (#17940)
     add 226a2b8  Queue support for DaskExecutor using Dask Worker Resources (#16829)
     add 9c19f0d  Improve MySqlToHiveOperator tests (#17958)
     add ee93935  Only show Pause/Unpause tooltip on hover (#17957)
     add fac06a1  Add robots.txt and X-Robots-Tag header (#17946)
     add fbdb688  Fix passing Jinja templates in ``DateTimeSensor`` (#17959)
     add 16b47ce  Invalidate Vault cached prop when not authenticated (#17387)
     add fe34582  New google operator: SQLToGoogleSheetsOperator (#17887)
     add 0791719  Add support for kinit options [-f|-F] and [-a|-A] (#17816)
     add 683fbd4  Fix Clear task instances endpoint resets all DAG runs bug (#17961)
     add fdbb798  Making spelling of "TaskFlow" consistent in docs (#17968)
     add 6914091  Update max_tis_per_query to better render on the webpage (#17971)
     add 9a0c10b  deduplicate running jobs on BigQueryInsertJobOperator (#17496)
     add 4d52207  Add missing menu access for dag dependencies and configurations pages (#17450)
     add 617fed9  Chart: Make cleanup cronjob cmd/args configurable (#17970)
     add 7c4d317  Delete unnecessary parameters in EKSPodOperator (#17960)
     add d67133c  Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs (#16866)
     add bec006e  Fix constraint generation properly (#17964)
     add 430976c  Fix max_active_runs not allowing moving of queued dagruns to running (#17945)
     add ab76581  Add DAG run endpoint for marking a dagrun success or failed(#17839)
     add f727635  Fix blank dag dependencies view (#17990)
     add ca4f99d  Serialize the template_ext attribute to show it in UI (#17985)
     add 1e1b3de  Fix grammar in local.rst (#18001)
     add 7b3a5f9  Hide variable import form if user lacks permission (#18000)
     add 6db73a6  Reduce number of lines in "monitoring job" parallel group (#17995)
     add 48316b9  Make EMR cluster visible to all users note (#17557)
     add 31b15c9  Applied permissions to self._error_file (#15947)
     add be7efb1  Require timetable class be registered via plugin (#17989)
     add bff5806  Summarize test failures at the end of CI run (#18008)
     add b6a962c  Logs task launch exception in StandardTaskRunner (#17967)
     add 2cace94  Implement API endpoint for DAG deletion (#17980)
     add bcd81f2  Add Spark to the EMR cluster for the job flow examples (#17563)
     add ace2374  Fix failed tests from run_as_user+error_file changes (#18013)
     add a88115e  Allow specifying multiple URLs via the CORS config option (#17941)
     add 9c64419  Fix unexpected bug in exiting hook context manager (#18014)
     add 0fe0b06  Adding missing init file in example_dags directory (#18019)
     add decaaeb  Fix spelling error causing tests to fail on main (#18021)
     add 867e930  AwsBaseHook make `client_type` & `resource_type` optional params for `get_client_type` & `get_resource_type` (#17987)
     add 21348c1  fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)
     add fd5d657  Update release notes for 3 extra providers released (#18018)
     add b486a0e  Adds capability of Warnings for incompatible community providers (#18020)
     add a0a05ff  Adds example showing the ES_hook (#17944)
     add 16a17f7  Fix building docs in `main` builds (#18035)
     add 6898a2f  Add Python2 to installed packages (#18037)
     add fe7efca  Opmitise LoggingMixin.log (#17280)
     add 1be3ef6  Improve the description of how to handle dynamic task generation (#17963)
     add bfad233  Fix providers tests in main branch with eager upgrades (#18040)
     add 952fa57  Suppress stat stderr output when we have fallback (#18044)
     add 0c2f71e  Revert "Opmitise LoggingMixin.log (#17280)" (#18047)
     add 022b4e0  Fix building documentation broken by upgrade of dnspython (#18046)
     add 944dcfb  Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)
     add 873d4d1  Optimize imports of Providers Manager (#18052)
     add 09c32e1  Mention data interval and add timetable how-to
     add 190bb46  Document timetable registration via plugin
     add a4cb8f5  Typos

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (9238ce6)
            \
             N -- N -- N   refs/heads/aip-39-docs (a4cb8f5)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .github/CODEOWNERS                                 |   4 +-
 .github/ISSUE_TEMPLATE/airflow_bug_report.yml      | 133 +++
 .../ISSUE_TEMPLATE/airflow_doc_issue_report.yml    |  68 ++
 .../airflow_helmchart_bug_report.yml               | 133 +++
 .../airflow_providers_bug_report.yml               | 211 +++++
 .github/ISSUE_TEMPLATE/bug_report.md               |  66 --
 .github/ISSUE_TEMPLATE/feature_request.md          |  42 -
 .github/ISSUE_TEMPLATE/feature_request.yml         |  58 ++
 .github/ISSUE_TEMPLATE/~free_form.yml              |  16 +
 .github/workflows/build-images.yml                 |  12 +-
 .github/workflows/ci.yml                           |  14 +-
 .pre-commit-config.yaml                            |  21 +-
 BREEZE.rst                                         |  18 +-
 CHANGELOG.txt                                      |  60 ++
 CI.rst                                             | 446 +++++-----
 CONTRIBUTING.rst                                   |  58 +-
 CONTRIBUTORS_QUICK_START.rst                       |   2 +-
 Dockerfile                                         |   6 +-
 Dockerfile.ci                                      |   9 +-
 IMAGES.rst                                         |  20 +-
 INTHEWILD.md                                       |   3 +
 PULL_REQUEST_WORKFLOW.rst                          |   4 +-
 README.md                                          | 102 ++-
 STATIC_CODE_CHECKS.rst                             | 185 ++--
 TESTING.rst                                        |   2 +-
 UPDATING.md                                        |  62 ++
 airflow/__init__.py                                |   1 +
 airflow/api/common/experimental/delete_dag.py      |   5 +-
 airflow/api/common/experimental/mark_tasks.py      |  13 +-
 airflow/api_connexion/endpoints/dag_endpoint.py    |  25 +-
 .../api_connexion/endpoints/dag_run_endpoint.py    |  44 +-
 airflow/api_connexion/endpoints/log_endpoint.py    |  18 +-
 .../endpoints/task_instance_endpoint.py            |  41 +-
 airflow/api_connexion/openapi/v1.yaml              |  91 +-
 airflow/api_connexion/schemas/dag_run_schema.py    |  68 +-
 .../api_connexion/schemas/task_instance_schema.py  |  58 +-
 airflow/cli/cli_parser.py                          |  18 +
 airflow/cli/commands/celery_command.py             |  49 +-
 airflow/cli/commands/dag_command.py                |   4 +-
 airflow/cli/commands/kubernetes_command.py         |   6 +-
 airflow/cli/commands/provider_command.py           |  48 +-
 airflow/cli/commands/task_command.py               | 108 ++-
 airflow/cli/commands/user_command.py               |  41 +-
 airflow/cli/commands/webserver_command.py          |   2 +
 airflow/config_templates/airflow_local_settings.py |   4 +-
 airflow/config_templates/config.yml                |  53 +-
 airflow/config_templates/default_airflow.cfg       |  40 +-
 airflow/configuration.py                           |  21 +-
 airflow/dag_processing/manager.py                  |  13 +-
 airflow/dag_processing/processor.py                |  20 +-
 airflow/example_dags/example_bash_operator.py      |   5 -
 .../example_branch_datetime_operator.py            |   6 -
 .../example_branch_day_of_week_operator.py         |   5 -
 airflow/example_dags/example_branch_operator.py    |   7 +-
 .../example_branch_python_dop_operator_3.py        |   7 +-
 airflow/example_dags/example_dag_decorator.py      |   4 +-
 .../example_dags/example_kubernetes_executor.py    |   5 -
 .../example_kubernetes_executor_config.py          |   5 -
 airflow/example_dags/example_nested_branch_dag.py  |   6 +-
 .../example_passing_params_via_test_command.py     |   3 -
 airflow/example_dags/example_python_operator.py    |   5 -
 .../example_dags/example_short_circuit_operator.py |   5 -
 airflow/example_dags/example_skip_dag.py           |   6 +-
 .../example_dags/example_trigger_controller_dag.py |   1 -
 airflow/example_dags/example_trigger_target_dag.py |   9 +-
 airflow/example_dags/example_workday_timetable.py  |  66 +-
 airflow/example_dags/example_xcom.py               |  65 +-
 airflow/example_dags/example_xcomargs.py           |   2 -
 .../example_dags/plugins}/__init__.py              |   0
 .../workday.py}                                    |  13 +-
 airflow/example_dags/tutorial_taskflow_api_etl.py  |  10 +-
 .../tutorial_taskflow_api_etl_virtualenv.py        |  14 +-
 airflow/exceptions.py                              |   5 +
 airflow/executors/dask_executor.py                 |  17 +-
 airflow/executors/kubernetes_executor.py           |  41 +-
 airflow/hooks/dbapi.py                             |   1 +
 airflow/hooks/subprocess.py                        |  20 +-
 airflow/jobs/backfill_job.py                       |  58 +-
 airflow/jobs/local_task_job.py                     |   2 +-
 airflow/jobs/scheduler_job.py                      | 131 +--
 airflow/kubernetes/kubernetes_helper_functions.py  |  26 +-
 airflow/kubernetes/pod_generator.py                |  43 +-
 ...6b6f902_increase_length_of_fab_ab_view_menu_.py |   7 +-
 .../0a2a5b66e19d_add_task_reschedule_table.py      |   2 +-
 .../migrations/versions/1b38cef5b76e_add_dagrun.py |   6 +-
 ...54bebd308c5f_add_trigger_table_and_task_info.py |   4 +-
 .../64de9cddf6c9_add_task_fails_journal_table.py   |   2 +-
 .../versions/7939bcff74ba_add_dagtags_table.py     |   4 +-
 .../7b2661a43ba3_taskinstance_keyed_to_dagrun.py   | 287 ++++++
 .../83f031fd9f1c_improve_mssql_compatibility.py    |   4 +-
 ...15af_add_rendered_task_instance_fields_table.py |   6 +-
 .../8646922c8a04_change_default_pool_slots_to_1.py |   3 +-
 ...d48763f6d53_add_unique_constraint_to_conn_id.py |   4 +-
 .../versions/952da73b5eff_add_dag_code_table.py    |   2 +-
 ...93827b8_add_queued_at_column_to_dagrun_table.py |   4 +-
 .../b25a55525161_increase_length_of_pool_name.py   |   4 +-
 ...623dc7_add_max_tries_column_to_task_instance.py |   3 +-
 .../d38e04c12aa2_add_serialized_dag_table.py       |   4 +-
 .../e38be357a868_update_schema_for_smart_sensor.py |   6 +-
 .../versions/e3a246e0dc1_current_schema.py         |  12 +-
 .../versions/f2ca10b85618_add_dag_stats_table.py   |   4 +-
 airflow/models/base.py                             |  13 +
 airflow/models/baseoperator.py                     |  85 +-
 airflow/models/connection.py                       |  27 +-
 airflow/models/dag.py                              | 174 ++--
 airflow/models/dagbag.py                           |   7 +-
 airflow/models/dagcode.py                          |   9 +-
 airflow/models/dagrun.py                           |  62 +-
 airflow/models/skipmixin.py                        |  85 +-
 airflow/models/taskinstance.py                     | 284 +++---
 airflow/models/taskreschedule.py                   |  26 +-
 airflow/models/variable.py                         |  15 +-
 airflow/operators/bash.py                          |  11 +
 airflow/operators/subdag.py                        |   2 +
 airflow/operators/weekday.py                       |  19 +-
 airflow/plugins_manager.py                         |  27 +
 airflow/provider.yaml.schema.json                  |  47 +-
 airflow/provider_info.schema.json                  |  45 +-
 airflow/providers/airbyte/CHANGELOG.rst            |  18 +-
 airflow/providers/airbyte/provider.yaml            |   7 +-
 .../alibaba/cloud/example_dags}/__init__.py        |   0
 airflow/providers/alibaba/provider.yaml            |   6 +-
 airflow/providers/amazon/CHANGELOG.rst             |  40 +-
 .../aws/example_dags/example_eks_templated.py      | 131 +++
 .../aws/example_dags/example_eks_using_defaults.py |  97 +++
 .../example_dags/example_eks_with_nodegroups.py    | 132 +++
 .../amazon/aws/example_dags/example_emr_eks_job.py |  81 ++
 .../example_emr_job_flow_automatic_steps.py        |   1 +
 .../example_emr_job_flow_manual_steps.py           |   1 +
 airflow/providers/amazon/aws/hooks/base_aws.py     |  23 +-
 airflow/providers/amazon/aws/hooks/eks.py          | 461 ++++++++++
 .../providers/amazon/aws/hooks/emr_containers.py   | 205 +++++
 .../amazon/aws/operators/dms_create_task.py        |   2 -
 .../amazon/aws/operators/dms_delete_task.py        |   2 -
 .../amazon/aws/operators/dms_describe_tasks.py     |   2 -
 .../amazon/aws/operators/dms_start_task.py         |   2 -
 .../amazon/aws/operators/dms_stop_task.py          |   2 -
 airflow/providers/amazon/aws/operators/eks.py      | 458 ++++++++++
 .../amazon/aws/operators/emr_containers.py         | 145 ++++
 airflow/providers/amazon/aws/sensors/dms_task.py   |   3 -
 airflow/providers/amazon/aws/sensors/eks.py        | 136 +++
 .../providers/amazon/aws/sensors/emr_containers.py |  93 ++
 .../amazon/aws/transfers/redshift_to_s3.py         |   8 +-
 airflow/providers/amazon/provider.yaml             |  52 +-
 airflow/providers/apache/beam/CHANGELOG.rst        |  15 +
 airflow/providers/apache/beam/provider.yaml        |   1 +
 airflow/providers/apache/cassandra/CHANGELOG.rst   |  18 +
 airflow/providers/apache/cassandra/provider.yaml   |   7 +-
 airflow/providers/apache/drill/CHANGELOG.rst       |  15 +
 airflow/providers/apache/drill/operators/drill.py  |   2 -
 airflow/providers/apache/drill/provider.yaml       |   7 +-
 airflow/providers/apache/druid/CHANGELOG.rst       |  16 +-
 airflow/providers/apache/druid/provider.yaml       |   7 +-
 airflow/providers/apache/hdfs/CHANGELOG.rst        |  21 +
 airflow/providers/apache/hdfs/hooks/webhdfs.py     |  10 +-
 airflow/providers/apache/hdfs/provider.yaml        |   7 +-
 airflow/providers/apache/hive/CHANGELOG.rst        |  20 +-
 airflow/providers/apache/hive/hooks/hive.py        |   3 +-
 airflow/providers/apache/hive/provider.yaml        |  11 +-
 airflow/providers/apache/kylin/CHANGELOG.rst       |  15 +
 airflow/providers/apache/kylin/provider.yaml       |   1 +
 airflow/providers/apache/livy/CHANGELOG.rst        |  21 +
 airflow/providers/apache/livy/hooks/livy.py        |  62 ++
 airflow/providers/apache/livy/operators/livy.py    |   1 +
 airflow/providers/apache/livy/provider.yaml        |   7 +-
 airflow/providers/apache/pig/CHANGELOG.rst         |  15 +
 airflow/providers/apache/pig/provider.yaml         |   7 +-
 airflow/providers/apache/pinot/CHANGELOG.rst       |  14 +
 airflow/providers/apache/pinot/provider.yaml       |   1 +
 airflow/providers/apache/spark/CHANGELOG.rst       |  17 +
 airflow/providers/apache/spark/provider.yaml       |  11 +-
 airflow/providers/apache/sqoop/CHANGELOG.rst       |  15 +-
 airflow/providers/apache/sqoop/provider.yaml       |   7 +-
 airflow/providers/asana/CHANGELOG.rst              |  23 +
 airflow/providers/asana/provider.yaml              |   7 +-
 airflow/providers/celery/CHANGELOG.rst             |  11 +
 airflow/providers/celery/provider.yaml             |   2 +
 airflow/providers/cloudant/CHANGELOG.rst           |  13 +
 airflow/providers/cloudant/provider.yaml           |   7 +-
 airflow/providers/cncf/kubernetes/CHANGELOG.rst    |  24 +-
 .../backcompat/backwards_compat_converters.py      |   6 +-
 .../cncf/kubernetes/operators/kubernetes_pod.py    |   2 -
 airflow/providers/cncf/kubernetes/provider.yaml    |   7 +-
 airflow/providers/databricks/CHANGELOG.rst         |  16 +
 airflow/providers/databricks/provider.yaml         |   7 +-
 airflow/providers/datadog/CHANGELOG.rst            |  14 +
 airflow/providers/datadog/provider.yaml            |   1 +
 airflow/providers/dependencies.json                |   1 +
 airflow/providers/dingding/CHANGELOG.rst           |  15 +
 airflow/providers/dingding/provider.yaml           |   7 +-
 airflow/providers/discord/CHANGELOG.rst            |  13 +
 airflow/providers/discord/provider.yaml            |   7 +-
 airflow/providers/docker/CHANGELOG.rst             |  20 +-
 airflow/providers/docker/operators/docker_swarm.py |  35 +-
 airflow/providers/docker/provider.yaml             |   7 +-
 airflow/providers/elasticsearch/CHANGELOG.rst      |  21 +-
 .../elasticsearch/example_dags}/__init__.py        |   0
 .../example_dags/example_elasticsearch_query.py    |  59 ++
 airflow/providers/elasticsearch/provider.yaml      |  10 +-
 airflow/providers/exasol/CHANGELOG.rst             |  18 +
 airflow/providers/exasol/hooks/exasol.py           |   8 +-
 airflow/providers/exasol/provider.yaml             |   7 +-
 airflow/providers/facebook/CHANGELOG.rst           |  13 +
 airflow/providers/facebook/provider.yaml           |   7 +-
 airflow/providers/ftp/CHANGELOG.rst                |  16 +
 airflow/providers/ftp/provider.yaml                |   7 +-
 airflow/providers/google/CHANGELOG.rst             |  34 +-
 .../cloud/example_dags/example_automl_tables.py    |   8 +-
 .../example_dags/example_azure_fileshare_to_gcs.py |   2 +-
 .../cloud/example_dags/example_bigquery_dts.py     |   2 +-
 .../example_dags/example_bigquery_operations.py    |  44 +-
 .../cloud/example_dags/example_bigquery_queries.py |  42 +-
 .../cloud/example_dags/example_bigquery_sensors.py |  14 +-
 .../example_dags/example_bigquery_to_bigquery.py   |   2 +-
 .../google/cloud/example_dags/example_bigtable.py  |   2 +-
 .../cloud/example_dags/example_cloud_build.py      |   2 +-
 .../example_dags/example_cloud_memorystore.py      |   4 +-
 .../google/cloud/example_dags/example_cloud_sql.py |   2 +-
 .../cloud/example_dags/example_cloud_sql_query.py  |   2 +-
 .../example_cloud_storage_transfer_service_gcp.py  |   2 +-
 .../google/cloud/example_dags/example_compute.py   |   2 +-
 .../cloud/example_dags/example_compute_igm.py      |   2 +-
 .../cloud/example_dags/example_compute_ssh.py      |   2 +-
 .../cloud/example_dags/example_datacatalog.py      |   4 +-
 .../google/cloud/example_dags/example_dataflow.py  |  59 +-
 .../example_dags/example_dataflow_flex_template.py |   2 +-
 .../cloud/example_dags/example_dataflow_sql.py     |   2 +-
 .../cloud/example_dags/example_datafusion.py       |  36 +-
 .../google/cloud/example_dags/example_dataprep.py  |   2 +-
 .../google/cloud/example_dags/example_dataproc.py  |  24 +-
 .../google/cloud/example_dags/example_datastore.py |   4 +-
 .../google/cloud/example_dags/example_dlp.py       |   8 +-
 .../example_dags/example_facebook_ads_to_gcs.py    |  14 +-
 .../google/cloud/example_dags/example_functions.py |   2 +-
 .../google/cloud/example_dags/example_gcs.py       |   4 +-
 .../example_gcs_timespan_file_transform.py         |   2 +-
 .../cloud/example_dags/example_gcs_to_bigquery.py  |   2 +-
 .../cloud/example_dags/example_gcs_to_gcs.py       |   2 +-
 .../cloud/example_dags/example_gcs_to_local.py     |   2 +-
 .../cloud/example_dags/example_gcs_to_sftp.py      |   2 +-
 .../cloud/example_dags/example_gdrive_to_gcs.py    |   6 +-
 .../example_dags/example_kubernetes_engine.py      |   2 +-
 .../cloud/example_dags/example_life_sciences.py    |   2 +-
 .../cloud/example_dags/example_local_to_gcs.py     |   2 +-
 .../google/cloud/example_dags/example_mlengine.py  |  39 +-
 .../cloud/example_dags/example_mysql_to_gcs.py     |   2 +-
 .../cloud/example_dags/example_natural_language.py |   2 +-
 .../cloud/example_dags/example_postgres_to_gcs.py  |   2 +-
 .../cloud/example_dags/example_presto_to_gcs.py    |  66 +-
 .../google/cloud/example_dags/example_pubsub.py    |   4 +-
 .../google/cloud/example_dags/example_s3_to_gcs.py |   2 +-
 .../example_dags/example_salesforce_to_gcs.py      |  14 +-
 .../cloud/example_dags/example_sftp_to_gcs.py      |   2 +-
 .../cloud/example_dags/example_sheets_to_gcs.py    |   2 +-
 .../google/cloud/example_dags/example_spanner.py   |   2 +-
 .../cloud/example_dags/example_speech_to_text.py   |   2 +-
 .../cloud/example_dags/example_stackdriver.py      |   2 +-
 .../google/cloud/example_dags/example_tasks.py     |   2 +-
 .../cloud/example_dags/example_text_to_speech.py   |   2 +-
 .../google/cloud/example_dags/example_translate.py |   2 +-
 .../cloud/example_dags/example_translate_speech.py |   2 +-
 .../cloud/example_dags/example_trino_to_gcs.py     |  66 +-
 .../example_dags/example_video_intelligence.py     |   2 +-
 .../google/cloud/example_dags/example_vision.py    |   6 +-
 .../google/cloud/example_dags/example_workflows.py |   2 +-
 airflow/providers/google/cloud/hooks/bigquery.py   |   8 +-
 airflow/providers/google/cloud/hooks/cloud_sql.py  |  13 +-
 .../providers/google/cloud/hooks/compute_ssh.py    |   2 +-
 .../providers/google/cloud/hooks/datacatalog.py    |   2 +-
 airflow/providers/google/cloud/hooks/datafusion.py |  17 +-
 airflow/providers/google/cloud/hooks/dataprep.py   |   2 +-
 airflow/providers/google/cloud/hooks/dataproc.py   |  22 +-
 .../providers/google/cloud/operators/bigquery.py   |  42 +-
 .../providers/google/cloud/operators/datafusion.py |  26 +-
 .../providers/google/cloud/operators/dataproc.py   |   6 +-
 .../google/cloud/operators/kubernetes_engine.py    |  32 +-
 .../providers/google/cloud/operators/mlengine.py   |  10 +
 .../providers/google/cloud/sensors/datafusion.py   | 125 +++
 airflow/providers/google/cloud/sensors/dataproc.py |   2 +-
 .../google/cloud/transfers/bigquery_to_mssql.py    |   2 -
 .../google/cloud/utils/mlengine_operator_utils.py  |   8 +-
 .../firebase/example_dags/example_firestore.py     |  34 +-
 .../google/leveldb/example_dags/example_leveldb.py |   2 +-
 .../example_dags/example_analytics.py              |   2 +-
 .../example_dags/example_campaign_manager.py       |   2 +-
 .../example_dags/example_display_video.py          |   6 +-
 .../example_dags/example_search_ads.py             |   2 +-
 airflow/providers/google/provider.yaml             |  36 +-
 .../suite/example_dags/example_gcs_to_sheets.py    |   2 +-
 .../google/suite/example_dags/example_sheets.py    |   2 +-
 .../example_dags/example_sql_to_sheets.py}         |  24 +-
 .../google/suite/transfers/sql_to_sheets.py        | 138 +++
 airflow/providers/grpc/CHANGELOG.rst               |  16 +
 airflow/providers/grpc/provider.yaml               |   7 +-
 airflow/providers/hashicorp/CHANGELOG.rst          |  30 +
 .../hashicorp/_internal_client/vault_client.py     |  19 +-
 airflow/providers/hashicorp/provider.yaml          |  10 +-
 airflow/providers/hashicorp/secrets/vault.py       |  51 +-
 airflow/providers/http/CHANGELOG.rst               |  18 +
 airflow/providers/http/provider.yaml               |  10 +-
 airflow/providers/imap/CHANGELOG.rst               |  13 +
 airflow/providers/imap/provider.yaml               |   7 +-
 airflow/providers/jdbc/CHANGELOG.rst               |  20 +
 airflow/providers/jdbc/provider.yaml               |   7 +-
 airflow/providers/jenkins/CHANGELOG.rst            |  15 +-
 airflow/providers/jenkins/provider.yaml            |   7 +-
 airflow/providers/jira/CHANGELOG.rst               |  16 +
 airflow/providers/jira/provider.yaml               |   7 +-
 airflow/providers/microsoft/azure/CHANGELOG.rst    |  16 +-
 .../azure/hooks/azure_container_instance.py        |   5 +
 airflow/providers/microsoft/azure/provider.yaml    |  36 +-
 airflow/providers/microsoft/mssql/CHANGELOG.rst    |  16 +
 airflow/providers/microsoft/mssql/provider.yaml    |   7 +-
 airflow/providers/microsoft/psrp/CHANGELOG.rst     |  11 +
 airflow/providers/microsoft/psrp/hooks/psrp.py     |   2 +-
 airflow/providers/microsoft/psrp/provider.yaml     |  14 +-
 airflow/providers/microsoft/winrm/CHANGELOG.rst    |  15 +
 airflow/providers/microsoft/winrm/provider.yaml    |   1 +
 airflow/providers/mongo/CHANGELOG.rst              |  18 +
 airflow/providers/mongo/provider.yaml              |   7 +-
 airflow/providers/mysql/CHANGELOG.rst              |  16 +-
 airflow/providers/mysql/provider.yaml              |   7 +-
 airflow/providers/neo4j/CHANGELOG.rst              |  20 +
 airflow/providers/neo4j/provider.yaml              |   7 +-
 airflow/providers/odbc/CHANGELOG.rst               |  16 +
 airflow/providers/odbc/provider.yaml               |   7 +-
 airflow/providers/opsgenie/CHANGELOG.rst           |  17 +
 airflow/providers/opsgenie/provider.yaml           |   7 +-
 airflow/providers/oracle/CHANGELOG.rst             |  15 +
 airflow/providers/oracle/provider.yaml             |   7 +-
 airflow/providers/pagerduty/CHANGELOG.rst          |  14 +
 airflow/providers/pagerduty/provider.yaml          |   1 +
 airflow/providers/papermill/CHANGELOG.rst          |  13 +
 airflow/providers/papermill/provider.yaml          |   1 +
 airflow/providers/plexus/CHANGELOG.rst             |  14 +
 airflow/providers/plexus/provider.yaml             |   1 +
 airflow/providers/postgres/CHANGELOG.rst           |  22 +-
 airflow/providers/postgres/provider.yaml           |   7 +-
 airflow/providers/presto/CHANGELOG.rst             |  17 +
 airflow/providers/presto/provider.yaml             |   7 +-
 airflow/providers/qubole/CHANGELOG.rst             |  17 +
 airflow/providers/qubole/provider.yaml             |   7 +-
 airflow/providers/redis/CHANGELOG.rst              |  14 +
 airflow/providers/redis/provider.yaml              |   7 +-
 airflow/providers/salesforce/CHANGELOG.rst         |  18 +
 airflow/providers/salesforce/provider.yaml         |   8 +-
 airflow/providers/samba/CHANGELOG.rst              |  19 +
 airflow/providers/samba/provider.yaml              |   7 +-
 airflow/providers/segment/CHANGELOG.rst            |  17 +
 airflow/providers/segment/provider.yaml            |   7 +-
 airflow/providers/sendgrid/CHANGELOG.rst           |  15 +
 airflow/providers/sendgrid/provider.yaml           |   1 +
 airflow/providers/sftp/CHANGELOG.rst               |  16 +-
 airflow/providers/sftp/provider.yaml               |   7 +-
 airflow/providers/singularity/CHANGELOG.rst        |  16 +
 .../example_dags/example_singularity.py            |   2 +-
 airflow/providers/singularity/provider.yaml        |   1 +
 airflow/providers/slack/CHANGELOG.rst              |  22 +
 airflow/providers/slack/provider.yaml              |   7 +-
 airflow/providers/snowflake/CHANGELOG.rst          |  16 +-
 airflow/providers/snowflake/provider.yaml          |   7 +-
 airflow/providers/sqlite/CHANGELOG.rst             |  21 +
 .../sqlite/example_dags/example_sqlite.py          |  26 +-
 airflow/providers/sqlite/hooks/sqlite.py           |  34 +
 airflow/providers/sqlite/provider.yaml             |   7 +-
 airflow/providers/ssh/CHANGELOG.rst                |  17 +-
 airflow/providers/ssh/provider.yaml                |   7 +-
 airflow/providers/tableau/CHANGELOG.rst            |  16 +-
 airflow/providers/tableau/provider.yaml            |   7 +-
 airflow/providers/telegram/CHANGELOG.rst           |  13 +
 airflow/providers/telegram/provider.yaml           |   1 +
 airflow/providers/trino/CHANGELOG.rst              |  17 +
 airflow/providers/trino/provider.yaml              |   7 +-
 airflow/providers/vertica/CHANGELOG.rst            |  16 +
 airflow/providers/vertica/provider.yaml            |   7 +-
 airflow/providers/yandex/CHANGELOG.rst             |  24 +
 airflow/providers/yandex/provider.yaml             |   7 +-
 airflow/providers/zendesk/CHANGELOG.rst            |  15 +
 airflow/providers/zendesk/provider.yaml            |   1 +
 airflow/providers_manager.py                       | 547 +++++++++---
 airflow/security/kerberos.py                       |  12 +
 airflow/sensors/base.py                            |   2 +-
 airflow/sensors/date_time.py                       |   7 +-
 airflow/sensors/external_task.py                   |  50 +-
 airflow/sensors/smart_sensor.py                    |  12 +-
 airflow/sensors/time_sensor.py                     |  10 +-
 airflow/sensors/weekday.py                         |  17 +-
 airflow/sentry.py                                  |   8 +-
 airflow/serialization/schema.json                  |  12 +-
 airflow/serialization/serialized_objects.py        | 142 ++-
 airflow/settings.py                                |   4 -
 airflow/task/task_runner/base_task_runner.py       |   8 +
 airflow/task/task_runner/standard_task_runner.py   |   5 +
 airflow/ti_deps/dep_context.py                     |  22 +-
 airflow/ti_deps/deps/dagrun_exists_dep.py          |  28 +-
 airflow/ti_deps/deps/dagrun_id_dep.py              |  11 +-
 airflow/ti_deps/deps/not_previously_skipped_dep.py |   2 +-
 airflow/ti_deps/deps/runnable_exec_date_dep.py     |  13 +-
 airflow/ti_deps/deps/task_concurrency_dep.py       |   4 +-
 airflow/ti_deps/deps/trigger_rule_dep.py           |   6 +-
 airflow/timetables/base.py                         |  61 +-
 airflow/timetables/interval.py                     | 241 +++++-
 airflow/timetables/schedules.py                    | 207 -----
 airflow/timetables/simple.py                       |  56 +-
 airflow/triggers/base.py                           |   2 +-
 airflow/triggers/temporal.py                       |   4 +-
 airflow/utils/callback_requests.py                 |   7 +-
 airflow/utils/decorators.py                        |   2 +-
 airflow/utils/docs.py                              |   5 +
 airflow/utils/module_loading.py                    |   5 +
 airflow/utils/state.py                             |   3 +
 airflow/utils/trigger_rule.py                      |   1 +
 airflow/utils/weekday.py                           |  25 +
 airflow/www/app.py                                 |   3 +
 airflow/www/auth.py                                |  19 +-
 airflow/www/decorators.py                          |   1 +
 .../extensions/init_robots.py}                     |  26 +-
 airflow/www/extensions/init_views.py               |  12 +-
 airflow/www/security.py                            |   8 +
 airflow/www/static/js/dag.js                       |  20 +-
 airflow/www/static/js/dags.js                      |  41 +-
 airflow/www/static/js/datetime_utils.js            |   5 +-
 airflow/www/static/js/graph.js                     |  20 +-
 airflow/www/static/js/task_instances.js            |  21 +-
 airflow/www/static/robots.txt                      |   2 +
 airflow/www/templates/airflow/dag.html             |  12 +-
 .../www/templates/airflow/dag_dependencies.html    |   2 +-
 airflow/www/templates/airflow/dags.html            |  43 +-
 .../{traceback.html => no_roles_permissions.html}  |  34 +-
 airflow/www/templates/airflow/providers.html       |  49 ++
 airflow/www/templates/airflow/traceback.html       |  19 +-
 airflow/www/templates/airflow/variable_list.html   |   2 +
 airflow/www/utils.py                               |  31 +-
 airflow/www/views.py                               | 424 ++++++---
 breeze                                             |  12 +-
 chart/Chart.yaml                                   |   2 +-
 chart/UPDATING.rst                                 |  10 +
 chart/templates/_helpers.yaml                      |  11 +
 chart/templates/cleanup/cleanup-cronjob.yaml       |   8 +-
 chart/templates/flower/flower-service.yaml         |   4 +
 .../templates/rbac/pod-log-reader-rolebinding.yaml |   2 +-
 .../templates/scheduler/scheduler-deployment.yaml  |   6 +
 .../templates/triggerer/triggerer-deployment.yaml  | 181 ++++
 .../triggerer-serviceaccount.yaml}                 |  38 +-
 chart/templates/webserver/webserver-service.yaml   |   4 +
 chart/templates/workers/worker-deployment.yaml     |   5 +
 chart/tests/test_cleanup_pods.py                   |  47 +
 chart/tests/test_flower.py                         |   2 +
 chart/tests/test_scheduler.py                      |  30 +
 .../tests/{test_scheduler.py => test_trigerrer.py} | 242 +-----
 chart/tests/test_webserver.py                      |   2 +
 chart/tests/test_worker.py                         |  30 +
 chart/values.schema.json                           | 225 ++++-
 chart/values.yaml                                  |  97 ++-
 codecov.yml                                        |   8 +-
 dev/README_RELEASE_AIRFLOW.md                      |  29 +-
 dev/REFRESHING_CI_CACHE.md                         |  94 ++
 dev/airflow-license                                |   2 +-
 dev/import_all_classes.py                          |  37 +-
 dev/provider_packages/prepare_provider_packages.py | 435 ++++++----
 .../prod/clean-logs.sh => dev/refresh_images.sh    |  31 +-
 docs/README.rst                                    |   2 -
 docs/apache-airflow-providers-airbyte/commits.rst  |  16 +-
 docs/apache-airflow-providers-airbyte/index.rst    |   8 +-
 docs/apache-airflow-providers-alibaba/commits.rst  |  21 +-
 docs/apache-airflow-providers-alibaba/index.rst    |  22 +-
 docs/apache-airflow-providers-amazon/commits.rst   |  27 +
 docs/apache-airflow-providers-amazon/index.rst     |  38 +-
 .../logging/cloud-watch-task-handlers.rst          |   2 +-
 .../logging/s3-task-handler.rst                    |   2 +-
 .../operators/eks.rst                              | 154 ++++
 .../operators/emr.rst                              |   4 +
 .../operators/emr_eks.rst                          |  79 ++
 .../commits.rst                                    |  17 +-
 .../apache-airflow-providers-apache-beam/index.rst |   8 +-
 .../commits.rst                                    |  20 +-
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  14 +
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  16 +-
 .../index.rst                                      |   8 +-
 .../commits.rst                                    |  19 +-
 .../connections.rst                                |   9 +-
 .../apache-airflow-providers-apache-hdfs/index.rst |   4 +-
 .../commits.rst                                    |  16 +-
 .../apache-airflow-providers-apache-hive/index.rst |   8 +-
 .../commits.rst                                    |  17 +-
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  27 +-
 .../apache-airflow-providers-apache-livy/index.rst |   8 +-
 .../commits.rst                                    |  17 +-
 docs/apache-airflow-providers-apache-pig/index.rst |   4 +-
 .../commits.rst                                    |  16 +-
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  19 +-
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  15 +-
 .../index.rst                                      |   4 +-
 docs/apache-airflow-providers-asana/commits.rst    |  27 +-
 docs/apache-airflow-providers-asana/index.rst      |  17 +-
 docs/apache-airflow-providers-celery/commits.rst   |   3 +-
 docs/apache-airflow-providers-celery/index.rst     |   9 +-
 docs/apache-airflow-providers-cloudant/commits.rst |  15 +-
 docs/apache-airflow-providers-cloudant/index.rst   |   4 +-
 .../commits.rst                                    |  19 +-
 .../index.rst                                      |   4 +-
 .../operators.rst                                  |   2 +
 .../commits.rst                                    |  18 +-
 docs/apache-airflow-providers-databricks/index.rst |   6 +-
 docs/apache-airflow-providers-datadog/commits.rst  |  16 +-
 docs/apache-airflow-providers-datadog/index.rst    |   4 +-
 docs/apache-airflow-providers-dingding/commits.rst |  17 +-
 docs/apache-airflow-providers-dingding/index.rst   |   8 +-
 docs/apache-airflow-providers-discord/commits.rst  |  15 +-
 docs/apache-airflow-providers-discord/index.rst    |   8 +-
 docs/apache-airflow-providers-docker/commits.rst   |  14 +
 docs/apache-airflow-providers-docker/index.rst     |   4 +-
 .../commits.rst                                    |  26 +
 .../index.rst                                      |  12 +-
 .../{logging.rst => logging/index.rst}             |   6 +-
 .../redirects.txt                                  |   1 +
 docs/apache-airflow-providers-exasol/commits.rst   |  16 +-
 docs/apache-airflow-providers-exasol/index.rst     |   4 +-
 docs/apache-airflow-providers-facebook/commits.rst |  15 +-
 docs/apache-airflow-providers-facebook/index.rst   |   4 +-
 docs/apache-airflow-providers-ftp/commits.rst      |  18 +-
 docs/apache-airflow-providers-ftp/index.rst        |   4 +-
 docs/apache-airflow-providers-google/commits.rst   |  24 +
 docs/apache-airflow-providers-google/index.rst     |  12 +-
 .../logging/gcs.rst                                |   2 +-
 .../logging/index.rst                              |   4 +-
 .../logging/stackdriver.rst                        |   2 +-
 .../operators/cloud/bigquery.rst                   |  17 -
 .../operators/cloud/datafusion.rst                 |  26 +-
 .../operators/transfer/sql_to_sheets.rst           |  49 ++
 docs/apache-airflow-providers-grpc/commits.rst     |  18 +-
 docs/apache-airflow-providers-grpc/index.rst       |  12 +-
 .../apache-airflow-providers-hashicorp/commits.rst |  23 +-
 docs/apache-airflow-providers-hashicorp/index.rst  |   8 +-
 .../secrets-backends/hashicorp-vault.rst           |  53 +-
 docs/apache-airflow-providers-http/commits.rst     |  21 +-
 docs/apache-airflow-providers-http/index.rst       |  15 +-
 docs/apache-airflow-providers-http/operators.rst   |  21 +
 docs/apache-airflow-providers-imap/commits.rst     |  15 +-
 docs/apache-airflow-providers-imap/index.rst       |   4 +-
 docs/apache-airflow-providers-jdbc/commits.rst     |  18 +-
 docs/apache-airflow-providers-jdbc/index.rst       |   4 +-
 docs/apache-airflow-providers-jenkins/commits.rst  |  13 +
 docs/apache-airflow-providers-jenkins/index.rst    |   4 +-
 docs/apache-airflow-providers-jira/commits.rst     |  18 +-
 docs/apache-airflow-providers-jira/index.rst       |   4 +-
 .../commits.rst                                    |  14 +
 .../index.rst                                      |  10 +-
 .../{logging.rst => logging/index.rst}             |   2 +-
 .../redirects.txt                                  |   1 +
 .../commits.rst                                    |  18 +-
 .../index.rst                                      |   4 +-
 .../commits.rst                                    |  35 +-
 .../index.rst                                      |  34 +
 .../commits.rst                                    |  17 +-
 .../index.rst                                      |   4 +-
 docs/apache-airflow-providers-mongo/commits.rst    |  16 +-
 docs/apache-airflow-providers-mongo/index.rst      |   6 +-
 docs/apache-airflow-providers-mysql/commits.rst    |  14 +
 docs/apache-airflow-providers-mysql/index.rst      |  16 +-
 docs/apache-airflow-providers-neo4j/commits.rst    |  18 +-
 docs/apache-airflow-providers-neo4j/index.rst      |   4 +-
 docs/apache-airflow-providers-odbc/commits.rst     |  18 +-
 docs/apache-airflow-providers-odbc/index.rst       |   4 +-
 docs/apache-airflow-providers-opsgenie/commits.rst |  18 +-
 docs/apache-airflow-providers-opsgenie/index.rst   |   8 +-
 docs/apache-airflow-providers-oracle/commits.rst   |  19 +-
 docs/apache-airflow-providers-oracle/index.rst     |   4 +-
 .../apache-airflow-providers-pagerduty/commits.rst |  16 +-
 docs/apache-airflow-providers-pagerduty/index.rst  |   4 +-
 .../apache-airflow-providers-papermill/commits.rst |  15 +-
 docs/apache-airflow-providers-papermill/index.rst  |   4 +-
 docs/apache-airflow-providers-plexus/commits.rst   |  15 +-
 docs/apache-airflow-providers-plexus/index.rst     |   4 +-
 docs/apache-airflow-providers-postgres/commits.rst |  16 +
 docs/apache-airflow-providers-postgres/index.rst   |   8 +-
 docs/apache-airflow-providers-presto/commits.rst   |  18 +-
 docs/apache-airflow-providers-presto/index.rst     |   4 +-
 docs/apache-airflow-providers-qubole/commits.rst   |  19 +-
 docs/apache-airflow-providers-qubole/index.rst     |   4 +-
 docs/apache-airflow-providers-redis/commits.rst    |  15 +-
 docs/apache-airflow-providers-redis/index.rst      |   4 +-
 .../commits.rst                                    |  16 +-
 docs/apache-airflow-providers-salesforce/index.rst |   8 +-
 docs/apache-airflow-providers-samba/commits.rst    |  16 +-
 docs/apache-airflow-providers-samba/index.rst      |   4 +-
 docs/apache-airflow-providers-segment/commits.rst  |  18 +-
 docs/apache-airflow-providers-segment/index.rst    |   4 +-
 docs/apache-airflow-providers-sendgrid/commits.rst |  16 +-
 docs/apache-airflow-providers-sendgrid/index.rst   |   4 +-
 docs/apache-airflow-providers-sftp/commits.rst     |  15 +-
 docs/apache-airflow-providers-sftp/index.rst       |   8 +-
 .../commits.rst                                    |  18 +-
 .../apache-airflow-providers-singularity/index.rst |   4 +-
 docs/apache-airflow-providers-slack/commits.rst    |  20 +-
 docs/apache-airflow-providers-slack/index.rst      |   8 +-
 .../apache-airflow-providers-snowflake/commits.rst |  14 +
 docs/apache-airflow-providers-snowflake/index.rst  |   8 +-
 docs/apache-airflow-providers-sqlite/commits.rst   |  19 +-
 docs/apache-airflow-providers-sqlite/index.rst     |   4 +-
 docs/apache-airflow-providers-sqlite/operators.rst |   2 +-
 docs/apache-airflow-providers-ssh/commits.rst      |  16 +-
 docs/apache-airflow-providers-ssh/index.rst        |   4 +-
 docs/apache-airflow-providers-tableau/commits.rst  |  14 +
 docs/apache-airflow-providers-tableau/index.rst    |   4 +-
 docs/apache-airflow-providers-telegram/commits.rst |  15 +-
 docs/apache-airflow-providers-telegram/index.rst   |   4 +-
 docs/apache-airflow-providers-trino/commits.rst    |  18 +-
 docs/apache-airflow-providers-trino/index.rst      |   4 +-
 docs/apache-airflow-providers-vertica/commits.rst  |  18 +-
 docs/apache-airflow-providers-vertica/index.rst    |   4 +-
 docs/apache-airflow-providers-yandex/commits.rst   |  20 +-
 docs/apache-airflow-providers-yandex/index.rst     |   6 +-
 docs/apache-airflow-providers-zendesk/commits.rst  |  16 +-
 docs/apache-airflow-providers-zendesk/index.rst    |   4 +-
 .../aws.rst => core-extensions/auth-backends.rst}  |  33 +-
 .../azure.rst => core-extensions/connections.rst}  |  33 +-
 .../extra-links.rst}                               |  28 +-
 .../core-extensions}/index.rst                     |  10 +-
 .../software.rst => core-extensions/logging.rst}   |  26 +-
 .../secrets-backends.rst}                          |  34 +-
 .../howto/create-update-providers.rst              |  17 +-
 docs/apache-airflow-providers/index.rst            | 239 +++--
 .../operators-and-hooks-ref/apache.rst             |   8 +-
 .../operators-and-hooks-ref/aws.rst                |   8 +-
 .../operators-and-hooks-ref/azure.rst              |   8 +-
 .../operators-and-hooks-ref/google.rst             |   8 +-
 .../operators-and-hooks-ref/index.rst              |   2 +-
 .../operators-and-hooks-ref/protocol.rst           |   8 +-
 .../operators-and-hooks-ref/services.rst           |   8 +-
 .../operators-and-hooks-ref/software.rst           |   8 +-
 docs/apache-airflow/best-practices.rst             | 150 +++-
 docs/apache-airflow/concepts/connections.rst       |  10 +
 docs/apache-airflow/concepts/dags.rst              |   6 +-
 docs/apache-airflow/concepts/operators.rst         |   9 +-
 docs/apache-airflow/concepts/scheduler.rst         |  11 -
 docs/apache-airflow/concepts/taskflow.rst          |   2 +-
 docs/apache-airflow/dag-serialization.rst          |   3 -
 docs/apache-airflow/executor/dask.rst              |   6 +-
 docs/apache-airflow/executor/debug.rst             |   1 +
 docs/apache-airflow/executor/kubernetes.rst        |   2 +-
 docs/apache-airflow/extra-packages-ref.rst         |   2 +-
 docs/apache-airflow/faq.rst                        |   2 +-
 docs/apache-airflow/howto/connection.rst           |  18 +-
 docs/apache-airflow/howto/define_extra_link.rst    |   7 +-
 docs/apache-airflow/howto/set-up-database.rst      |   8 +-
 docs/apache-airflow/howto/timetable.rst            |  51 +-
 .../logging-monitoring/logging-tasks.rst           |  11 +-
 docs/apache-airflow/logging-monitoring/metrics.rst |   2 -
 docs/apache-airflow/migrations-ref.rst             |  10 +-
 docs/apache-airflow/modules_management.rst         | 357 +++++---
 docs/apache-airflow/operators-and-hooks-ref.rst    |   7 +-
 docs/apache-airflow/plugins.rst                    |   3 +
 docs/apache-airflow/project.rst                    |   1 +
 docs/apache-airflow/security/api.rst               |   4 +-
 docs/apache-airflow/security/kerberos.rst          |  22 +
 .../security/secrets/secrets-backend/index.rst     |  23 +-
 docs/apache-airflow/security/webserver.rst         | 107 +++
 docs/apache-airflow/security/workload.rst          |   8 +-
 docs/apache-airflow/start/docker-compose.yaml      |  16 +-
 docs/apache-airflow/start/docker.rst               |  17 +-
 docs/apache-airflow/start/local.rst                |   2 +-
 docs/apache-airflow/templates-ref.rst              |   2 +-
 docs/apache-airflow/tutorial_taskflow_api.rst      |  20 +-
 docs/apache-airflow/upgrade-check.rst              |  15 +-
 docs/apache-airflow/upgrading-to-2.rst             |  18 +-
 docs/build_docs.py                                 |  76 +-
 docs/conf.py                                       |   7 +
 docs/docker-stack/build-arg-ref.rst                |  78 +-
 docs/docker-stack/build.rst                        |   2 +-
 docs/docker-stack/index.rst                        |  10 +-
 .../exts/auth_backend.rst.jinja2                   |  28 +-
 .../exts/connections.rst.jinja2                    |  28 +-
 docs/exts/exampleinclude.py                        |   6 +
 .../exts/extra_links.rst.jinja2                    |  28 +-
 .../traceback.html => docs/exts/logging.rst.jinja2 |  30 +-
 docs/exts/operators_and_hooks_ref.py               | 246 +++++-
 .../exts/secret_backend.rst.jinja2                 |  28 +-
 docs/helm-chart/manage-logs.rst                    |   2 +-
 ...azon-Elastic-Kubernetes-Service_light-bg@4x.png | Bin 0 -> 12199 bytes
 docs/spelling_wordlist.txt                         |  13 +
 images/ci/pull_request_ci_flow.md5                 |   2 +-
 images/ci/pull_request_ci_flow.mermaid             |  52 +-
 images/ci/pull_request_ci_flow.png                 | Bin 193138 -> 192880 bytes
 images/ci/push_ci_flow.md5                         |   2 +-
 images/ci/push_ci_flow.mermaid                     |  60 +-
 images/ci/push_ci_flow.png                         | Bin 200079 -> 200048 bytes
 images/ci/scheduled_ci_flow.md5                    |   2 +-
 images/ci/scheduled_ci_flow.mermaid                |  52 +-
 images/ci/scheduled_ci_flow.png                    | Bin 171813 -> 171588 bytes
 kubernetes_tests/test_kubernetes_pod_operator.py   |   6 +-
 .../test_kubernetes_pod_operator_backcompat.py     |   6 +-
 pytest.ini                                         |   2 +
 scripts/ci/docker-compose/backend-mysql.yml        |   1 -
 scripts/ci/images/ci_prepare_ci_image_on_ci.sh     |   6 +-
 scripts/ci/images/ci_prepare_prod_image_on_ci.sh   |   5 +-
 scripts/ci/images/ci_push_legacy_ci_images.sh      |  27 -
 scripts/ci/images/ci_push_legacy_prod_images.sh    |  27 -
 .../ci/images/ci_wait_for_and_verify_ci_image.sh   |  11 +-
 .../ci/images/ci_wait_for_and_verify_prod_image.sh |  11 +-
 scripts/ci/libraries/_build_images.sh              | 100 +--
 scripts/ci/libraries/_docker_engine_resources.sh   |  18 +-
 scripts/ci/libraries/_initialization.sh            |  16 +-
 scripts/ci/libraries/_parallel.sh                  |  21 +-
 scripts/ci/libraries/_push_pull_remove_images.sh   |   7 +-
 scripts/ci/libraries/_script_init.sh               |   2 +
 .../pre_commit_check_provider_yaml_files.py        |  25 +-
 scripts/ci/selective_ci_checks.sh                  |  22 +-
 scripts/ci/testing/ci_run_airflow_testing.sh       |   4 +
 .../ci_run_single_airflow_test_in_docker.sh        |   4 +-
 scripts/ci/testing/summarize_junit_failures.py     | 125 +++
 scripts/in_container/entrypoint_ci.sh              |   3 -
 scripts/in_container/prod/clean-logs.sh            |   5 +-
 scripts/in_container/prod/entrypoint_prod.sh       |  25 +-
 scripts/in_container/run_generate_constraints.sh   |  48 +-
 .../run_install_and_test_provider_packages.sh      |  61 ++
 setup.cfg                                          |   2 +-
 setup.py                                           |  28 +-
 tests/always/test_project_structure.py             |  46 +-
 tests/api/common/experimental/test_delete_dag.py   |  36 +-
 tests/api/common/experimental/test_mark_tasks.py   |  41 +-
 tests/api_connexion/conftest.py                    |   8 +
 tests/api_connexion/endpoints/test_dag_endpoint.py |   2 +
 .../endpoints/test_dag_run_endpoint.py             | 196 ++++-
 .../endpoints/test_dag_source_endpoint.py          | 119 ++-
 .../endpoints/test_event_log_endpoint.py           | 194 ++---
 tests/api_connexion/endpoints/test_log_endpoint.py |  54 +-
 .../endpoints/test_task_instance_endpoint.py       | 105 +--
 tests/api_connexion/schemas/test_dag_run_schema.py |  10 +-
 .../api_connexion/schemas/test_event_log_schema.py |  74 +-
 .../schemas/test_task_instance_schema.py           |  60 +-
 tests/bats/bats_utils.bash                         |   2 +
 tests/cli/commands/test_celery_command.py          |  86 +-
 tests/cli/commands/test_dag_command.py             |   4 +-
 tests/cli/commands/test_task_command.py            | 195 +----
 tests/cli/commands/test_user_command.py            |  60 +-
 tests/conftest.py                                  | 220 ++++-
 tests/core/test_configuration.py                   |  55 +-
 tests/core/test_core.py                            |  79 +-
 tests/core/test_providers_manager.py               | 143 ++-
 tests/core/test_sentry.py                          |  55 +-
 tests/dag_processing/test_manager.py               |  69 +-
 tests/dag_processing/test_processor.py             | 143 ++-
 tests/executors/test_base_executor.py              |  87 +-
 tests/executors/test_celery_executor.py            |  39 +-
 tests/executors/test_dask_executor.py              |  72 +-
 tests/executors/test_kubernetes_executor.py        |  34 +-
 tests/jobs/test_backfill_job.py                    |  92 +-
 tests/jobs/test_local_task_job.py                  | 334 +++----
 tests/jobs/test_scheduler_job.py                   | 963 ++++++---------------
 tests/jobs/test_triggerer_job.py                   |  22 +-
 tests/kubernetes/test_pod_generator.py             |   8 +
 tests/lineage/test_lineage.py                      |  40 +-
 tests/models/test_base.py                          |  47 +
 tests/models/test_baseoperator.py                  |  34 +
 tests/models/test_cleartasks.py                    | 190 ++--
 tests/models/test_dag.py                           | 124 +--
 tests/models/test_dagbag.py                        |  58 +-
 tests/models/test_dagcode.py                       |  10 -
 tests/models/test_dagparam.py                      |  63 +-
 tests/models/test_dagrun.py                        |  50 +-
 tests/models/test_pool.py                          |  72 +-
 tests/models/test_renderedtifields.py              | 123 +--
 tests/models/test_skipmixin.py                     |  45 +-
 tests/models/test_taskinstance.py                  | 702 +++++++--------
 tests/models/test_timestamp.py                     |  20 +-
 tests/models/test_trigger.py                       |  27 +-
 tests/models/test_xcom_arg.py                      |  63 +-
 tests/operators/test_bash.py                       |  35 +-
 tests/operators/test_latest_only_operator.py       |   3 +-
 tests/operators/test_python.py                     | 117 +--
 tests/operators/test_subdag_operator.py            |  88 +-
 tests/operators/test_weekday.py                    |  30 +-
 tests/providers/amazon/aws/hooks/test_base_aws.py  |  80 +-
 tests/providers/amazon/aws/hooks/test_eks.py       | 793 +++++++++++++++++
 .../amazon/aws/hooks/test_emr_containers.py        |  57 ++
 .../amazon/aws/log/test_cloudwatch_task_handler.py |  10 +-
 .../amazon/aws/log/test_s3_task_handler.py         |  10 +-
 .../providers/amazon/aws/operators/test_athena.py  |  12 +-
 .../amazon/aws/operators/test_datasync.py          |  60 +-
 .../aws/operators/test_dms_describe_tasks.py       |   9 +-
 tests/providers/amazon/aws/operators/test_eks.py   | 192 ++++
 .../amazon/aws/operators/test_eks_system.py        |  58 ++
 .../amazon/aws/operators/test_emr_add_steps.py     |  61 +-
 .../amazon/aws/operators/test_emr_containers.py    | 136 +++
 .../aws/operators/test_emr_create_job_flow.py      |  12 +-
 tests/providers/amazon/aws/operators/test_sqs.py   |   9 +-
 .../amazon/aws/sensors/test_emr_containers.py      |  72 ++
 tests/providers/amazon/aws/sensors/test_s3_key.py  |   7 +-
 .../amazon/aws/sensors/test_s3_keys_unchanged.py   |  13 +-
 tests/providers/amazon/aws/sensors/test_sqs.py     |  39 +-
 .../amazon/aws/transfers/test_mongo_to_s3.py       |   7 +-
 .../amazon/aws/transfers/test_s3_to_sftp.py        |  24 +-
 .../amazon/aws/transfers/test_sftp_to_s3.py        |  17 +-
 .../amazon/aws/utils/eks_test_constants.py         | 208 +++++
 tests/providers/amazon/aws/utils/eks_test_utils.py | 213 +++++
 .../providers/apache/druid/operators/test_druid.py |  98 +--
 tests/providers/apache/hdfs/hooks/test_webhdfs.py  |  49 +-
 tests/providers/apache/hive/hooks/test_hive.py     |   9 +-
 tests/providers/apache/hive/operators/test_hive.py |   6 +-
 .../apache/hive/transfers/test_mysql_to_hive.py    | 576 ++++--------
 .../apache/kylin/operators/test_kylin_cube.py      |   5 +-
 tests/providers/apache/livy/operators/test_livy.py |  45 +-
 .../apache/spark/operators/test_spark_submit.py    |   5 +-
 .../kubernetes/operators/test_kubernetes_pod.py    |   8 +-
 .../docker/operators/test_docker_swarm.py          |  19 +-
 .../elasticsearch/log/test_es_task_handler.py      | 156 ++--
 .../google/cloud/hooks/test_bigquery_system.py     |   4 +
 .../google/cloud/hooks/test_datacatalog.py         |   3 +-
 .../google/cloud/hooks/test_datafusion.py          |  12 +-
 .../google/cloud/hooks/test_kms_system.py          |   6 +
 .../cloud/hooks/test_secret_manager_system.py      |   6 +
 .../google/cloud/log/test_gcs_task_handler.py      |  75 +-
 .../cloud/log/test_gcs_task_handler_system.py      |   2 +
 .../cloud/log/test_stackdriver_task_handler.py     | 165 ++--
 .../log/test_stackdriver_task_handler_system.py    |  11 +-
 .../google/cloud/operators/test_automl_system.py   |  12 +
 .../google/cloud/operators/test_bigquery.py        | 152 ++--
 .../google/cloud/operators/test_bigtable_system.py |   3 +
 .../google/cloud/operators/test_cloud_build.py     |  48 +-
 .../cloud/operators/test_cloud_sql_system.py       |   9 +
 .../test_cloud_storage_transfer_service.py         | 208 ++---
 .../test_cloud_storage_transfer_service_system.py  |   6 +
 .../google/cloud/operators/test_compute.py         |  78 +-
 .../cloud/operators/test_datacatalog_system.py     |   6 +
 .../google/cloud/operators/test_dataflow_system.py |   4 +
 .../google/cloud/operators/test_datafusion.py      |  44 +
 .../cloud/operators/test_datafusion_system.py      |   2 +
 .../google/cloud/operators/test_dataprep_system.py |   1 +
 .../google/cloud/operators/test_dataproc.py        | 424 +++++----
 .../google/cloud/operators/test_dlp_system.py      |   6 +
 .../cloud/operators/test_functions_system.py       |   6 +
 .../cloud/operators/test_kubernetes_engine.py      |  72 +-
 .../operators/test_kubernetes_engine_system.py     |   6 +
 .../google/cloud/operators/test_mlengine.py        |  84 +-
 .../google/cloud/operators/test_mlengine_utils.py  |  25 +-
 .../operators/test_natural_language_system.py      |   6 +
 .../google/cloud/operators/test_pubsub_system.py   |   6 +
 .../google/cloud/operators/test_spanner_system.py  |   3 +
 .../cloud/operators/test_stackdriver_system.py     |   6 +
 .../google/cloud/operators/test_tasks_system.py    |   6 +
 .../cloud/operators/test_translate_system.py       |   6 +
 .../operators/test_video_intelligence_system.py    |   2 +-
 .../cloud/operators/test_workflows_system.py       |   6 +
 .../cloud/secrets/test_secret_manager_system.py    |   4 +
 .../google/cloud/sensors/test_datafusion.py        |  75 ++
 tests/providers/google/cloud/sensors/test_gcs.py   |  12 +-
 .../test_azure_fileshare_to_gcs_system.py          |   6 +
 .../transfers/test_bigquery_to_bigquery_system.py  |   6 +
 .../transfers/test_facebook_ads_to_gcs_system.py   |   6 +
 .../cloud/transfers/test_gcs_to_bigquery_system.py |   6 +
 .../transfers/test_salesforce_to_gcs_system.py     |   6 +
 .../cloud/utils/test_mlengine_operator_utils.py    |  44 +-
 .../leveldb/operators/test_leveldb_system.py       |   6 +
 .../operators/test_analytics_system.py             |   6 +
 .../google/suite/operators/test_sheets_system.py   |   6 +
 .../google/suite/transfers/test_sql_to_sheets.py   |  65 ++
 .../_internal_client/test_vault_client.py          |  27 +
 tests/providers/hashicorp/secrets/test_vault.py    |  43 +
 tests/providers/http/sensors/test_http.py          |  56 +-
 .../microsoft/azure/log/test_wasb_task_handler.py  |  51 +-
 .../microsoft/azure/operators/test_adx.py          |  24 +-
 tests/providers/microsoft/psrp/hooks/test_psrp.py  |   2 +
 tests/providers/qubole/operators/test_qubole.py    |  87 +-
 tests/providers/sftp/operators/test_sftp.py        | 418 ++++-----
 tests/providers/sqlite/hooks/test_sqlite.py        |  20 +
 tests/providers/ssh/operators/test_ssh.py          | 124 ++-
 tests/security/test_kerberos.py                    |  43 +
 tests/sensors/test_base.py                         | 179 ++--
 tests/sensors/test_date_time.py                    |  13 +-
 tests/sensors/test_external_task_sensor.py         | 271 ++++--
 tests/sensors/test_smart_sensor_operator.py        |  11 +-
 tests/sensors/test_time_sensor.py                  |  22 +-
 tests/sensors/test_weekday_sensor.py               |  21 +-
 tests/serialization/test_dag_serialization.py      | 286 ++++--
 .../task/task_runner/test_standard_task_runner.py  |  56 +-
 tests/task/task_runner/test_task_runner.py         |   5 +-
 tests/test_utils/amazon_system_helpers.py          |   5 +-
 tests/test_utils/gcp_system_helpers.py             |   4 +-
 tests/test_utils/mock_executor.py                  |   5 +-
 tests/test_utils/mock_operators.py                 |  12 +-
 tests/test_utils/mock_process.py                   |  23 +-
 tests/test_utils/timetables.py                     |  23 +
 tests/ti_deps/deps/test_dagrun_exists_dep.py       |   3 +-
 tests/ti_deps/deps/test_dagrun_id_dep.py           |   7 -
 .../deps/test_not_previously_skipped_dep.py        | 177 ++--
 tests/ti_deps/deps/test_ready_to_reschedule_dep.py |   4 +-
 tests/ti_deps/deps/test_runnable_exec_date_dep.py  |  70 +-
 tests/ti_deps/deps/test_task_concurrency.py        |   4 +-
 tests/ti_deps/deps/test_trigger_rule_dep.py        | 166 ++--
 tests/triggers/test_temporal.py                    |   8 +
 tests/utils/log/test_log_reader.py                 | 108 +--
 tests/utils/test_dot_renderer.py                   |  87 +-
 tests/utils/test_helpers.py                        |  40 +-
 tests/utils/test_log_handlers.py                   |  61 +-
 tests/utils/test_state.py                          |  58 ++
 .../test_task_handler_with_custom_formatter.py     |  14 +-
 tests/utils/test_trigger_rule.py                   |   3 +-
 tests/utils/test_weekday.py                        |  44 +
 tests/www/test_security.py                         |  22 +
 tests/www/views/test_views.py                      |  17 +
 tests/www/views/test_views_acl.py                  |  57 ++
 tests/www/views/test_views_base.py                 |  52 +-
 tests/www/views/test_views_dagrun.py               |  16 +-
 tests/www/views/test_views_extra_links.py          |  34 +-
 tests/www/views/test_views_home.py                 | 187 ++++
 tests/www/views/test_views_log.py                  |  75 +-
 tests/www/views/test_views_rendered.py             | 109 ++-
 .../www/views/test_views_robots.py                 |  13 +-
 tests/www/views/test_views_tasks.py                |  20 +-
 tests/www/views/test_views_variable.py             |  35 +-
 916 files changed, 22219 insertions(+), 10006 deletions(-)
 create mode 100644 .github/ISSUE_TEMPLATE/airflow_bug_report.yml
 create mode 100644 .github/ISSUE_TEMPLATE/airflow_doc_issue_report.yml
 create mode 100644 .github/ISSUE_TEMPLATE/airflow_helmchart_bug_report.yml
 create mode 100644 .github/ISSUE_TEMPLATE/airflow_providers_bug_report.yml
 delete mode 100644 .github/ISSUE_TEMPLATE/bug_report.md
 delete mode 100644 .github/ISSUE_TEMPLATE/feature_request.md
 create mode 100644 .github/ISSUE_TEMPLATE/feature_request.yml
 create mode 100644 .github/ISSUE_TEMPLATE/~free_form.yml
 copy {tests/providers/zendesk/hooks => airflow/example_dags/plugins}/__init__.py (100%)
 copy airflow/example_dags/{example_workday_timetable.py => plugins/workday.py} (92%)
 create mode 100644 airflow/migrations/versions/7b2661a43ba3_taskinstance_keyed_to_dagrun.py
 copy {tests/www/api/experimental => airflow/providers/alibaba/cloud/example_dags}/__init__.py (100%)
 create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_templated.py
 create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_using_defaults.py
 create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroups.py
 create mode 100644 airflow/providers/amazon/aws/example_dags/example_emr_eks_job.py
 create mode 100644 airflow/providers/amazon/aws/hooks/eks.py
 create mode 100644 airflow/providers/amazon/aws/hooks/emr_containers.py
 create mode 100644 airflow/providers/amazon/aws/operators/eks.py
 create mode 100644 airflow/providers/amazon/aws/operators/emr_containers.py
 create mode 100644 airflow/providers/amazon/aws/sensors/eks.py
 create mode 100644 airflow/providers/amazon/aws/sensors/emr_containers.py
 copy {tests/providers/zendesk/hooks => airflow/providers/elasticsearch/example_dags}/__init__.py (100%)
 create mode 100644 airflow/providers/elasticsearch/example_dags/example_elasticsearch_query.py
 create mode 100644 airflow/providers/google/cloud/sensors/datafusion.py
 copy airflow/providers/google/{cloud/example_dags/example_sheets_to_gcs.py => suite/example_dags/example_sql_to_sheets.py} (67%)
 create mode 100644 airflow/providers/google/suite/transfers/sql_to_sheets.py
 delete mode 100644 airflow/timetables/schedules.py
 copy airflow/{utils/module_loading.py => www/extensions/init_robots.py} (57%)
 create mode 100644 airflow/www/static/robots.txt
 copy airflow/www/templates/airflow/{traceback.html => no_roles_permissions.html} (51%)
 create mode 100644 airflow/www/templates/airflow/providers.html
 create mode 100644 chart/templates/triggerer/triggerer-deployment.yaml
 copy chart/templates/{webserver/webserver-service.yaml => triggerer/triggerer-serviceaccount.yaml} (61%)
 copy chart/tests/{test_scheduler.py => test_trigerrer.py} (52%)
 create mode 100644 dev/REFRESHING_CI_CACHE.md
 copy scripts/in_container/prod/clean-logs.sh => dev/refresh_images.sh (57%)
 create mode 100644 docs/apache-airflow-providers-amazon/operators/eks.rst
 create mode 100644 docs/apache-airflow-providers-amazon/operators/emr_eks.rst
 rename docs/apache-airflow-providers-elasticsearch/{logging.rst => logging/index.rst} (98%)
 create mode 100644 docs/apache-airflow-providers-elasticsearch/redirects.txt
 create mode 100644 docs/apache-airflow-providers-google/operators/transfer/sql_to_sheets.rst
 rename docs/apache-airflow-providers-microsoft-azure/{logging.rst => logging/index.rst} (98%)
 copy docs/apache-airflow-providers/{operators-and-hooks-ref/aws.rst => core-extensions/auth-backends.rst} (57%)
 copy docs/apache-airflow-providers/{operators-and-hooks-ref/azure.rst => core-extensions/connections.rst} (52%)
 copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/extra-links.rst} (58%)
 copy docs/{apache-airflow-providers-google/logging => apache-airflow-providers/core-extensions}/index.rst (78%)
 copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/logging.rst} (67%)
 copy docs/apache-airflow-providers/{operators-and-hooks-ref/azure.rst => core-extensions/secrets-backends.rst} (50%)
 copy airflow/www/templates/airflow/traceback.html => docs/exts/auth_backend.rst.jinja2 (54%)
 copy airflow/www/templates/airflow/traceback.html => docs/exts/connections.rst.jinja2 (54%)
 copy airflow/www/templates/airflow/traceback.html => docs/exts/extra_links.rst.jinja2 (54%)
 copy airflow/www/templates/airflow/traceback.html => docs/exts/logging.rst.jinja2 (54%)
 copy airflow/www/templates/airflow/traceback.html => docs/exts/secret_backend.rst.jinja2 (54%)
 create mode 100644 docs/integration-logos/aws/Amazon-Elastic-Kubernetes-Service_light-bg@4x.png
 delete mode 100755 scripts/ci/images/ci_push_legacy_ci_images.sh
 delete mode 100755 scripts/ci/images/ci_push_legacy_prod_images.sh
 create mode 100755 scripts/ci/testing/summarize_junit_failures.py
 create mode 100644 tests/models/test_base.py
 create mode 100644 tests/providers/amazon/aws/hooks/test_eks.py
 create mode 100644 tests/providers/amazon/aws/hooks/test_emr_containers.py
 create mode 100644 tests/providers/amazon/aws/operators/test_eks.py
 create mode 100644 tests/providers/amazon/aws/operators/test_eks_system.py
 create mode 100644 tests/providers/amazon/aws/operators/test_emr_containers.py
 create mode 100644 tests/providers/amazon/aws/sensors/test_emr_containers.py
 create mode 100644 tests/providers/amazon/aws/utils/eks_test_constants.py
 create mode 100644 tests/providers/amazon/aws/utils/eks_test_utils.py
 create mode 100644 tests/providers/google/cloud/sensors/test_datafusion.py
 create mode 100644 tests/providers/google/suite/transfers/test_sql_to_sheets.py
 create mode 100644 tests/utils/test_state.py
 create mode 100644 tests/www/views/test_views_home.py
 copy airflow/providers/sendgrid/provider.yaml => tests/www/views/test_views_robots.py (81%)