You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ur...@apache.org on 2021/09/07 12:16:32 UTC
[airflow] branch aip-39-docs updated (9238ce6 -> a4cb8f5)
This is an automated email from the ASF dual-hosted git repository.
uranusjr pushed a change to branch aip-39-docs
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 9238ce6 Mention data interval and add timetable how-to
add f38ebaf Make output from users cli command more consistent (#17642)
add 29aab64 Adds secrets backend/logging/auth information to provider yaml (#17625)
add 84df864 Fix wrong query on running tis (#17631)
add 1d3c729 Only run 2.2.0 providers commands for Airflow >= 2.2.0 (#17647)
add 0282f41 Forces rebuilding the image for cache pushing (#17635)
add e99624d Speed up tests that use BackfillJob (#17648)
add c22ed08 Chart: use serviceaccount template for log reader rolebinding (#17645)
add 808fb2a Add Changelog updates for 2.1.3 (#17644)
add 495535b Update pre-commit checks-flynt to 0.66 (#17672)
add dfdffa6 Fix link to generating constraints in BREEZE.rst (#17670)
add 7c96800 Dev: Remove duplicate step to push Docker Image (#17674)
add 1cd3d8f Update docs on syncing forks (#17675)
add d8c0cfe Have the dag_maker fixture (optionally) give SerializedDAGs (#17577)
add 6868ca4 Avoid endless redirect loop when user has no roles (#17613)
add cbd9ad2 Remove the use of multiprocessing in TestLocalTaskJob and Improve Tests (#17581)
add 83a2858 Docs: Make ``DAG.is_active`` read-only in API (#17667)
add be9911c Renames main workflow to `Tests` (#17650)
add 4e59741 Remove legacy image convention (#17692)
add 9863811 Chart: fix running with uid 0 (#17688)
add 9b2e593 Fix sqlite hook - insert and replace functions (#17695)
add 9922287 Replace execution_date with run_id in airflow tasks run command (#16666)
add 0016007 hdfs provider: allow SSL webhdfs connections (#17637)
add c698204 Add steps for building release package without breeze. (#17702)
add 09828a5 docs(impersonation): update note so avoid misintrepretation (#17701)
add 79c1a0e Add ``Scribd`` to INTHEWILD.md (#17685)
add b6c20a8 docs(dagowner): describe dag owner more carefully (#17699)
add d5a6dc7 Minor doc formatting fix (#17704)
add 87e64fa Clearly document no breaking change for 2.1.2 and 2.1.3 (#17706)
add 32475fa Sync DB Migrations with Airflow 2.1.3 (#17703)
add 6040125 Adding support for multiple task-ids in the external task sensor (#17339)
add b99d029 Add `v2-*-stable` to codecov branches (#17707)
add fbf5163 Add a note about XCOMs push condition for K8sPodOperator docs (#17690)
add d26b862 Add optional SQL parameters in ``RedshiftToS3Operator`` (#17640)
add 3b41bb4 Doc: Replace deprecated param from docstrings (#17709)
add bee48f3 Implemented Basic EKS Integration (#16571)
add b68d193 Add error check for config_file parameter in GKEStartPodOperator (#17700)
add 95b2685 Use `dag_maker` fixture in some test files under tests/models (#17556)
add 8cdda20 Doc: Fix replacing Airflow version for Docker stack (#17711)
add 6ba538f Doc: Update Upgrade to 2 docs with Airflow 1.10.x EOL dates (#17710)
add 4da4c18 Add support for configs, secrets, networks and replicas for DockerSwarmOperator (#17474)
add b5e6661 Improve description of Python compatibility approach (#17721)
add 02fbe44 Fix instructions of release to get proper path in shasum file (#17716)
add 76ed2a4 Import Hooks lazily individually in providers manager (#17682)
add 50771e0 Do not let create_dagrun overwrite explicit run_id (#17728)
add 35a6c30 Rename ``task_concurrency`` to ``max_active_tis_per_dag`` (#17708)
add e107891 Extend init_containers defined in pod_override (#17537)
add 12709bf Added table to view providers in Airflow ui under admin tab (#15385)
add 35b8f50 Make sure "podcution-readiness` of docker-compose is well explained (#17731)
add af9dc8b Remove ``[core] store_dag_code`` & use DB to get Dag Code (#16342)
add f654db8 Fix clean-logs after improper skipping of lost+found (#17739)
add 83678b6 Fix comment in Helm Chart for worker ``logGroomerSidecar`` (#17742)
add 8fde9a4 Rename ``none_failed_or_skipped`` by ``none_failed_min_one_success`` trigger rule (#17683)
add 65684dd Add logical_date to OpenAPI DAGRun schema (#17122)
add 5d90bcb Remove Marshmallow schema warnings (#17753)
add 22e87b3 Separate infer_data_interval for data interval timetables (#17755)
add 00dc3c4 Chart: Add loadBalancerSourceRanges in webserver and flower services (#17666)
add 4fb184b Add links to provider's documentation (#17736)
add ebf3b4a Bump `pip` version to `21.2.4` (#17746)
add e21b54a Ensure ``DateTimeTrigger`` receives a datetime object (#17747)
add d04aa13 [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)
add 02a33b5 Fetching and logging livy session logs for LivyOperrator (#17393)
add d39ca78 Add triggerer to `docker-compose.yaml` file (#17745)
add c4d043d Fix failing main spellcheck build (#17761)
add 3b99225 Chart docs: Format ``loadBalancerSourceRanges`` using code-block (#17763)
add 73d2b72 Fix using XCom with ``KubernetesPodOperator`` (#17760)
add c7f37a9 make the providers operators/hooks reference much more usable (#17768)
add 11c5ce3 Improve pre-commit documentation (#17770)
add 6511ce7 Fix ``TimeSensorAsync`` (#17748)
add ccaff5a Automatically use utf8mb3_general_ci collation for mysql (#17729)
add 4ced69b Remove deprecated metrics from metrics.rst (#17772)
add 6301faa Enable Connection creation from Vault parameters (#15013)
add 5f159cb Ensure that airflow modules are not imported too early in conftest (#17779)
add ffb81ea Improve dag/task concurrency check (#17786)
add 1a929f7 Fix dag_processing.last_duration metric random holes (#17769)
add 32bfb2f Add Triggerer to Helm Chart (#17743)
add d97e50f Fix failing Helm Chart docs test (#17789)
add cb9f0bd Move Model collation args tests to correct folder (#17791)
add a0ce41c Add warning about https configuration in SimpleHttpOperator (#17783)
add 6fdfa09 Chart: Update the default Airflow version to ``2.1.3`` (#17794)
add 39a8b2c Update ``README.md`` to point to Airflow 2.1.3 (#17793)
add 3a7a65c feat: Add Loadsmart in the list of companies using it (#17792)
add be75dcd Update description about the new ``connection-types`` provider meta-data
add bcc7665 Improve discoverability of Provider packages' functionality
add 36c5fd3 Move instriuctions of constraint/image refreshing to dev
add 0264fea Remove airflow dependency from http provider
add 41e3a91 Fix missing whitespace in ``apply_default`` deprecation message (#17799)
add bb5602c Prepare release for Kubernetes Provider (#17798)
add 3d96ad6 Add pre/post execution hooks (#17576)
add 5019916 Fix: Mysql 5.7 id utf8mb3 (#14535)
add c32ab51 Use one interpreter for Airflow and gunicorn (#17805)
add 48b37dc Fixes unbound variable during remote image check in Breeze (#17807)
add 83167a6 API documentation spelling fix (#17811)
add c4fd84a fix EXTRA_LOGGER_NAMES param and related docs (#17808)
add 98d45cb Improves documentation about modules management (#17757)
add 97f0065 Show all import_errors from zip files (#17759)
add 806f06b Fixed numeric list (#17813)
add c203e77 Show import errors in DAG views (#17818)
add 06e53f2 Chart: configurable number of retention days for log groomers (#17764)
add 96f7e3f Increase width for Run column (#17817)
add a759499 Update INTHEWILD.md (#17832)
add 45e61a9 Only show import errors for DAGs a user can access (#17835)
add ea49c96 Fix typos in docs & ``bug_report`` template (#17809)
add 7e93828 (docs): update README.md (#17806)
add bfdda08 Improve graph view load time for dags with open groups (#17821)
add 933d863 Fix broken MSSQL test (#17797)
add e18b6a6 Avoid redirect loop for users with no permissions (#17838)
add 41632e0 Fix provider.yaml errors due to exit(0) in test (#17858)
add a2fd67d Update to Celery 5 (#17397)
add 275e0d1 Sane detection of the host/port in entrypoint prod (#17847)
add 83f1f07 Fix log links on graph TI modal (#17862)
add 87769db Allow omission of `initial_node_count` if `node_pools` is specified (#17820)
add aa5952e Gcp ai hyperparameter tuning (#17790)
add 4990176 Move setting of project ID after activating service account (#17866)
add eec757d Add Brent to Committers list (#17873)
add 220678d Allow google-auth < 3 and google-api-core < 3 (#17671)
add 4d48305 Convert issue templates into forms (#17855)
add 0abbd2d Secrets backend failover (#16404)
add 890bd43 Add an Amazon EMR on EKS provider package (#16766)
add 997c31c ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)
add 606b697 Add Brent to ``CODEOWNERS`` (#17877)
add 95279bd Add back deleted comment (#17884)
add e4d3da1 fix wrong documents around upgrade-check.rst (#17903)
add d0bc11f replace to contributing quick start guide (#17908)
add 42e13e1 Remove all deprecation warnings in providers (#17900)
add 07405e6 [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)
add 24aa34b Fixed button size in "Actions" group. (#17902)
add b5da846 Fix missing Data Fusion sensor integration (#17914)
add e9bf127 Add doc warning about connections added via envvars (#17915)
add 332406d BugFix: ``TimeSensorAsync`` returns a naive datetime (#17875)
add a3f9c69 Fix ``DagRunState`` enum query for ``MySQLdb`` driver (#17886)
add 653c13e Fix broken XCOM in EKSPodOperator (#17918)
add 4a0711c Fix `TestSecurity.test_current_user_has_permissions` (#17916)
add 18cc31c Add issue form template for Helm Chat (#17917)
add 1d71441 Fix saving last choice of backend and other flags between breeze runs (#17913)
add da99c3f HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)
add 0a68588 Add August 2021 Provider's documentation (#17890)
add 098765e Allow setting specific cwd for BashOperator (#17751)
add 9028a78 Separate Managed Services for Airflow (#17926)
add 3fc57de Allow custom timetable as a DAG argument (#17414)
add 2aa443f Update error message to guide the user into self-help mostly (#17929)
add 27c1150 Always upgrade to newer dependencies in main (#17939)
add 5350cc2 Example xcom update (#17749)
add eda8a51 Fix docs about login for hdfs connections (#17936)
add dd8b04d Fix grammar in `traceback.html` (#17942)
add a29503e Fix instantiating Vault Secret Backend during configuration (#17935)
add eebfeec Update docker.rst (#17882)
add 1aca908 Adds Github Oauth example with team based authorization (#17896)
add 9befaee Fixing bug which restricted the visibility of ImportErrors (#17924)
add 5007806 Add possibility to run DAGs from system tests and see DAGs logs (#17868)
add 887ef6b Add Next Run to UI (#17732)
add 601f22c Refactor BranchDayOfWeekOperator, DayOfWeekSensor (#17940)
add 226a2b8 Queue support for DaskExecutor using Dask Worker Resources (#16829)
add 9c19f0d Improve MySqlToHiveOperator tests (#17958)
add ee93935 Only show Pause/Unpause tooltip on hover (#17957)
add fac06a1 Add robots.txt and X-Robots-Tag header (#17946)
add fbdb688 Fix passing Jinja templates in ``DateTimeSensor`` (#17959)
add 16b47ce Invalidate Vault cached prop when not authenticated (#17387)
add fe34582 New google operator: SQLToGoogleSheetsOperator (#17887)
add 0791719 Add support for kinit options [-f|-F] and [-a|-A] (#17816)
add 683fbd4 Fix Clear task instances endpoint resets all DAG runs bug (#17961)
add fdbb798 Making spelling of "TaskFlow" consistent in docs (#17968)
add 6914091 Update max_tis_per_query to better render on the webpage (#17971)
add 9a0c10b deduplicate running jobs on BigQueryInsertJobOperator (#17496)
add 4d52207 Add missing menu access for dag dependencies and configurations pages (#17450)
add 617fed9 Chart: Make cleanup cronjob cmd/args configurable (#17970)
add 7c4d317 Delete unnecessary parameters in EKSPodOperator (#17960)
add d67133c Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs (#16866)
add bec006e Fix constraint generation properly (#17964)
add 430976c Fix max_active_runs not allowing moving of queued dagruns to running (#17945)
add ab76581 Add DAG run endpoint for marking a dagrun success or failed(#17839)
add f727635 Fix blank dag dependencies view (#17990)
add ca4f99d Serialize the template_ext attribute to show it in UI (#17985)
add 1e1b3de Fix grammar in local.rst (#18001)
add 7b3a5f9 Hide variable import form if user lacks permission (#18000)
add 6db73a6 Reduce number of lines in "monitoring job" parallel group (#17995)
add 48316b9 Make EMR cluster visible to all users note (#17557)
add 31b15c9 Applied permissions to self._error_file (#15947)
add be7efb1 Require timetable class be registered via plugin (#17989)
add bff5806 Summarize test failures at the end of CI run (#18008)
add b6a962c Logs task launch exception in StandardTaskRunner (#17967)
add 2cace94 Implement API endpoint for DAG deletion (#17980)
add bcd81f2 Add Spark to the EMR cluster for the job flow examples (#17563)
add ace2374 Fix failed tests from run_as_user+error_file changes (#18013)
add a88115e Allow specifying multiple URLs via the CORS config option (#17941)
add 9c64419 Fix unexpected bug in exiting hook context manager (#18014)
add 0fe0b06 Adding missing init file in example_dags directory (#18019)
add decaaeb Fix spelling error causing tests to fail on main (#18021)
add 867e930 AwsBaseHook make `client_type` & `resource_type` optional params for `get_client_type` & `get_resource_type` (#17987)
add 21348c1 fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)
add fd5d657 Update release notes for 3 extra providers released (#18018)
add b486a0e Adds capability of Warnings for incompatible community providers (#18020)
add a0a05ff Adds example showing the ES_hook (#17944)
add 16a17f7 Fix building docs in `main` builds (#18035)
add 6898a2f Add Python2 to installed packages (#18037)
add fe7efca Opmitise LoggingMixin.log (#17280)
add 1be3ef6 Improve the description of how to handle dynamic task generation (#17963)
add bfad233 Fix providers tests in main branch with eager upgrades (#18040)
add 952fa57 Suppress stat stderr output when we have fallback (#18044)
add 0c2f71e Revert "Opmitise LoggingMixin.log (#17280)" (#18047)
add 022b4e0 Fix building documentation broken by upgrade of dnspython (#18046)
add 944dcfb Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)
add 873d4d1 Optimize imports of Providers Manager (#18052)
add 09c32e1 Mention data interval and add timetable how-to
add 190bb46 Document timetable registration via plugin
add a4cb8f5 Typos
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9238ce6)
\
N -- N -- N refs/heads/aip-39-docs (a4cb8f5)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/CODEOWNERS | 4 +-
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 133 +++
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 68 ++
.../airflow_helmchart_bug_report.yml | 133 +++
.../airflow_providers_bug_report.yml | 211 +++++
.github/ISSUE_TEMPLATE/bug_report.md | 66 --
.github/ISSUE_TEMPLATE/feature_request.md | 42 -
.github/ISSUE_TEMPLATE/feature_request.yml | 58 ++
.github/ISSUE_TEMPLATE/~free_form.yml | 16 +
.github/workflows/build-images.yml | 12 +-
.github/workflows/ci.yml | 14 +-
.pre-commit-config.yaml | 21 +-
BREEZE.rst | 18 +-
CHANGELOG.txt | 60 ++
CI.rst | 446 +++++-----
CONTRIBUTING.rst | 58 +-
CONTRIBUTORS_QUICK_START.rst | 2 +-
Dockerfile | 6 +-
Dockerfile.ci | 9 +-
IMAGES.rst | 20 +-
INTHEWILD.md | 3 +
PULL_REQUEST_WORKFLOW.rst | 4 +-
README.md | 102 ++-
STATIC_CODE_CHECKS.rst | 185 ++--
TESTING.rst | 2 +-
UPDATING.md | 62 ++
airflow/__init__.py | 1 +
airflow/api/common/experimental/delete_dag.py | 5 +-
airflow/api/common/experimental/mark_tasks.py | 13 +-
airflow/api_connexion/endpoints/dag_endpoint.py | 25 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 44 +-
airflow/api_connexion/endpoints/log_endpoint.py | 18 +-
.../endpoints/task_instance_endpoint.py | 41 +-
airflow/api_connexion/openapi/v1.yaml | 91 +-
airflow/api_connexion/schemas/dag_run_schema.py | 68 +-
.../api_connexion/schemas/task_instance_schema.py | 58 +-
airflow/cli/cli_parser.py | 18 +
airflow/cli/commands/celery_command.py | 49 +-
airflow/cli/commands/dag_command.py | 4 +-
airflow/cli/commands/kubernetes_command.py | 6 +-
airflow/cli/commands/provider_command.py | 48 +-
airflow/cli/commands/task_command.py | 108 ++-
airflow/cli/commands/user_command.py | 41 +-
airflow/cli/commands/webserver_command.py | 2 +
airflow/config_templates/airflow_local_settings.py | 4 +-
airflow/config_templates/config.yml | 53 +-
airflow/config_templates/default_airflow.cfg | 40 +-
airflow/configuration.py | 21 +-
airflow/dag_processing/manager.py | 13 +-
airflow/dag_processing/processor.py | 20 +-
airflow/example_dags/example_bash_operator.py | 5 -
.../example_branch_datetime_operator.py | 6 -
.../example_branch_day_of_week_operator.py | 5 -
airflow/example_dags/example_branch_operator.py | 7 +-
.../example_branch_python_dop_operator_3.py | 7 +-
airflow/example_dags/example_dag_decorator.py | 4 +-
.../example_dags/example_kubernetes_executor.py | 5 -
.../example_kubernetes_executor_config.py | 5 -
airflow/example_dags/example_nested_branch_dag.py | 6 +-
.../example_passing_params_via_test_command.py | 3 -
airflow/example_dags/example_python_operator.py | 5 -
.../example_dags/example_short_circuit_operator.py | 5 -
airflow/example_dags/example_skip_dag.py | 6 +-
.../example_dags/example_trigger_controller_dag.py | 1 -
airflow/example_dags/example_trigger_target_dag.py | 9 +-
airflow/example_dags/example_workday_timetable.py | 66 +-
airflow/example_dags/example_xcom.py | 65 +-
airflow/example_dags/example_xcomargs.py | 2 -
.../example_dags/plugins}/__init__.py | 0
.../workday.py} | 13 +-
airflow/example_dags/tutorial_taskflow_api_etl.py | 10 +-
.../tutorial_taskflow_api_etl_virtualenv.py | 14 +-
airflow/exceptions.py | 5 +
airflow/executors/dask_executor.py | 17 +-
airflow/executors/kubernetes_executor.py | 41 +-
airflow/hooks/dbapi.py | 1 +
airflow/hooks/subprocess.py | 20 +-
airflow/jobs/backfill_job.py | 58 +-
airflow/jobs/local_task_job.py | 2 +-
airflow/jobs/scheduler_job.py | 131 +--
airflow/kubernetes/kubernetes_helper_functions.py | 26 +-
airflow/kubernetes/pod_generator.py | 43 +-
...6b6f902_increase_length_of_fab_ab_view_menu_.py | 7 +-
.../0a2a5b66e19d_add_task_reschedule_table.py | 2 +-
.../migrations/versions/1b38cef5b76e_add_dagrun.py | 6 +-
...54bebd308c5f_add_trigger_table_and_task_info.py | 4 +-
.../64de9cddf6c9_add_task_fails_journal_table.py | 2 +-
.../versions/7939bcff74ba_add_dagtags_table.py | 4 +-
.../7b2661a43ba3_taskinstance_keyed_to_dagrun.py | 287 ++++++
.../83f031fd9f1c_improve_mssql_compatibility.py | 4 +-
...15af_add_rendered_task_instance_fields_table.py | 6 +-
.../8646922c8a04_change_default_pool_slots_to_1.py | 3 +-
...d48763f6d53_add_unique_constraint_to_conn_id.py | 4 +-
.../versions/952da73b5eff_add_dag_code_table.py | 2 +-
...93827b8_add_queued_at_column_to_dagrun_table.py | 4 +-
.../b25a55525161_increase_length_of_pool_name.py | 4 +-
...623dc7_add_max_tries_column_to_task_instance.py | 3 +-
.../d38e04c12aa2_add_serialized_dag_table.py | 4 +-
.../e38be357a868_update_schema_for_smart_sensor.py | 6 +-
.../versions/e3a246e0dc1_current_schema.py | 12 +-
.../versions/f2ca10b85618_add_dag_stats_table.py | 4 +-
airflow/models/base.py | 13 +
airflow/models/baseoperator.py | 85 +-
airflow/models/connection.py | 27 +-
airflow/models/dag.py | 174 ++--
airflow/models/dagbag.py | 7 +-
airflow/models/dagcode.py | 9 +-
airflow/models/dagrun.py | 62 +-
airflow/models/skipmixin.py | 85 +-
airflow/models/taskinstance.py | 284 +++---
airflow/models/taskreschedule.py | 26 +-
airflow/models/variable.py | 15 +-
airflow/operators/bash.py | 11 +
airflow/operators/subdag.py | 2 +
airflow/operators/weekday.py | 19 +-
airflow/plugins_manager.py | 27 +
airflow/provider.yaml.schema.json | 47 +-
airflow/provider_info.schema.json | 45 +-
airflow/providers/airbyte/CHANGELOG.rst | 18 +-
airflow/providers/airbyte/provider.yaml | 7 +-
.../alibaba/cloud/example_dags}/__init__.py | 0
airflow/providers/alibaba/provider.yaml | 6 +-
airflow/providers/amazon/CHANGELOG.rst | 40 +-
.../aws/example_dags/example_eks_templated.py | 131 +++
.../aws/example_dags/example_eks_using_defaults.py | 97 +++
.../example_dags/example_eks_with_nodegroups.py | 132 +++
.../amazon/aws/example_dags/example_emr_eks_job.py | 81 ++
.../example_emr_job_flow_automatic_steps.py | 1 +
.../example_emr_job_flow_manual_steps.py | 1 +
airflow/providers/amazon/aws/hooks/base_aws.py | 23 +-
airflow/providers/amazon/aws/hooks/eks.py | 461 ++++++++++
.../providers/amazon/aws/hooks/emr_containers.py | 205 +++++
.../amazon/aws/operators/dms_create_task.py | 2 -
.../amazon/aws/operators/dms_delete_task.py | 2 -
.../amazon/aws/operators/dms_describe_tasks.py | 2 -
.../amazon/aws/operators/dms_start_task.py | 2 -
.../amazon/aws/operators/dms_stop_task.py | 2 -
airflow/providers/amazon/aws/operators/eks.py | 458 ++++++++++
.../amazon/aws/operators/emr_containers.py | 145 ++++
airflow/providers/amazon/aws/sensors/dms_task.py | 3 -
airflow/providers/amazon/aws/sensors/eks.py | 136 +++
.../providers/amazon/aws/sensors/emr_containers.py | 93 ++
.../amazon/aws/transfers/redshift_to_s3.py | 8 +-
airflow/providers/amazon/provider.yaml | 52 +-
airflow/providers/apache/beam/CHANGELOG.rst | 15 +
airflow/providers/apache/beam/provider.yaml | 1 +
airflow/providers/apache/cassandra/CHANGELOG.rst | 18 +
airflow/providers/apache/cassandra/provider.yaml | 7 +-
airflow/providers/apache/drill/CHANGELOG.rst | 15 +
airflow/providers/apache/drill/operators/drill.py | 2 -
airflow/providers/apache/drill/provider.yaml | 7 +-
airflow/providers/apache/druid/CHANGELOG.rst | 16 +-
airflow/providers/apache/druid/provider.yaml | 7 +-
airflow/providers/apache/hdfs/CHANGELOG.rst | 21 +
airflow/providers/apache/hdfs/hooks/webhdfs.py | 10 +-
airflow/providers/apache/hdfs/provider.yaml | 7 +-
airflow/providers/apache/hive/CHANGELOG.rst | 20 +-
airflow/providers/apache/hive/hooks/hive.py | 3 +-
airflow/providers/apache/hive/provider.yaml | 11 +-
airflow/providers/apache/kylin/CHANGELOG.rst | 15 +
airflow/providers/apache/kylin/provider.yaml | 1 +
airflow/providers/apache/livy/CHANGELOG.rst | 21 +
airflow/providers/apache/livy/hooks/livy.py | 62 ++
airflow/providers/apache/livy/operators/livy.py | 1 +
airflow/providers/apache/livy/provider.yaml | 7 +-
airflow/providers/apache/pig/CHANGELOG.rst | 15 +
airflow/providers/apache/pig/provider.yaml | 7 +-
airflow/providers/apache/pinot/CHANGELOG.rst | 14 +
airflow/providers/apache/pinot/provider.yaml | 1 +
airflow/providers/apache/spark/CHANGELOG.rst | 17 +
airflow/providers/apache/spark/provider.yaml | 11 +-
airflow/providers/apache/sqoop/CHANGELOG.rst | 15 +-
airflow/providers/apache/sqoop/provider.yaml | 7 +-
airflow/providers/asana/CHANGELOG.rst | 23 +
airflow/providers/asana/provider.yaml | 7 +-
airflow/providers/celery/CHANGELOG.rst | 11 +
airflow/providers/celery/provider.yaml | 2 +
airflow/providers/cloudant/CHANGELOG.rst | 13 +
airflow/providers/cloudant/provider.yaml | 7 +-
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 24 +-
.../backcompat/backwards_compat_converters.py | 6 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 2 -
airflow/providers/cncf/kubernetes/provider.yaml | 7 +-
airflow/providers/databricks/CHANGELOG.rst | 16 +
airflow/providers/databricks/provider.yaml | 7 +-
airflow/providers/datadog/CHANGELOG.rst | 14 +
airflow/providers/datadog/provider.yaml | 1 +
airflow/providers/dependencies.json | 1 +
airflow/providers/dingding/CHANGELOG.rst | 15 +
airflow/providers/dingding/provider.yaml | 7 +-
airflow/providers/discord/CHANGELOG.rst | 13 +
airflow/providers/discord/provider.yaml | 7 +-
airflow/providers/docker/CHANGELOG.rst | 20 +-
airflow/providers/docker/operators/docker_swarm.py | 35 +-
airflow/providers/docker/provider.yaml | 7 +-
airflow/providers/elasticsearch/CHANGELOG.rst | 21 +-
.../elasticsearch/example_dags}/__init__.py | 0
.../example_dags/example_elasticsearch_query.py | 59 ++
airflow/providers/elasticsearch/provider.yaml | 10 +-
airflow/providers/exasol/CHANGELOG.rst | 18 +
airflow/providers/exasol/hooks/exasol.py | 8 +-
airflow/providers/exasol/provider.yaml | 7 +-
airflow/providers/facebook/CHANGELOG.rst | 13 +
airflow/providers/facebook/provider.yaml | 7 +-
airflow/providers/ftp/CHANGELOG.rst | 16 +
airflow/providers/ftp/provider.yaml | 7 +-
airflow/providers/google/CHANGELOG.rst | 34 +-
.../cloud/example_dags/example_automl_tables.py | 8 +-
.../example_dags/example_azure_fileshare_to_gcs.py | 2 +-
.../cloud/example_dags/example_bigquery_dts.py | 2 +-
.../example_dags/example_bigquery_operations.py | 44 +-
.../cloud/example_dags/example_bigquery_queries.py | 42 +-
.../cloud/example_dags/example_bigquery_sensors.py | 14 +-
.../example_dags/example_bigquery_to_bigquery.py | 2 +-
.../google/cloud/example_dags/example_bigtable.py | 2 +-
.../cloud/example_dags/example_cloud_build.py | 2 +-
.../example_dags/example_cloud_memorystore.py | 4 +-
.../google/cloud/example_dags/example_cloud_sql.py | 2 +-
.../cloud/example_dags/example_cloud_sql_query.py | 2 +-
.../example_cloud_storage_transfer_service_gcp.py | 2 +-
.../google/cloud/example_dags/example_compute.py | 2 +-
.../cloud/example_dags/example_compute_igm.py | 2 +-
.../cloud/example_dags/example_compute_ssh.py | 2 +-
.../cloud/example_dags/example_datacatalog.py | 4 +-
.../google/cloud/example_dags/example_dataflow.py | 59 +-
.../example_dags/example_dataflow_flex_template.py | 2 +-
.../cloud/example_dags/example_dataflow_sql.py | 2 +-
.../cloud/example_dags/example_datafusion.py | 36 +-
.../google/cloud/example_dags/example_dataprep.py | 2 +-
.../google/cloud/example_dags/example_dataproc.py | 24 +-
.../google/cloud/example_dags/example_datastore.py | 4 +-
.../google/cloud/example_dags/example_dlp.py | 8 +-
.../example_dags/example_facebook_ads_to_gcs.py | 14 +-
.../google/cloud/example_dags/example_functions.py | 2 +-
.../google/cloud/example_dags/example_gcs.py | 4 +-
.../example_gcs_timespan_file_transform.py | 2 +-
.../cloud/example_dags/example_gcs_to_bigquery.py | 2 +-
.../cloud/example_dags/example_gcs_to_gcs.py | 2 +-
.../cloud/example_dags/example_gcs_to_local.py | 2 +-
.../cloud/example_dags/example_gcs_to_sftp.py | 2 +-
.../cloud/example_dags/example_gdrive_to_gcs.py | 6 +-
.../example_dags/example_kubernetes_engine.py | 2 +-
.../cloud/example_dags/example_life_sciences.py | 2 +-
.../cloud/example_dags/example_local_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_mlengine.py | 39 +-
.../cloud/example_dags/example_mysql_to_gcs.py | 2 +-
.../cloud/example_dags/example_natural_language.py | 2 +-
.../cloud/example_dags/example_postgres_to_gcs.py | 2 +-
.../cloud/example_dags/example_presto_to_gcs.py | 66 +-
.../google/cloud/example_dags/example_pubsub.py | 4 +-
.../google/cloud/example_dags/example_s3_to_gcs.py | 2 +-
.../example_dags/example_salesforce_to_gcs.py | 14 +-
.../cloud/example_dags/example_sftp_to_gcs.py | 2 +-
.../cloud/example_dags/example_sheets_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_spanner.py | 2 +-
.../cloud/example_dags/example_speech_to_text.py | 2 +-
.../cloud/example_dags/example_stackdriver.py | 2 +-
.../google/cloud/example_dags/example_tasks.py | 2 +-
.../cloud/example_dags/example_text_to_speech.py | 2 +-
.../google/cloud/example_dags/example_translate.py | 2 +-
.../cloud/example_dags/example_translate_speech.py | 2 +-
.../cloud/example_dags/example_trino_to_gcs.py | 66 +-
.../example_dags/example_video_intelligence.py | 2 +-
.../google/cloud/example_dags/example_vision.py | 6 +-
.../google/cloud/example_dags/example_workflows.py | 2 +-
airflow/providers/google/cloud/hooks/bigquery.py | 8 +-
airflow/providers/google/cloud/hooks/cloud_sql.py | 13 +-
.../providers/google/cloud/hooks/compute_ssh.py | 2 +-
.../providers/google/cloud/hooks/datacatalog.py | 2 +-
airflow/providers/google/cloud/hooks/datafusion.py | 17 +-
airflow/providers/google/cloud/hooks/dataprep.py | 2 +-
airflow/providers/google/cloud/hooks/dataproc.py | 22 +-
.../providers/google/cloud/operators/bigquery.py | 42 +-
.../providers/google/cloud/operators/datafusion.py | 26 +-
.../providers/google/cloud/operators/dataproc.py | 6 +-
.../google/cloud/operators/kubernetes_engine.py | 32 +-
.../providers/google/cloud/operators/mlengine.py | 10 +
.../providers/google/cloud/sensors/datafusion.py | 125 +++
airflow/providers/google/cloud/sensors/dataproc.py | 2 +-
.../google/cloud/transfers/bigquery_to_mssql.py | 2 -
.../google/cloud/utils/mlengine_operator_utils.py | 8 +-
.../firebase/example_dags/example_firestore.py | 34 +-
.../google/leveldb/example_dags/example_leveldb.py | 2 +-
.../example_dags/example_analytics.py | 2 +-
.../example_dags/example_campaign_manager.py | 2 +-
.../example_dags/example_display_video.py | 6 +-
.../example_dags/example_search_ads.py | 2 +-
airflow/providers/google/provider.yaml | 36 +-
.../suite/example_dags/example_gcs_to_sheets.py | 2 +-
.../google/suite/example_dags/example_sheets.py | 2 +-
.../example_dags/example_sql_to_sheets.py} | 24 +-
.../google/suite/transfers/sql_to_sheets.py | 138 +++
airflow/providers/grpc/CHANGELOG.rst | 16 +
airflow/providers/grpc/provider.yaml | 7 +-
airflow/providers/hashicorp/CHANGELOG.rst | 30 +
.../hashicorp/_internal_client/vault_client.py | 19 +-
airflow/providers/hashicorp/provider.yaml | 10 +-
airflow/providers/hashicorp/secrets/vault.py | 51 +-
airflow/providers/http/CHANGELOG.rst | 18 +
airflow/providers/http/provider.yaml | 10 +-
airflow/providers/imap/CHANGELOG.rst | 13 +
airflow/providers/imap/provider.yaml | 7 +-
airflow/providers/jdbc/CHANGELOG.rst | 20 +
airflow/providers/jdbc/provider.yaml | 7 +-
airflow/providers/jenkins/CHANGELOG.rst | 15 +-
airflow/providers/jenkins/provider.yaml | 7 +-
airflow/providers/jira/CHANGELOG.rst | 16 +
airflow/providers/jira/provider.yaml | 7 +-
airflow/providers/microsoft/azure/CHANGELOG.rst | 16 +-
.../azure/hooks/azure_container_instance.py | 5 +
airflow/providers/microsoft/azure/provider.yaml | 36 +-
airflow/providers/microsoft/mssql/CHANGELOG.rst | 16 +
airflow/providers/microsoft/mssql/provider.yaml | 7 +-
airflow/providers/microsoft/psrp/CHANGELOG.rst | 11 +
airflow/providers/microsoft/psrp/hooks/psrp.py | 2 +-
airflow/providers/microsoft/psrp/provider.yaml | 14 +-
airflow/providers/microsoft/winrm/CHANGELOG.rst | 15 +
airflow/providers/microsoft/winrm/provider.yaml | 1 +
airflow/providers/mongo/CHANGELOG.rst | 18 +
airflow/providers/mongo/provider.yaml | 7 +-
airflow/providers/mysql/CHANGELOG.rst | 16 +-
airflow/providers/mysql/provider.yaml | 7 +-
airflow/providers/neo4j/CHANGELOG.rst | 20 +
airflow/providers/neo4j/provider.yaml | 7 +-
airflow/providers/odbc/CHANGELOG.rst | 16 +
airflow/providers/odbc/provider.yaml | 7 +-
airflow/providers/opsgenie/CHANGELOG.rst | 17 +
airflow/providers/opsgenie/provider.yaml | 7 +-
airflow/providers/oracle/CHANGELOG.rst | 15 +
airflow/providers/oracle/provider.yaml | 7 +-
airflow/providers/pagerduty/CHANGELOG.rst | 14 +
airflow/providers/pagerduty/provider.yaml | 1 +
airflow/providers/papermill/CHANGELOG.rst | 13 +
airflow/providers/papermill/provider.yaml | 1 +
airflow/providers/plexus/CHANGELOG.rst | 14 +
airflow/providers/plexus/provider.yaml | 1 +
airflow/providers/postgres/CHANGELOG.rst | 22 +-
airflow/providers/postgres/provider.yaml | 7 +-
airflow/providers/presto/CHANGELOG.rst | 17 +
airflow/providers/presto/provider.yaml | 7 +-
airflow/providers/qubole/CHANGELOG.rst | 17 +
airflow/providers/qubole/provider.yaml | 7 +-
airflow/providers/redis/CHANGELOG.rst | 14 +
airflow/providers/redis/provider.yaml | 7 +-
airflow/providers/salesforce/CHANGELOG.rst | 18 +
airflow/providers/salesforce/provider.yaml | 8 +-
airflow/providers/samba/CHANGELOG.rst | 19 +
airflow/providers/samba/provider.yaml | 7 +-
airflow/providers/segment/CHANGELOG.rst | 17 +
airflow/providers/segment/provider.yaml | 7 +-
airflow/providers/sendgrid/CHANGELOG.rst | 15 +
airflow/providers/sendgrid/provider.yaml | 1 +
airflow/providers/sftp/CHANGELOG.rst | 16 +-
airflow/providers/sftp/provider.yaml | 7 +-
airflow/providers/singularity/CHANGELOG.rst | 16 +
.../example_dags/example_singularity.py | 2 +-
airflow/providers/singularity/provider.yaml | 1 +
airflow/providers/slack/CHANGELOG.rst | 22 +
airflow/providers/slack/provider.yaml | 7 +-
airflow/providers/snowflake/CHANGELOG.rst | 16 +-
airflow/providers/snowflake/provider.yaml | 7 +-
airflow/providers/sqlite/CHANGELOG.rst | 21 +
.../sqlite/example_dags/example_sqlite.py | 26 +-
airflow/providers/sqlite/hooks/sqlite.py | 34 +
airflow/providers/sqlite/provider.yaml | 7 +-
airflow/providers/ssh/CHANGELOG.rst | 17 +-
airflow/providers/ssh/provider.yaml | 7 +-
airflow/providers/tableau/CHANGELOG.rst | 16 +-
airflow/providers/tableau/provider.yaml | 7 +-
airflow/providers/telegram/CHANGELOG.rst | 13 +
airflow/providers/telegram/provider.yaml | 1 +
airflow/providers/trino/CHANGELOG.rst | 17 +
airflow/providers/trino/provider.yaml | 7 +-
airflow/providers/vertica/CHANGELOG.rst | 16 +
airflow/providers/vertica/provider.yaml | 7 +-
airflow/providers/yandex/CHANGELOG.rst | 24 +
airflow/providers/yandex/provider.yaml | 7 +-
airflow/providers/zendesk/CHANGELOG.rst | 15 +
airflow/providers/zendesk/provider.yaml | 1 +
airflow/providers_manager.py | 547 +++++++++---
airflow/security/kerberos.py | 12 +
airflow/sensors/base.py | 2 +-
airflow/sensors/date_time.py | 7 +-
airflow/sensors/external_task.py | 50 +-
airflow/sensors/smart_sensor.py | 12 +-
airflow/sensors/time_sensor.py | 10 +-
airflow/sensors/weekday.py | 17 +-
airflow/sentry.py | 8 +-
airflow/serialization/schema.json | 12 +-
airflow/serialization/serialized_objects.py | 142 ++-
airflow/settings.py | 4 -
airflow/task/task_runner/base_task_runner.py | 8 +
airflow/task/task_runner/standard_task_runner.py | 5 +
airflow/ti_deps/dep_context.py | 22 +-
airflow/ti_deps/deps/dagrun_exists_dep.py | 28 +-
airflow/ti_deps/deps/dagrun_id_dep.py | 11 +-
airflow/ti_deps/deps/not_previously_skipped_dep.py | 2 +-
airflow/ti_deps/deps/runnable_exec_date_dep.py | 13 +-
airflow/ti_deps/deps/task_concurrency_dep.py | 4 +-
airflow/ti_deps/deps/trigger_rule_dep.py | 6 +-
airflow/timetables/base.py | 61 +-
airflow/timetables/interval.py | 241 +++++-
airflow/timetables/schedules.py | 207 -----
airflow/timetables/simple.py | 56 +-
airflow/triggers/base.py | 2 +-
airflow/triggers/temporal.py | 4 +-
airflow/utils/callback_requests.py | 7 +-
airflow/utils/decorators.py | 2 +-
airflow/utils/docs.py | 5 +
airflow/utils/module_loading.py | 5 +
airflow/utils/state.py | 3 +
airflow/utils/trigger_rule.py | 1 +
airflow/utils/weekday.py | 25 +
airflow/www/app.py | 3 +
airflow/www/auth.py | 19 +-
airflow/www/decorators.py | 1 +
.../extensions/init_robots.py} | 26 +-
airflow/www/extensions/init_views.py | 12 +-
airflow/www/security.py | 8 +
airflow/www/static/js/dag.js | 20 +-
airflow/www/static/js/dags.js | 41 +-
airflow/www/static/js/datetime_utils.js | 5 +-
airflow/www/static/js/graph.js | 20 +-
airflow/www/static/js/task_instances.js | 21 +-
airflow/www/static/robots.txt | 2 +
airflow/www/templates/airflow/dag.html | 12 +-
.../www/templates/airflow/dag_dependencies.html | 2 +-
airflow/www/templates/airflow/dags.html | 43 +-
.../{traceback.html => no_roles_permissions.html} | 34 +-
airflow/www/templates/airflow/providers.html | 49 ++
airflow/www/templates/airflow/traceback.html | 19 +-
airflow/www/templates/airflow/variable_list.html | 2 +
airflow/www/utils.py | 31 +-
airflow/www/views.py | 424 ++++++---
breeze | 12 +-
chart/Chart.yaml | 2 +-
chart/UPDATING.rst | 10 +
chart/templates/_helpers.yaml | 11 +
chart/templates/cleanup/cleanup-cronjob.yaml | 8 +-
chart/templates/flower/flower-service.yaml | 4 +
.../templates/rbac/pod-log-reader-rolebinding.yaml | 2 +-
.../templates/scheduler/scheduler-deployment.yaml | 6 +
.../templates/triggerer/triggerer-deployment.yaml | 181 ++++
.../triggerer-serviceaccount.yaml} | 38 +-
chart/templates/webserver/webserver-service.yaml | 4 +
chart/templates/workers/worker-deployment.yaml | 5 +
chart/tests/test_cleanup_pods.py | 47 +
chart/tests/test_flower.py | 2 +
chart/tests/test_scheduler.py | 30 +
.../tests/{test_scheduler.py => test_trigerrer.py} | 242 +-----
chart/tests/test_webserver.py | 2 +
chart/tests/test_worker.py | 30 +
chart/values.schema.json | 225 ++++-
chart/values.yaml | 97 ++-
codecov.yml | 8 +-
dev/README_RELEASE_AIRFLOW.md | 29 +-
dev/REFRESHING_CI_CACHE.md | 94 ++
dev/airflow-license | 2 +-
dev/import_all_classes.py | 37 +-
dev/provider_packages/prepare_provider_packages.py | 435 ++++++----
.../prod/clean-logs.sh => dev/refresh_images.sh | 31 +-
docs/README.rst | 2 -
docs/apache-airflow-providers-airbyte/commits.rst | 16 +-
docs/apache-airflow-providers-airbyte/index.rst | 8 +-
docs/apache-airflow-providers-alibaba/commits.rst | 21 +-
docs/apache-airflow-providers-alibaba/index.rst | 22 +-
docs/apache-airflow-providers-amazon/commits.rst | 27 +
docs/apache-airflow-providers-amazon/index.rst | 38 +-
.../logging/cloud-watch-task-handlers.rst | 2 +-
.../logging/s3-task-handler.rst | 2 +-
.../operators/eks.rst | 154 ++++
.../operators/emr.rst | 4 +
.../operators/emr_eks.rst | 79 ++
.../commits.rst | 17 +-
.../apache-airflow-providers-apache-beam/index.rst | 8 +-
.../commits.rst | 20 +-
.../index.rst | 4 +-
.../commits.rst | 14 +
.../index.rst | 4 +-
.../commits.rst | 16 +-
.../index.rst | 8 +-
.../commits.rst | 19 +-
.../connections.rst | 9 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 4 +-
.../commits.rst | 16 +-
.../apache-airflow-providers-apache-hive/index.rst | 8 +-
.../commits.rst | 17 +-
.../index.rst | 4 +-
.../commits.rst | 27 +-
.../apache-airflow-providers-apache-livy/index.rst | 8 +-
.../commits.rst | 17 +-
docs/apache-airflow-providers-apache-pig/index.rst | 4 +-
.../commits.rst | 16 +-
.../index.rst | 4 +-
.../commits.rst | 19 +-
.../index.rst | 4 +-
.../commits.rst | 15 +-
.../index.rst | 4 +-
docs/apache-airflow-providers-asana/commits.rst | 27 +-
docs/apache-airflow-providers-asana/index.rst | 17 +-
docs/apache-airflow-providers-celery/commits.rst | 3 +-
docs/apache-airflow-providers-celery/index.rst | 9 +-
docs/apache-airflow-providers-cloudant/commits.rst | 15 +-
docs/apache-airflow-providers-cloudant/index.rst | 4 +-
.../commits.rst | 19 +-
.../index.rst | 4 +-
.../operators.rst | 2 +
.../commits.rst | 18 +-
docs/apache-airflow-providers-databricks/index.rst | 6 +-
docs/apache-airflow-providers-datadog/commits.rst | 16 +-
docs/apache-airflow-providers-datadog/index.rst | 4 +-
docs/apache-airflow-providers-dingding/commits.rst | 17 +-
docs/apache-airflow-providers-dingding/index.rst | 8 +-
docs/apache-airflow-providers-discord/commits.rst | 15 +-
docs/apache-airflow-providers-discord/index.rst | 8 +-
docs/apache-airflow-providers-docker/commits.rst | 14 +
docs/apache-airflow-providers-docker/index.rst | 4 +-
.../commits.rst | 26 +
.../index.rst | 12 +-
.../{logging.rst => logging/index.rst} | 6 +-
.../redirects.txt | 1 +
docs/apache-airflow-providers-exasol/commits.rst | 16 +-
docs/apache-airflow-providers-exasol/index.rst | 4 +-
docs/apache-airflow-providers-facebook/commits.rst | 15 +-
docs/apache-airflow-providers-facebook/index.rst | 4 +-
docs/apache-airflow-providers-ftp/commits.rst | 18 +-
docs/apache-airflow-providers-ftp/index.rst | 4 +-
docs/apache-airflow-providers-google/commits.rst | 24 +
docs/apache-airflow-providers-google/index.rst | 12 +-
.../logging/gcs.rst | 2 +-
.../logging/index.rst | 4 +-
.../logging/stackdriver.rst | 2 +-
.../operators/cloud/bigquery.rst | 17 -
.../operators/cloud/datafusion.rst | 26 +-
.../operators/transfer/sql_to_sheets.rst | 49 ++
docs/apache-airflow-providers-grpc/commits.rst | 18 +-
docs/apache-airflow-providers-grpc/index.rst | 12 +-
.../apache-airflow-providers-hashicorp/commits.rst | 23 +-
docs/apache-airflow-providers-hashicorp/index.rst | 8 +-
.../secrets-backends/hashicorp-vault.rst | 53 +-
docs/apache-airflow-providers-http/commits.rst | 21 +-
docs/apache-airflow-providers-http/index.rst | 15 +-
docs/apache-airflow-providers-http/operators.rst | 21 +
docs/apache-airflow-providers-imap/commits.rst | 15 +-
docs/apache-airflow-providers-imap/index.rst | 4 +-
docs/apache-airflow-providers-jdbc/commits.rst | 18 +-
docs/apache-airflow-providers-jdbc/index.rst | 4 +-
docs/apache-airflow-providers-jenkins/commits.rst | 13 +
docs/apache-airflow-providers-jenkins/index.rst | 4 +-
docs/apache-airflow-providers-jira/commits.rst | 18 +-
docs/apache-airflow-providers-jira/index.rst | 4 +-
.../commits.rst | 14 +
.../index.rst | 10 +-
.../{logging.rst => logging/index.rst} | 2 +-
.../redirects.txt | 1 +
.../commits.rst | 18 +-
.../index.rst | 4 +-
.../commits.rst | 35 +-
.../index.rst | 34 +
.../commits.rst | 17 +-
.../index.rst | 4 +-
docs/apache-airflow-providers-mongo/commits.rst | 16 +-
docs/apache-airflow-providers-mongo/index.rst | 6 +-
docs/apache-airflow-providers-mysql/commits.rst | 14 +
docs/apache-airflow-providers-mysql/index.rst | 16 +-
docs/apache-airflow-providers-neo4j/commits.rst | 18 +-
docs/apache-airflow-providers-neo4j/index.rst | 4 +-
docs/apache-airflow-providers-odbc/commits.rst | 18 +-
docs/apache-airflow-providers-odbc/index.rst | 4 +-
docs/apache-airflow-providers-opsgenie/commits.rst | 18 +-
docs/apache-airflow-providers-opsgenie/index.rst | 8 +-
docs/apache-airflow-providers-oracle/commits.rst | 19 +-
docs/apache-airflow-providers-oracle/index.rst | 4 +-
.../apache-airflow-providers-pagerduty/commits.rst | 16 +-
docs/apache-airflow-providers-pagerduty/index.rst | 4 +-
.../apache-airflow-providers-papermill/commits.rst | 15 +-
docs/apache-airflow-providers-papermill/index.rst | 4 +-
docs/apache-airflow-providers-plexus/commits.rst | 15 +-
docs/apache-airflow-providers-plexus/index.rst | 4 +-
docs/apache-airflow-providers-postgres/commits.rst | 16 +
docs/apache-airflow-providers-postgres/index.rst | 8 +-
docs/apache-airflow-providers-presto/commits.rst | 18 +-
docs/apache-airflow-providers-presto/index.rst | 4 +-
docs/apache-airflow-providers-qubole/commits.rst | 19 +-
docs/apache-airflow-providers-qubole/index.rst | 4 +-
docs/apache-airflow-providers-redis/commits.rst | 15 +-
docs/apache-airflow-providers-redis/index.rst | 4 +-
.../commits.rst | 16 +-
docs/apache-airflow-providers-salesforce/index.rst | 8 +-
docs/apache-airflow-providers-samba/commits.rst | 16 +-
docs/apache-airflow-providers-samba/index.rst | 4 +-
docs/apache-airflow-providers-segment/commits.rst | 18 +-
docs/apache-airflow-providers-segment/index.rst | 4 +-
docs/apache-airflow-providers-sendgrid/commits.rst | 16 +-
docs/apache-airflow-providers-sendgrid/index.rst | 4 +-
docs/apache-airflow-providers-sftp/commits.rst | 15 +-
docs/apache-airflow-providers-sftp/index.rst | 8 +-
.../commits.rst | 18 +-
.../apache-airflow-providers-singularity/index.rst | 4 +-
docs/apache-airflow-providers-slack/commits.rst | 20 +-
docs/apache-airflow-providers-slack/index.rst | 8 +-
.../apache-airflow-providers-snowflake/commits.rst | 14 +
docs/apache-airflow-providers-snowflake/index.rst | 8 +-
docs/apache-airflow-providers-sqlite/commits.rst | 19 +-
docs/apache-airflow-providers-sqlite/index.rst | 4 +-
docs/apache-airflow-providers-sqlite/operators.rst | 2 +-
docs/apache-airflow-providers-ssh/commits.rst | 16 +-
docs/apache-airflow-providers-ssh/index.rst | 4 +-
docs/apache-airflow-providers-tableau/commits.rst | 14 +
docs/apache-airflow-providers-tableau/index.rst | 4 +-
docs/apache-airflow-providers-telegram/commits.rst | 15 +-
docs/apache-airflow-providers-telegram/index.rst | 4 +-
docs/apache-airflow-providers-trino/commits.rst | 18 +-
docs/apache-airflow-providers-trino/index.rst | 4 +-
docs/apache-airflow-providers-vertica/commits.rst | 18 +-
docs/apache-airflow-providers-vertica/index.rst | 4 +-
docs/apache-airflow-providers-yandex/commits.rst | 20 +-
docs/apache-airflow-providers-yandex/index.rst | 6 +-
docs/apache-airflow-providers-zendesk/commits.rst | 16 +-
docs/apache-airflow-providers-zendesk/index.rst | 4 +-
.../aws.rst => core-extensions/auth-backends.rst} | 33 +-
.../azure.rst => core-extensions/connections.rst} | 33 +-
.../extra-links.rst} | 28 +-
.../core-extensions}/index.rst | 10 +-
.../software.rst => core-extensions/logging.rst} | 26 +-
.../secrets-backends.rst} | 34 +-
.../howto/create-update-providers.rst | 17 +-
docs/apache-airflow-providers/index.rst | 239 +++--
.../operators-and-hooks-ref/apache.rst | 8 +-
.../operators-and-hooks-ref/aws.rst | 8 +-
.../operators-and-hooks-ref/azure.rst | 8 +-
.../operators-and-hooks-ref/google.rst | 8 +-
.../operators-and-hooks-ref/index.rst | 2 +-
.../operators-and-hooks-ref/protocol.rst | 8 +-
.../operators-and-hooks-ref/services.rst | 8 +-
.../operators-and-hooks-ref/software.rst | 8 +-
docs/apache-airflow/best-practices.rst | 150 +++-
docs/apache-airflow/concepts/connections.rst | 10 +
docs/apache-airflow/concepts/dags.rst | 6 +-
docs/apache-airflow/concepts/operators.rst | 9 +-
docs/apache-airflow/concepts/scheduler.rst | 11 -
docs/apache-airflow/concepts/taskflow.rst | 2 +-
docs/apache-airflow/dag-serialization.rst | 3 -
docs/apache-airflow/executor/dask.rst | 6 +-
docs/apache-airflow/executor/debug.rst | 1 +
docs/apache-airflow/executor/kubernetes.rst | 2 +-
docs/apache-airflow/extra-packages-ref.rst | 2 +-
docs/apache-airflow/faq.rst | 2 +-
docs/apache-airflow/howto/connection.rst | 18 +-
docs/apache-airflow/howto/define_extra_link.rst | 7 +-
docs/apache-airflow/howto/set-up-database.rst | 8 +-
docs/apache-airflow/howto/timetable.rst | 51 +-
.../logging-monitoring/logging-tasks.rst | 11 +-
docs/apache-airflow/logging-monitoring/metrics.rst | 2 -
docs/apache-airflow/migrations-ref.rst | 10 +-
docs/apache-airflow/modules_management.rst | 357 +++++---
docs/apache-airflow/operators-and-hooks-ref.rst | 7 +-
docs/apache-airflow/plugins.rst | 3 +
docs/apache-airflow/project.rst | 1 +
docs/apache-airflow/security/api.rst | 4 +-
docs/apache-airflow/security/kerberos.rst | 22 +
.../security/secrets/secrets-backend/index.rst | 23 +-
docs/apache-airflow/security/webserver.rst | 107 +++
docs/apache-airflow/security/workload.rst | 8 +-
docs/apache-airflow/start/docker-compose.yaml | 16 +-
docs/apache-airflow/start/docker.rst | 17 +-
docs/apache-airflow/start/local.rst | 2 +-
docs/apache-airflow/templates-ref.rst | 2 +-
docs/apache-airflow/tutorial_taskflow_api.rst | 20 +-
docs/apache-airflow/upgrade-check.rst | 15 +-
docs/apache-airflow/upgrading-to-2.rst | 18 +-
docs/build_docs.py | 76 +-
docs/conf.py | 7 +
docs/docker-stack/build-arg-ref.rst | 78 +-
docs/docker-stack/build.rst | 2 +-
docs/docker-stack/index.rst | 10 +-
.../exts/auth_backend.rst.jinja2 | 28 +-
.../exts/connections.rst.jinja2 | 28 +-
docs/exts/exampleinclude.py | 6 +
.../exts/extra_links.rst.jinja2 | 28 +-
.../traceback.html => docs/exts/logging.rst.jinja2 | 30 +-
docs/exts/operators_and_hooks_ref.py | 246 +++++-
.../exts/secret_backend.rst.jinja2 | 28 +-
docs/helm-chart/manage-logs.rst | 2 +-
...azon-Elastic-Kubernetes-Service_light-bg@4x.png | Bin 0 -> 12199 bytes
docs/spelling_wordlist.txt | 13 +
images/ci/pull_request_ci_flow.md5 | 2 +-
images/ci/pull_request_ci_flow.mermaid | 52 +-
images/ci/pull_request_ci_flow.png | Bin 193138 -> 192880 bytes
images/ci/push_ci_flow.md5 | 2 +-
images/ci/push_ci_flow.mermaid | 60 +-
images/ci/push_ci_flow.png | Bin 200079 -> 200048 bytes
images/ci/scheduled_ci_flow.md5 | 2 +-
images/ci/scheduled_ci_flow.mermaid | 52 +-
images/ci/scheduled_ci_flow.png | Bin 171813 -> 171588 bytes
kubernetes_tests/test_kubernetes_pod_operator.py | 6 +-
.../test_kubernetes_pod_operator_backcompat.py | 6 +-
pytest.ini | 2 +
scripts/ci/docker-compose/backend-mysql.yml | 1 -
scripts/ci/images/ci_prepare_ci_image_on_ci.sh | 6 +-
scripts/ci/images/ci_prepare_prod_image_on_ci.sh | 5 +-
scripts/ci/images/ci_push_legacy_ci_images.sh | 27 -
scripts/ci/images/ci_push_legacy_prod_images.sh | 27 -
.../ci/images/ci_wait_for_and_verify_ci_image.sh | 11 +-
.../ci/images/ci_wait_for_and_verify_prod_image.sh | 11 +-
scripts/ci/libraries/_build_images.sh | 100 +--
scripts/ci/libraries/_docker_engine_resources.sh | 18 +-
scripts/ci/libraries/_initialization.sh | 16 +-
scripts/ci/libraries/_parallel.sh | 21 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 7 +-
scripts/ci/libraries/_script_init.sh | 2 +
.../pre_commit_check_provider_yaml_files.py | 25 +-
scripts/ci/selective_ci_checks.sh | 22 +-
scripts/ci/testing/ci_run_airflow_testing.sh | 4 +
.../ci_run_single_airflow_test_in_docker.sh | 4 +-
scripts/ci/testing/summarize_junit_failures.py | 125 +++
scripts/in_container/entrypoint_ci.sh | 3 -
scripts/in_container/prod/clean-logs.sh | 5 +-
scripts/in_container/prod/entrypoint_prod.sh | 25 +-
scripts/in_container/run_generate_constraints.sh | 48 +-
.../run_install_and_test_provider_packages.sh | 61 ++
setup.cfg | 2 +-
setup.py | 28 +-
tests/always/test_project_structure.py | 46 +-
tests/api/common/experimental/test_delete_dag.py | 36 +-
tests/api/common/experimental/test_mark_tasks.py | 41 +-
tests/api_connexion/conftest.py | 8 +
tests/api_connexion/endpoints/test_dag_endpoint.py | 2 +
.../endpoints/test_dag_run_endpoint.py | 196 ++++-
.../endpoints/test_dag_source_endpoint.py | 119 ++-
.../endpoints/test_event_log_endpoint.py | 194 ++---
tests/api_connexion/endpoints/test_log_endpoint.py | 54 +-
.../endpoints/test_task_instance_endpoint.py | 105 +--
tests/api_connexion/schemas/test_dag_run_schema.py | 10 +-
.../api_connexion/schemas/test_event_log_schema.py | 74 +-
.../schemas/test_task_instance_schema.py | 60 +-
tests/bats/bats_utils.bash | 2 +
tests/cli/commands/test_celery_command.py | 86 +-
tests/cli/commands/test_dag_command.py | 4 +-
tests/cli/commands/test_task_command.py | 195 +----
tests/cli/commands/test_user_command.py | 60 +-
tests/conftest.py | 220 ++++-
tests/core/test_configuration.py | 55 +-
tests/core/test_core.py | 79 +-
tests/core/test_providers_manager.py | 143 ++-
tests/core/test_sentry.py | 55 +-
tests/dag_processing/test_manager.py | 69 +-
tests/dag_processing/test_processor.py | 143 ++-
tests/executors/test_base_executor.py | 87 +-
tests/executors/test_celery_executor.py | 39 +-
tests/executors/test_dask_executor.py | 72 +-
tests/executors/test_kubernetes_executor.py | 34 +-
tests/jobs/test_backfill_job.py | 92 +-
tests/jobs/test_local_task_job.py | 334 +++----
tests/jobs/test_scheduler_job.py | 963 ++++++---------------
tests/jobs/test_triggerer_job.py | 22 +-
tests/kubernetes/test_pod_generator.py | 8 +
tests/lineage/test_lineage.py | 40 +-
tests/models/test_base.py | 47 +
tests/models/test_baseoperator.py | 34 +
tests/models/test_cleartasks.py | 190 ++--
tests/models/test_dag.py | 124 +--
tests/models/test_dagbag.py | 58 +-
tests/models/test_dagcode.py | 10 -
tests/models/test_dagparam.py | 63 +-
tests/models/test_dagrun.py | 50 +-
tests/models/test_pool.py | 72 +-
tests/models/test_renderedtifields.py | 123 +--
tests/models/test_skipmixin.py | 45 +-
tests/models/test_taskinstance.py | 702 +++++++--------
tests/models/test_timestamp.py | 20 +-
tests/models/test_trigger.py | 27 +-
tests/models/test_xcom_arg.py | 63 +-
tests/operators/test_bash.py | 35 +-
tests/operators/test_latest_only_operator.py | 3 +-
tests/operators/test_python.py | 117 +--
tests/operators/test_subdag_operator.py | 88 +-
tests/operators/test_weekday.py | 30 +-
tests/providers/amazon/aws/hooks/test_base_aws.py | 80 +-
tests/providers/amazon/aws/hooks/test_eks.py | 793 +++++++++++++++++
.../amazon/aws/hooks/test_emr_containers.py | 57 ++
.../amazon/aws/log/test_cloudwatch_task_handler.py | 10 +-
.../amazon/aws/log/test_s3_task_handler.py | 10 +-
.../providers/amazon/aws/operators/test_athena.py | 12 +-
.../amazon/aws/operators/test_datasync.py | 60 +-
.../aws/operators/test_dms_describe_tasks.py | 9 +-
tests/providers/amazon/aws/operators/test_eks.py | 192 ++++
.../amazon/aws/operators/test_eks_system.py | 58 ++
.../amazon/aws/operators/test_emr_add_steps.py | 61 +-
.../amazon/aws/operators/test_emr_containers.py | 136 +++
.../aws/operators/test_emr_create_job_flow.py | 12 +-
tests/providers/amazon/aws/operators/test_sqs.py | 9 +-
.../amazon/aws/sensors/test_emr_containers.py | 72 ++
tests/providers/amazon/aws/sensors/test_s3_key.py | 7 +-
.../amazon/aws/sensors/test_s3_keys_unchanged.py | 13 +-
tests/providers/amazon/aws/sensors/test_sqs.py | 39 +-
.../amazon/aws/transfers/test_mongo_to_s3.py | 7 +-
.../amazon/aws/transfers/test_s3_to_sftp.py | 24 +-
.../amazon/aws/transfers/test_sftp_to_s3.py | 17 +-
.../amazon/aws/utils/eks_test_constants.py | 208 +++++
tests/providers/amazon/aws/utils/eks_test_utils.py | 213 +++++
.../providers/apache/druid/operators/test_druid.py | 98 +--
tests/providers/apache/hdfs/hooks/test_webhdfs.py | 49 +-
tests/providers/apache/hive/hooks/test_hive.py | 9 +-
tests/providers/apache/hive/operators/test_hive.py | 6 +-
.../apache/hive/transfers/test_mysql_to_hive.py | 576 ++++--------
.../apache/kylin/operators/test_kylin_cube.py | 5 +-
tests/providers/apache/livy/operators/test_livy.py | 45 +-
.../apache/spark/operators/test_spark_submit.py | 5 +-
.../kubernetes/operators/test_kubernetes_pod.py | 8 +-
.../docker/operators/test_docker_swarm.py | 19 +-
.../elasticsearch/log/test_es_task_handler.py | 156 ++--
.../google/cloud/hooks/test_bigquery_system.py | 4 +
.../google/cloud/hooks/test_datacatalog.py | 3 +-
.../google/cloud/hooks/test_datafusion.py | 12 +-
.../google/cloud/hooks/test_kms_system.py | 6 +
.../cloud/hooks/test_secret_manager_system.py | 6 +
.../google/cloud/log/test_gcs_task_handler.py | 75 +-
.../cloud/log/test_gcs_task_handler_system.py | 2 +
.../cloud/log/test_stackdriver_task_handler.py | 165 ++--
.../log/test_stackdriver_task_handler_system.py | 11 +-
.../google/cloud/operators/test_automl_system.py | 12 +
.../google/cloud/operators/test_bigquery.py | 152 ++--
.../google/cloud/operators/test_bigtable_system.py | 3 +
.../google/cloud/operators/test_cloud_build.py | 48 +-
.../cloud/operators/test_cloud_sql_system.py | 9 +
.../test_cloud_storage_transfer_service.py | 208 ++---
.../test_cloud_storage_transfer_service_system.py | 6 +
.../google/cloud/operators/test_compute.py | 78 +-
.../cloud/operators/test_datacatalog_system.py | 6 +
.../google/cloud/operators/test_dataflow_system.py | 4 +
.../google/cloud/operators/test_datafusion.py | 44 +
.../cloud/operators/test_datafusion_system.py | 2 +
.../google/cloud/operators/test_dataprep_system.py | 1 +
.../google/cloud/operators/test_dataproc.py | 424 +++++----
.../google/cloud/operators/test_dlp_system.py | 6 +
.../cloud/operators/test_functions_system.py | 6 +
.../cloud/operators/test_kubernetes_engine.py | 72 +-
.../operators/test_kubernetes_engine_system.py | 6 +
.../google/cloud/operators/test_mlengine.py | 84 +-
.../google/cloud/operators/test_mlengine_utils.py | 25 +-
.../operators/test_natural_language_system.py | 6 +
.../google/cloud/operators/test_pubsub_system.py | 6 +
.../google/cloud/operators/test_spanner_system.py | 3 +
.../cloud/operators/test_stackdriver_system.py | 6 +
.../google/cloud/operators/test_tasks_system.py | 6 +
.../cloud/operators/test_translate_system.py | 6 +
.../operators/test_video_intelligence_system.py | 2 +-
.../cloud/operators/test_workflows_system.py | 6 +
.../cloud/secrets/test_secret_manager_system.py | 4 +
.../google/cloud/sensors/test_datafusion.py | 75 ++
tests/providers/google/cloud/sensors/test_gcs.py | 12 +-
.../test_azure_fileshare_to_gcs_system.py | 6 +
.../transfers/test_bigquery_to_bigquery_system.py | 6 +
.../transfers/test_facebook_ads_to_gcs_system.py | 6 +
.../cloud/transfers/test_gcs_to_bigquery_system.py | 6 +
.../transfers/test_salesforce_to_gcs_system.py | 6 +
.../cloud/utils/test_mlengine_operator_utils.py | 44 +-
.../leveldb/operators/test_leveldb_system.py | 6 +
.../operators/test_analytics_system.py | 6 +
.../google/suite/operators/test_sheets_system.py | 6 +
.../google/suite/transfers/test_sql_to_sheets.py | 65 ++
.../_internal_client/test_vault_client.py | 27 +
tests/providers/hashicorp/secrets/test_vault.py | 43 +
tests/providers/http/sensors/test_http.py | 56 +-
.../microsoft/azure/log/test_wasb_task_handler.py | 51 +-
.../microsoft/azure/operators/test_adx.py | 24 +-
tests/providers/microsoft/psrp/hooks/test_psrp.py | 2 +
tests/providers/qubole/operators/test_qubole.py | 87 +-
tests/providers/sftp/operators/test_sftp.py | 418 ++++-----
tests/providers/sqlite/hooks/test_sqlite.py | 20 +
tests/providers/ssh/operators/test_ssh.py | 124 ++-
tests/security/test_kerberos.py | 43 +
tests/sensors/test_base.py | 179 ++--
tests/sensors/test_date_time.py | 13 +-
tests/sensors/test_external_task_sensor.py | 271 ++++--
tests/sensors/test_smart_sensor_operator.py | 11 +-
tests/sensors/test_time_sensor.py | 22 +-
tests/sensors/test_weekday_sensor.py | 21 +-
tests/serialization/test_dag_serialization.py | 286 ++++--
.../task/task_runner/test_standard_task_runner.py | 56 +-
tests/task/task_runner/test_task_runner.py | 5 +-
tests/test_utils/amazon_system_helpers.py | 5 +-
tests/test_utils/gcp_system_helpers.py | 4 +-
tests/test_utils/mock_executor.py | 5 +-
tests/test_utils/mock_operators.py | 12 +-
tests/test_utils/mock_process.py | 23 +-
tests/test_utils/timetables.py | 23 +
tests/ti_deps/deps/test_dagrun_exists_dep.py | 3 +-
tests/ti_deps/deps/test_dagrun_id_dep.py | 7 -
.../deps/test_not_previously_skipped_dep.py | 177 ++--
tests/ti_deps/deps/test_ready_to_reschedule_dep.py | 4 +-
tests/ti_deps/deps/test_runnable_exec_date_dep.py | 70 +-
tests/ti_deps/deps/test_task_concurrency.py | 4 +-
tests/ti_deps/deps/test_trigger_rule_dep.py | 166 ++--
tests/triggers/test_temporal.py | 8 +
tests/utils/log/test_log_reader.py | 108 +--
tests/utils/test_dot_renderer.py | 87 +-
tests/utils/test_helpers.py | 40 +-
tests/utils/test_log_handlers.py | 61 +-
tests/utils/test_state.py | 58 ++
.../test_task_handler_with_custom_formatter.py | 14 +-
tests/utils/test_trigger_rule.py | 3 +-
tests/utils/test_weekday.py | 44 +
tests/www/test_security.py | 22 +
tests/www/views/test_views.py | 17 +
tests/www/views/test_views_acl.py | 57 ++
tests/www/views/test_views_base.py | 52 +-
tests/www/views/test_views_dagrun.py | 16 +-
tests/www/views/test_views_extra_links.py | 34 +-
tests/www/views/test_views_home.py | 187 ++++
tests/www/views/test_views_log.py | 75 +-
tests/www/views/test_views_rendered.py | 109 ++-
.../www/views/test_views_robots.py | 13 +-
tests/www/views/test_views_tasks.py | 20 +-
tests/www/views/test_views_variable.py | 35 +-
916 files changed, 22219 insertions(+), 10006 deletions(-)
create mode 100644 .github/ISSUE_TEMPLATE/airflow_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_doc_issue_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_helmchart_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_providers_bug_report.yml
delete mode 100644 .github/ISSUE_TEMPLATE/bug_report.md
delete mode 100644 .github/ISSUE_TEMPLATE/feature_request.md
create mode 100644 .github/ISSUE_TEMPLATE/feature_request.yml
create mode 100644 .github/ISSUE_TEMPLATE/~free_form.yml
copy {tests/providers/zendesk/hooks => airflow/example_dags/plugins}/__init__.py (100%)
copy airflow/example_dags/{example_workday_timetable.py => plugins/workday.py} (92%)
create mode 100644 airflow/migrations/versions/7b2661a43ba3_taskinstance_keyed_to_dagrun.py
copy {tests/www/api/experimental => airflow/providers/alibaba/cloud/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_templated.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_using_defaults.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroups.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_emr_eks_job.py
create mode 100644 airflow/providers/amazon/aws/hooks/eks.py
create mode 100644 airflow/providers/amazon/aws/hooks/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/operators/eks.py
create mode 100644 airflow/providers/amazon/aws/operators/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/sensors/eks.py
create mode 100644 airflow/providers/amazon/aws/sensors/emr_containers.py
copy {tests/providers/zendesk/hooks => airflow/providers/elasticsearch/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/elasticsearch/example_dags/example_elasticsearch_query.py
create mode 100644 airflow/providers/google/cloud/sensors/datafusion.py
copy airflow/providers/google/{cloud/example_dags/example_sheets_to_gcs.py => suite/example_dags/example_sql_to_sheets.py} (67%)
create mode 100644 airflow/providers/google/suite/transfers/sql_to_sheets.py
delete mode 100644 airflow/timetables/schedules.py
copy airflow/{utils/module_loading.py => www/extensions/init_robots.py} (57%)
create mode 100644 airflow/www/static/robots.txt
copy airflow/www/templates/airflow/{traceback.html => no_roles_permissions.html} (51%)
create mode 100644 airflow/www/templates/airflow/providers.html
create mode 100644 chart/templates/triggerer/triggerer-deployment.yaml
copy chart/templates/{webserver/webserver-service.yaml => triggerer/triggerer-serviceaccount.yaml} (61%)
copy chart/tests/{test_scheduler.py => test_trigerrer.py} (52%)
create mode 100644 dev/REFRESHING_CI_CACHE.md
copy scripts/in_container/prod/clean-logs.sh => dev/refresh_images.sh (57%)
create mode 100644 docs/apache-airflow-providers-amazon/operators/eks.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/emr_eks.rst
rename docs/apache-airflow-providers-elasticsearch/{logging.rst => logging/index.rst} (98%)
create mode 100644 docs/apache-airflow-providers-elasticsearch/redirects.txt
create mode 100644 docs/apache-airflow-providers-google/operators/transfer/sql_to_sheets.rst
rename docs/apache-airflow-providers-microsoft-azure/{logging.rst => logging/index.rst} (98%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/aws.rst => core-extensions/auth-backends.rst} (57%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/azure.rst => core-extensions/connections.rst} (52%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/extra-links.rst} (58%)
copy docs/{apache-airflow-providers-google/logging => apache-airflow-providers/core-extensions}/index.rst (78%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/software.rst => core-extensions/logging.rst} (67%)
copy docs/apache-airflow-providers/{operators-and-hooks-ref/azure.rst => core-extensions/secrets-backends.rst} (50%)
copy airflow/www/templates/airflow/traceback.html => docs/exts/auth_backend.rst.jinja2 (54%)
copy airflow/www/templates/airflow/traceback.html => docs/exts/connections.rst.jinja2 (54%)
copy airflow/www/templates/airflow/traceback.html => docs/exts/extra_links.rst.jinja2 (54%)
copy airflow/www/templates/airflow/traceback.html => docs/exts/logging.rst.jinja2 (54%)
copy airflow/www/templates/airflow/traceback.html => docs/exts/secret_backend.rst.jinja2 (54%)
create mode 100644 docs/integration-logos/aws/Amazon-Elastic-Kubernetes-Service_light-bg@4x.png
delete mode 100755 scripts/ci/images/ci_push_legacy_ci_images.sh
delete mode 100755 scripts/ci/images/ci_push_legacy_prod_images.sh
create mode 100755 scripts/ci/testing/summarize_junit_failures.py
create mode 100644 tests/models/test_base.py
create mode 100644 tests/providers/amazon/aws/hooks/test_eks.py
create mode 100644 tests/providers/amazon/aws/hooks/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/operators/test_eks.py
create mode 100644 tests/providers/amazon/aws/operators/test_eks_system.py
create mode 100644 tests/providers/amazon/aws/operators/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/sensors/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/utils/eks_test_constants.py
create mode 100644 tests/providers/amazon/aws/utils/eks_test_utils.py
create mode 100644 tests/providers/google/cloud/sensors/test_datafusion.py
create mode 100644 tests/providers/google/suite/transfers/test_sql_to_sheets.py
create mode 100644 tests/utils/test_state.py
create mode 100644 tests/www/views/test_views_home.py
copy airflow/providers/sendgrid/provider.yaml => tests/www/views/test_views_robots.py (81%)