You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ur...@apache.org on 2021/09/13 03:30:13 UTC
[airflow] branch aip-39-docs updated (331694b -> 159b186)
This is an automated email from the ASF dual-hosted git repository.
uranusjr pushed a change to branch aip-39-docs
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 331694b Fix imports in example DAG
discard 2ffbf30 Typos
discard 190bb46 Document timetable registration via plugin
discard 09c32e1 Mention data interval and add timetable how-to
add 64d2f54 Do not fail KubernetesPodOperator tasks if log reading fails (#17649)
add 1bfb572 Build CI images for the merge result of a PR, not the tip of the PR (#18060)
add 0dba2e0 Revert "Build CI images for the merge result of a PR, not the tip of the PR (#18060)" (#18063)
add 5d2b056 Fix Neo4jHook to get the query response (#18007)
add 77d50a1 Add missing "be" in documentation (#18059)
add 79d8557 Added Jagex to the list of companies using Apache Airflow (#18058)
add b658a42 Change id collation for MySQL to case-sensitive (#18072)
add 13e7d4a Adding CI check to verify __init__.py file exists in providers' example_dags dirs (#18076)
add b8d06e8 Fix KubernetesPodOperator reattach when not deleting pods (#18070)
add 29a395c Chart: fix webserver secret key update (#18079)
add cc0e740 Update non-working example in documentation (#18067)
add 9496235 Reapply "Build CI images for the merge result of a PR, not the tip of the PR (#18060)" (#18086)
add ff64fe8 Allow filtering DAGS by tags in the REST API (#18090)
add 3fe948a sftp_to_s3 stream file option (#17609)
add d6e48cd Fixes incorrect parameter passed to views (#18083) (#18085)
add a1d9172 Limit colorlog version (6.x is incompatible) (#18099)
add 5f3d2cd Chart: Fix minor Triggerer issues (#18105)
add 6acb9e1 Adds LoggingMixins to BaseTrigger (#18106)
add 43f595f Advises the kernel to not cache log files generated by Airflow (#18054)
add ebbe2b4 Fix DagRun execution order from queued to running not being properly followed (#18061)
add 28de326 Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)
add 0eb41b5 Limit the number of queued dagruns created by the Scheduler (#18065)
add cee48c3 Update wasb.rst (#18117)
add 80eb809 Check for missing DagRun rows for "downstream" tables before migrating DB (#17030)
add afd4ba6 Fix constraints generation scripts. (#18094)
add 9c7ae4d added TUD to INTHEWILD.md (#18123)
add 47e8fa6 Add "packaging" to core requirements (#18122)
add feb0a4b Change XCom class methods to accept run_id argument (#18084)
add 046f02e fix misspelling (#18121)
add 2fd3f27 Make next_dagrun_info take a data interval (#18088)
add c9d2946 Fix deprecation error message rather than silencing it (#18126)
add f97ddf1 Fix Sentry handler from LocalTaskJob causing error (#18119)
add 2767781 Update version added fields in airflow/config_templates/config.yml (#18128)
add cfb602a Fix ``BigQuery`` data extraction in ``BigQueryToMySqlOperator`` (#18073)
add 969b239 Test coverage on the autocomplete view (#15943)
add 6e10131 Simplify s3 ``unify_bucket_name_and_key`` (#17325)
add b879550 Aws secrets manager backend (#17448)
add 1945494 Adding ``TaskGroup`` support in ``BaseOperator.chain()`` (#17456)
add a897076 Add Snowflake operators based on SQL Checks (#17741)
add e6cb2f7 ECSOperator returns last logs when ECS task fails (#17209)
add b8926ee Add a note about no back-compat guarantees for experimental features (#18139)
add 0e3b06b Mark passing pre/post execute callbacks to operators as experimental. (#18140)
add 68d99bc [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)
add 0df31cd Change from dynamic date to fixed date in examples (#18071)
add 3d4bfdc Add missing __init__.py files for some test packages (#18142)
add 975a4e0 Fix quarentine tests affected by AIP-39 (#18141)
add d491afb Doc: Minor wording tweaks (#18148)
add 42c835f Fix typo in StandardTaskRunning log message (#18149)
add 491d818 Fix bad repository name in pre-commit config (#18151)
add 9e13e45 Fixes warm shutdown for celery worker. (#18068)
add 476ae0e Fixing Vault AppRole authentication with CONN_URI (#18064)
add 692d744 Fixed log view for deferred tasks (#18154)
add db5ac64 Reorder migrations to be compatible with 2.1.4 (#18153)
add a3c4784 Add C2FO to ``INTHEWILD.md`` (#18157)
add a773794 Make auto refresh interval configurable (#18107)
add 2776e08 Fix Airflow version for `[logging] worker_log_server_port` (#18158)
add 9140ad8 Use parameters instead of params (#18143)
add 723eeb4 Add script that validate version fields in config.yaml (#18130)
add f34893a Remove limits for dnspython (#18162)
add 4ee8f82 Allow users to submit issues for 2.2.0beta1 (#18165)
add 8593d7f Improves quick-start docker-compose warnings and documentation (#18164)
add 3d6c86c Fix spelling mistake in documentation (#18167)
add 3e3c48a Apply parent dag permissions to subdags. (#18160)
add 0b2b711 Allow publishing Docker images with more pre-release versions (#18170)
add f9969c1 Separate Installing from sources section and add more details (#18171)
add db72f40 Remove redundant single quote from Breeze build image script (#18173)
add e2d069f Set task state to failed when pod is DELETED while running (#18095)
add 29af57b Fix usage of ``range(len())`` to ``enumerate`` (#18174)
add 15a9945 Update various pre-commits (#18176)
add d7aed84 Add note about params on trigger DAG page (#18166)
add a6c9f95 Fix typo in task fail migration (#18180)
add 1cf7240 Remove Brent from Collaborators (#18182)
add f222aad Fix broken link in ``dev/REFRESHING_CI_CACHE.md`` (#18181)
add 9d05b32 Doc: Use ``closer.lua`` script for downloading sources (#18179)
add 42bbeb0 Fix minor issues in Airflow release guide (#18177)
add 0239776 Deprecate default pod name in EKSPodOperator (#18036)
add 2f1ed34 sets encoding to utf-8 by default while reading task logs (#17965)
add 0c43e68 Automatically create section when migrating config (#16814)
add 1cb456c Add official download page for providers (#18187)
add 1fdde76 Fix typo in decorator test (#18191)
add d6e7c45 Adding Variable.update method and improving detection of variable key collisions (#18159)
add ec79da0 Doc: Improve installing from sources (#18194)
add 81ebd78 Added upsert method on S3ToRedshift operator (#18027)
add d119ae8 Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)
add 21459ab Mention data interval and add timetable how-to
add 655ddd0 Document timetable registration via plugin
add 02be21a Typos
add 8897d1a Fix imports in example DAG
add 159b186 Rewrite example with new last_automated_dagrun
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (331694b)
\
N -- N -- N refs/heads/aip-39-docs (159b186)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 -
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 1 +
.github/workflows/build-images.yml | 43 +-
.pre-commit-config.yaml | 24 +-
BREEZE.rst | 12 +-
Dockerfile | 4 +
INTHEWILD.md | 3 +
STATIC_CODE_CHECKS.rst | 300 +++++------
airflow/api_connexion/endpoints/dag_endpoint.py | 9 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 4 +-
airflow/api_connexion/openapi/v1.yaml | 11 +
airflow/cli/commands/dag_command.py | 47 +-
airflow/config_templates/config.yml | 148 +++---
airflow/config_templates/default_airflow.cfg | 10 +-
airflow/configuration.py | 8 +-
airflow/contrib/operators/file_to_wasb.py | 26 +-
airflow/dag_processing/processor.py | 25 +-
airflow/example_dags/example_bash_operator.py | 7 +-
.../example_branch_datetime_operator.py | 7 +-
.../example_branch_day_of_week_operator.py | 6 +-
airflow/example_dags/example_branch_labels.py | 7 +-
airflow/example_dags/example_branch_operator.py | 6 +-
.../example_branch_python_dop_operator_3.py | 6 +-
airflow/example_dags/example_complex.py | 6 +-
airflow/example_dags/example_dag_decorator.py | 5 +-
.../example_dags/example_kubernetes_executor.py | 6 +-
.../example_kubernetes_executor_config.py | 5 +-
airflow/example_dags/example_latest_only.py | 5 +-
.../example_latest_only_with_trigger.py | 5 +-
airflow/example_dags/example_nested_branch_dag.py | 8 +-
.../example_passing_params_via_test_command.py | 7 +-
airflow/example_dags/example_python_operator.py | 6 +-
.../example_dags/example_short_circuit_operator.py | 7 +-
airflow/example_dags/example_skip_dag.py | 5 +-
airflow/example_dags/example_task_group.py | 6 +-
.../example_dags/example_task_group_decorator.py | 7 +-
.../example_dags/example_trigger_controller_dag.py | 7 +-
airflow/example_dags/example_trigger_target_dag.py | 6 +-
airflow/example_dags/example_xcom.py | 7 +-
airflow/example_dags/example_xcomargs.py | 9 +-
airflow/example_dags/plugins/workday.py | 39 +-
airflow/example_dags/subdags/subdag.py | 6 +-
airflow/example_dags/test_utils.py | 1 -
airflow/example_dags/tutorial.py | 6 +-
airflow/example_dags/tutorial_etl_dag.py | 5 +-
airflow/example_dags/tutorial_taskflow_api_etl.py | 4 +-
.../tutorial_taskflow_api_etl_virtualenv.py | 5 +-
airflow/executors/kubernetes_executor.py | 6 +-
airflow/jobs/scheduler_job.py | 53 +-
...5d12_add_max_active_runs_column_to_dagmodel_.py | 59 +++
...ta_interval_start_end_to_dagmodel_and_dagrun.py | 2 +-
.../83f031fd9f1c_improve_mssql_compatibility.py | 4 +-
..._faskfail.py => 9635ae0956e7_index_taskfail.py} | 2 +-
...6fe78_add_index_on_state_dag_id_for_queued_.py} | 31 +-
airflow/models/base.py | 4 +-
airflow/models/baseoperator.py | 59 ++-
airflow/models/dag.py | 252 +++++++--
airflow/models/dagrun.py | 62 ++-
airflow/models/taskinstance.py | 40 +-
airflow/models/variable.py | 89 +++-
airflow/models/xcom.py | 105 +++-
airflow/operators/latest_only.py | 18 +-
.../aws/example_dags/example_eks_templated.py | 1 +
.../aws/example_dags/example_eks_using_defaults.py | 1 +
.../example_dags/example_eks_with_nodegroups.py | 1 +
airflow/providers/amazon/aws/hooks/s3.py | 13 +-
airflow/providers/amazon/aws/operators/ecs.py | 22 +-
airflow/providers/amazon/aws/operators/eks.py | 16 +-
.../amazon/aws/secrets/secrets_manager.py | 116 ++++-
.../amazon/aws/transfers/s3_to_redshift.py | 82 ++-
.../providers/amazon/aws/transfers/sftp_to_s3.py | 15 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 12 +-
.../cncf/kubernetes/utils/pod_launcher.py | 27 +-
.../example_dags/example_facebook_ads_to_gcs.py | 4 +-
airflow/providers/google/cloud/operators/gcs.py | 21 +-
airflow/providers/google/cloud/sensors/gcs.py | 10 +-
.../google/cloud/transfers/bigquery_to_mysql.py | 10 +-
.../google/cloud/transfers/facebook_ads_to_gcs.py | 27 +-
.../providers/google/config_templates}/__init__.py | 0
.../example_dags/example_display_video.py | 4 +-
.../marketing_platform/operators/display_video.py | 29 +-
airflow/providers/hashicorp/hooks/vault.py | 26 +-
.../azure/example_dags/example_adls_delete.py | 4 +-
.../azure/example_dags/example_local_to_adls.py | 4 +-
...le_file_to_wasb.py => example_local_to_wasb.py} | 6 +-
airflow/providers/microsoft/azure/provider.yaml | 3 +
.../microsoft/azure/transfers/file_to_wasb.py | 59 +--
.../microsoft/azure/transfers/local_to_adls.py | 23 +-
.../{file_to_wasb.py => local_to_wasb.py} | 2 +-
airflow/providers/neo4j/hooks/neo4j.py | 11 +-
airflow/providers/papermill/operators/papermill.py | 6 +-
airflow/providers/postgres/hooks/postgres.py | 27 +-
airflow/providers/snowflake/operators/snowflake.py | 318 +++++++++++-
airflow/providers/ssh/hooks/ssh.py | 40 +-
airflow/providers/ssh/operators/ssh.py | 37 +-
airflow/sensors/time_delta.py | 15 +-
airflow/sentry.py | 15 +-
airflow/task/task_runner/standard_task_runner.py | 2 +-
airflow/timetables/base.py | 6 +-
airflow/timetables/interval.py | 10 +-
airflow/timetables/simple.py | 8 +-
airflow/triggers/base.py | 4 +-
airflow/utils/cli.py | 3 +-
airflow/utils/db.py | 95 +++-
airflow/utils/log/file_processor_handler.py | 3 +-
airflow/utils/log/file_task_handler.py | 5 +-
airflow/utils/log/non_caching_file_handler.py | 46 ++
airflow/utils/session.py | 6 +-
airflow/www/extensions/init_views.py | 2 +-
airflow/www/security.py | 9 +-
airflow/www/static/js/dags.js | 4 +-
airflow/www/static/js/graph.js | 5 +-
airflow/www/static/js/tree.js | 4 +-
airflow/www/templates/airflow/dags.html | 2 +-
airflow/www/templates/airflow/graph.html | 1 +
airflow/www/templates/airflow/tree.html | 3 +-
airflow/www/templates/airflow/trigger.html | 7 +
airflow/www/views.py | 90 ++--
breeze-complete | 1 +
.../templates/triggerer/triggerer-deployment.yaml | 3 +-
.../templates/webserver/webserver-deployment.yaml | 1 +
chart/templates/workers/worker-deployment.yaml | 4 +
.../tests/{test_trigerrer.py => test_triggerer.py} | 0
dev/README_RELEASE_AIRFLOW.md | 32 +-
dev/REFRESHING_CI_CACHE.md | 2 +-
dev/provider_packages/prepare_provider_packages.py | 1 +
dev/validate_version_added_fields_in_config.py | 112 ++++
docs/apache-airflow-providers-airbyte/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-alibaba/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-amazon/commits.rst | 4 +-
.../img/aws-secrets-manager.png | Bin 0 -> 28060 bytes
docs/apache-airflow-providers-amazon/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../secrets-backends/aws-secrets-manager.rst | 74 ++-
.../apache-airflow-providers-apache-beam/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../apache-airflow-providers-apache-hive/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 2 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../apache-airflow-providers-apache-livy/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
docs/apache-airflow-providers-apache-pig/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-asana/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-celery/commits.rst | 4 +-
docs/apache-airflow-providers-celery/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-cloudant/commits.rst | 4 +-
docs/apache-airflow-providers-cloudant/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 2 +-
.../index.rst | 2 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
docs/apache-airflow-providers-databricks/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-datadog/commits.rst | 4 +-
docs/apache-airflow-providers-datadog/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-dingding/commits.rst | 2 +-
docs/apache-airflow-providers-dingding/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-discord/commits.rst | 2 +-
docs/apache-airflow-providers-discord/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-docker/commits.rst | 4 +-
docs/apache-airflow-providers-docker/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-exasol/commits.rst | 4 +-
docs/apache-airflow-providers-exasol/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-facebook/commits.rst | 4 +-
docs/apache-airflow-providers-facebook/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-ftp/commits.rst | 4 +-
docs/apache-airflow-providers-ftp/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-google/commits.rst | 4 +-
docs/apache-airflow-providers-google/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-grpc/commits.rst | 4 +-
docs/apache-airflow-providers-grpc/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-hashicorp/commits.rst | 4 +-
docs/apache-airflow-providers-hashicorp/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-http/commits.rst | 4 +-
docs/apache-airflow-providers-http/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-imap/commits.rst | 4 +-
docs/apache-airflow-providers-imap/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jdbc/commits.rst | 4 +-
docs/apache-airflow-providers-jdbc/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jenkins/commits.rst | 4 +-
docs/apache-airflow-providers-jenkins/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jira/commits.rst | 4 +-
docs/apache-airflow-providers-jira/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../connections/wasb.rst | 2 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../operators/local_to_adls.rst | 6 +-
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
.../index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-mongo/commits.rst | 4 +-
docs/apache-airflow-providers-mongo/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-mysql/commits.rst | 4 +-
docs/apache-airflow-providers-mysql/index.rst | 6 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-neo4j/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-odbc/commits.rst | 4 +-
docs/apache-airflow-providers-odbc/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-openfaas/commits.rst | 4 +-
docs/apache-airflow-providers-openfaas/index.rst | 3 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-opsgenie/commits.rst | 2 +-
docs/apache-airflow-providers-opsgenie/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-oracle/commits.rst | 4 +-
docs/apache-airflow-providers-oracle/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-pagerduty/commits.rst | 4 +-
docs/apache-airflow-providers-pagerduty/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-papermill/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-plexus/commits.rst | 2 +-
docs/apache-airflow-providers-plexus/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-postgres/commits.rst | 6 +-
docs/apache-airflow-providers-postgres/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-presto/commits.rst | 4 +-
docs/apache-airflow-providers-presto/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-qubole/commits.rst | 4 +-
docs/apache-airflow-providers-qubole/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-redis/commits.rst | 4 +-
docs/apache-airflow-providers-redis/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 4 +-
docs/apache-airflow-providers-salesforce/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-samba/commits.rst | 4 +-
docs/apache-airflow-providers-samba/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-segment/commits.rst | 4 +-
docs/apache-airflow-providers-segment/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sendgrid/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sftp/commits.rst | 4 +-
docs/apache-airflow-providers-sftp/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 2 +-
.../apache-airflow-providers-singularity/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-slack/commits.rst | 4 +-
docs/apache-airflow-providers-slack/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-snowflake/commits.rst | 4 +-
docs/apache-airflow-providers-snowflake/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sqlite/commits.rst | 4 +-
docs/apache-airflow-providers-sqlite/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-ssh/commits.rst | 4 +-
.../connections/ssh.rst | 7 +-
docs/apache-airflow-providers-ssh/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-tableau/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-telegram/commits.rst | 2 +-
docs/apache-airflow-providers-telegram/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-trino/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-vertica/commits.rst | 4 +-
docs/apache-airflow-providers-vertica/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-yandex/commits.rst | 4 +-
docs/apache-airflow-providers-yandex/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-zendesk/commits.rst | 4 +-
docs/apache-airflow-providers-zendesk/index.rst | 1 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow/concepts/dags.rst | 2 +-
docs/apache-airflow/howto/custom-operator.rst | 2 +-
docs/apache-airflow/howto/set-up-database.rst | 4 +-
docs/apache-airflow/howto/timetable.rst | 40 +-
docs/apache-airflow/index.rst | 1 +
docs/apache-airflow/installation.rst | 17 -
docs/apache-airflow/installing-from-sources.rst | 124 +++++
docs/apache-airflow/migrations-ref.rst | 16 +-
docs/apache-airflow/release-process.rst | 17 +-
.../security/secrets/secrets-backend/index.rst | 6 +
docs/apache-airflow/start/docker-compose.yaml | 27 +-
docs/apache-airflow/start/docker.rst | 28 +-
docs/apache-airflow/templates-ref.rst | 4 +-
docs/conf.py | 24 +-
docs/docker-stack/entrypoint.rst | 41 ++
docs/installing-providers-from-sources.rst | 124 +++++
docs/spelling_wordlist.txt | 2 +-
scripts/ci/docker-compose/_docker.env | 1 +
scripts/ci/libraries/_build_images.sh | 4 +-
.../pre_commit_check_provider_yaml_files.py | 21 +-
...it_check_providers_subpackages_all_have_init.py | 52 ++
scripts/in_container/run_generate_constraints.sh | 7 +-
setup.cfg | 3 +-
setup.py | 6 -
tests/api_connexion/endpoints/test_dag_endpoint.py | 25 +
tests/api_connexion/endpoints/test_log_endpoint.py | 14 +-
tests/cli/commands/test_dag_command.py | 5 +-
tests/cli/commands/test_task_command.py | 24 +-
tests/conftest.py | 59 ++-
tests/core/test_configuration.py | 42 +-
tests/decorators/test_python.py | 4 +-
tests/deprecated_classes.py | 2 +-
tests/executors/test_celery_executor.py | 2 +-
tests/executors/test_kubernetes_executor.py | 7 +
tests/jobs/test_local_task_job.py | 6 +-
tests/jobs/test_scheduler_job.py | 570 ++++++++++++---------
tests/models/test_base.py | 4 +-
tests/models/test_baseoperator.py | 37 +-
tests/models/test_dag.py | 51 +-
tests/models/test_dagrun.py | 24 +-
tests/models/test_taskinstance.py | 9 +-
tests/models/test_variable.py | 59 ++-
.../aws/config_templates}/__init__.py | 0
.../aws/infrastructure}/__init__.py | 0
.../example_s3_to_redshift}/__init__.py | 0
tests/providers/amazon/aws/operators/test_ecs.py | 54 +-
tests/providers/amazon/aws/operators/test_eks.py | 1 +
.../hooks => amazon/aws/secrets}/__init__.py | 0
.../amazon/aws/secrets/test_secrets_manager.py | 56 +-
.../amazon/aws/transfers/test_s3_to_redshift.py | 116 ++++-
.../amazon/aws/transfers/test_sftp_to_s3.py | 10 +-
tests/providers/apache/drill/hooks/test_drill.py | 4 +-
tests/providers/apache/druid/hooks/test_druid.py | 4 +-
.../providers/apache/druid/operators/test_druid.py | 5 +-
.../apache/kylin/operators/test_kylin_cube.py | 2 +-
tests/providers/apache/pinot/hooks/test_pinot.py | 4 +-
.../apache/spark/operators/test_spark_submit.py | 2 +-
.../kubernetes/operators/test_kubernetes_pod.py | 89 ++++
.../cncf/kubernetes/utils/test_pod_launcher.py | 25 +-
tests/providers/exasol/hooks/test_exasol.py | 4 +-
.../hooks => google/ads/operators}/__init__.py | 0
.../cloud/transfers/test_bigquery_to_mysql.py | 15 +-
.../cloud/transfers/test_facebook_ads_to_gcs.py | 8 +-
.../operators/test_display_video.py | 6 +-
tests/providers/hashicorp/hooks/test_vault.py | 43 +-
.../{zendesk => jenkins}/hooks/__init__.py | 0
.../hooks => microsoft/azure/secrets}/__init__.py | 0
.../azure/transfers/test_local_to_adls.py | 8 +-
...{test_file_to_wasb.py => test_local_to_wasb.py} | 12 +-
...wasb_system.py => test_local_to_wasb_system.py} | 8 +-
.../mssql/operators}/__init__.py | 0
tests/providers/mysql/hooks/test_mysql.py | 4 +-
tests/providers/neo4j/hooks/test_neo4j.py | 109 ++--
tests/providers/neo4j/operators/test_neo4j.py | 31 +-
.../providers/{zendesk/hooks => odbc}/__init__.py | 0
.../providers/{zendesk => odbc}/hooks/__init__.py | 0
.../{zendesk => plexus}/hooks/__init__.py | 0
.../snowflake/operators/test_snowflake.py | 34 +-
tests/providers/ssh/hooks/test_ssh.py | 221 +++++++-
tests/providers/ssh/operators/test_ssh.py | 28 +-
.../{zendesk/hooks => tableau}/__init__.py | 0
tests/sensors/test_external_task_sensor.py | 3 +-
.../perf/scheduler_dag_execution_timing.py | 19 +-
tests/ti_deps/deps/test_runnable_exec_date_dep.py | 3 +
tests/utils/log/test_log_reader.py | 2 +
tests/utils/test_log_handlers.py | 1 +
tests/www/test_security.py | 41 +-
tests/www/views/test_views_acl.py | 33 ++
tests/www/views/test_views_log.py | 4 +-
420 files changed, 5734 insertions(+), 1593 deletions(-)
create mode 100644 airflow/migrations/versions/092435bf5d12_add_max_active_runs_column_to_dagmodel_.py
copy airflow/migrations/versions/{9635ae0956e7_index_faskfail.py => 9635ae0956e7_index_taskfail.py} (98%)
rename airflow/migrations/versions/{9635ae0956e7_index_faskfail.py => ccde3e26fe78_add_index_on_state_dag_id_for_queued_.py} (54%)
copy {tests/providers/zendesk/hooks => airflow/providers/google/config_templates}/__init__.py (100%)
rename airflow/providers/microsoft/azure/example_dags/{example_file_to_wasb.py => example_local_to_wasb.py} (84%)
copy airflow/providers/microsoft/azure/transfers/{file_to_wasb.py => local_to_wasb.py} (97%)
create mode 100644 airflow/utils/log/non_caching_file_handler.py
rename chart/tests/{test_trigerrer.py => test_triggerer.py} (100%)
create mode 100755 dev/validate_version_added_fields_in_config.py
create mode 100644 docs/apache-airflow-providers-airbyte/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-alibaba/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-amazon/img/aws-secrets-manager.png
create mode 100644 docs/apache-airflow-providers-amazon/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-beam/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-cassandra/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-druid/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-hdfs/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-hive/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-kylin/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-livy/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-pig/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-pinot/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-spark/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-sqoop/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-asana/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-celery/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-cloudant/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-cncf-kubernetes/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-databricks/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-datadog/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-dingding/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-discord/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-docker/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-exasol/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-facebook/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-ftp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-google/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-grpc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-hashicorp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-http/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-imap/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jdbc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jenkins/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jira/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-mssql/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-psrp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-winrm/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-mongo/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-mysql/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-neo4j/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-odbc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-openfaas/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-opsgenie/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-oracle/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-pagerduty/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-papermill/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-plexus/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-postgres/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-presto/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-qubole/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-redis/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-salesforce/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-samba/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-segment/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sendgrid/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sftp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-singularity/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-slack/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-snowflake/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sqlite/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-ssh/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-tableau/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-telegram/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-trino/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-vertica/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-yandex/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-zendesk/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow/installing-from-sources.rst
create mode 100644 docs/installing-providers-from-sources.rst
create mode 100755 scripts/ci/pre_commit/pre_commit_check_providers_subpackages_all_have_init.py
copy tests/providers/{zendesk/hooks => amazon/aws/config_templates}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => amazon/aws/infrastructure}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => amazon/aws/infrastructure/example_s3_to_redshift}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => amazon/aws/secrets}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => google/ads/operators}/__init__.py (100%)
copy tests/providers/{zendesk => jenkins}/hooks/__init__.py (100%)
copy tests/providers/{zendesk/hooks => microsoft/azure/secrets}/__init__.py (100%)
rename tests/providers/microsoft/azure/transfers/{test_file_to_wasb.py => test_local_to_wasb.py} (81%)
rename tests/providers/microsoft/azure/transfers/{test_file_to_wasb_system.py => test_local_to_wasb_system.py} (85%)
copy tests/providers/{zendesk/hooks => microsoft/mssql/operators}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => odbc}/__init__.py (100%)
copy tests/providers/{zendesk => odbc}/hooks/__init__.py (100%)
copy tests/providers/{zendesk => plexus}/hooks/__init__.py (100%)
copy tests/providers/{zendesk/hooks => tableau}/__init__.py (100%)