You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2021/05/06 08:46:55 UTC
[airflow] tag providers-amazon/1.4.0 updated (6580a2c -> 151ba30)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag providers-amazon/1.4.0
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag providers-amazon/1.4.0 was modified! ***
from 6580a2c (commit)
to 151ba30 (commit)
from 6580a2c Upgrade hadolint to version 2.3.0 (#15573)
add a587dda Fix doc typo (#15584)
add 814e471 Update pre-commit checks (#15583)
add 053d903 `func.sum` may returns `Decimal` that break rest APIs (#15585)
add 414bb20 Serve logs with Scheduler when using Local or Sequential Executor (#15557)
add 943e3ca add an option to trigger a dag w/o changing conf (#15591)
add df143ae An initial rework of the "Concepts" docs (#15444)
add 18ead33 Change helm chart logging level back to default (INFO) (#15597)
add ff4b7c4 Adds log persistence to helm chart (#15595)
add 5045419 Remove odbc dependency in microsoft.mssql provider (#15594)
add 924af8d Fix KEDA Autoscaler ``connectionFromEnv`` (#15561)
add 9c296c9 Fix parallelism after KubeExecutor pod adoption (#15555)
add 7f6ddda Improves production image preparation scripts. (#15577)
add c7cd437 Chart: Change default executor to ``CeleryExecutor`` (#15603)
add 5e79b1e Use latest version of `git-sync` image (#15606)
add c6be8b1 Expose snowflake query_id in snowflake hook and operator, support multiple statements in sql string (#15533)
add d7a14a8 Remove the limit on Gunicorn dependency (#15611)
add 18531f8 Add test for the create user job in helm chart (#15614)
add a4211e2 Fix changing the parent dag state on subdag clear (#15562)
add f8a70e1 Support MySQL db in the helm chart (#15616)
add 8655d66 Helm RBAC Best Practices (#14152)
add 9a6309f Refactor building of results backend connection secret (#15618)
add 807ad32 Prepares provider release after PIP 21 compatibility (#15576)
add 37ce907 Update support policy for Python and Kubernetes (#15612)
add 3d227f2 Automated tagging of default images in DockerHub (#15625)
add 7a4e170 Kubernetes Test Cleanup (#15626)
add db557a8 Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)
add bf81d2e Add docker-context-files detection and cleanup flag. (#15593)
add fc845ca PostgresHook: deepcopy connection to avoid mutating connection obj (#15412)
add 4226f64 Better description of UID/GID behaviour in image and quickstart (#15592)
add 7318787 Fix add quotes to extraConfigMaps/extraSecrets (#15633)
add 5f43cd9 Worker ServiceAccount is needed for KubernetesExecutor (#15642)
add edbc89c Bump ssri from 6.0.1 to 6.0.2 in /airflow/www (#15437)
add 47a5539 Feature qubole hook support headers (#15615)
add 1dcd3d0 Chart: Add unit tests for limits and resources (#15621)
add 32c6362 When one_success mark task as failed if no success (#15467)
add 4ff05fa Fix breeze k8s tests on mac (#15643)
add 0f97a39 Rename example bucket names to use INVALID BUCKET NAME by default (#15651)
add 59be278 Allow chart to work with custom cluster domains (#15640)
add cf6324e Implement BigQuery Table Schema Update Operator (#15367)
add ca432ee HttpHook: Use request factory and respect defaults (#14701)
add 91bb877 Use the Stable REST API for Kubernetes executor integration tests (#15644)
add b1bd594 Add delimiter argument to WasbHook delete_file method (#15637)
add 367d64b Fix chart DAG ``git-sync`` and persistence with ``KubernetesExecutor ``(#15657)
add cf583b9 Rename old "Experimental" API to deprecated in the docs. (#15653)
add dd56875 Improve Test Coverage for Kubernetes Executor (#15617)
add d723ba5 Fix log persistence with KubernetesExecutor (#15659)
add a0eb747 Fix dags table overflow (#15660)
add 60a3da6 Fix building assets on ``breeze start-airflow`` (#15663)
add e47f7e4 Add --executor option to breeze kind-cluster deploy command (#15661)
add 86ad628 More verbose logs when running `airflow check_migrations` (#15662)
add d295e70 Mask passwords and sensitive info in task logs and UI (#15599)
add a781093 Allows overriding versioned dirs when publishing documentation (#15624)
add 13faa69 When installing providers from the context folder, use `pip --find-links` (#15673)
add 817b599 Fix on_failure_callback when task receive SIGKILL (#15537)
add 922668f More test coverage on pgbouncer in the helm chart (#15684)
add 151ba30 Clean up the pre-commit config file (#15681)
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml | 114 +-
BREEZE.rst | 26 +
CI.rst | 17 +
CONTRIBUTING.rst | 1 -
Dockerfile | 2 +-
README.md | 33 +-
airflow/cli/cli_parser.py | 1 +
airflow/cli/commands/scheduler_command.py | 22 +
airflow/cli/commands/task_command.py | 5 +
airflow/config_templates/airflow_local_settings.py | 10 +
airflow/config_templates/config.yml | 34 +-
airflow/config_templates/default_airflow.cfg | 16 +-
airflow/config_templates/default_test.cfg | 4 -
airflow/configuration.py | 2 +
.../example_dags/example_task_group_decorator.py | 12 +-
airflow/executors/kubernetes_executor.py | 66 +-
airflow/hooks/base.py | 4 +-
airflow/jobs/local_task_job.py | 9 +-
airflow/kubernetes/kubernetes_helper_functions.py | 20 +
airflow/models/connection.py | 15 +-
airflow/models/dag.py | 13 +-
airflow/models/pool.py | 15 +-
airflow/models/renderedtifields.py | 11 +
airflow/models/taskinstance.py | 8 +-
airflow/models/variable.py | 13 +-
airflow/providers/amazon/CHANGELOG.rst | 18 +
.../aws/example_dags/example_glacier_to_gcs.py | 2 +-
.../aws/example_dags/example_s3_to_redshift.py | 12 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 2 +-
.../providers/amazon/aws/log/s3_task_handler.py | 2 +-
airflow/providers/amazon/provider.yaml | 1 +
.../apache/beam/example_dags/example_beam.py | 32 +-
.../apache/cassandra/.latest-doc-only-change.txt | 2 +-
.../apache/druid/.latest-doc-only-change.txt | 2 +-
.../apache/hdfs/.latest-doc-only-change.txt | 1 +
.../apache/hive/.latest-doc-only-change.txt | 1 +
.../apache/kylin/.latest-doc-only-change.txt | 2 +-
.../apache/pig/.latest-doc-only-change.txt | 2 +-
.../apache/pinot/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/spark/CHANGELOG.rst | 9 +
airflow/providers/apache/spark/provider.yaml | 1 +
.../apache/sqoop/.latest-doc-only-change.txt | 2 +-
.../providers/celery/.latest-doc-only-change.txt | 2 +-
.../providers/cloudant/.latest-doc-only-change.txt | 2 +-
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 15 +
airflow/providers/cncf/kubernetes/provider.yaml | 1 +
.../databricks/.latest-doc-only-change.txt | 1 +
.../providers/databricks/operators/databricks.py | 4 +-
.../providers/datadog/.latest-doc-only-change.txt | 2 +-
airflow/providers/dependencies.json | 3 -
.../providers/dingding/.latest-doc-only-change.txt | 2 +-
.../dingding/example_dags/example_dingding.py | 25 +-
.../providers/discord/.latest-doc-only-change.txt | 2 +-
airflow/providers/docker/CHANGELOG.rst | 11 +
airflow/providers/docker/provider.yaml | 1 +
airflow/providers/elasticsearch/CHANGELOG.rst | 9 +
airflow/providers/elasticsearch/provider.yaml | 1 +
.../providers/exasol/.latest-doc-only-change.txt | 2 +-
airflow/providers/ftp/CHANGELOG.rst | 8 +
airflow/providers/ftp/provider.yaml | 1 +
airflow/providers/google/CHANGELOG.rst | 13 +
.../google/ads/example_dags/example_ads.py | 2 +-
.../example_automl_nl_text_classification.py | 2 +-
.../example_automl_nl_text_extraction.py | 4 +-
.../example_automl_nl_text_sentiment.py | 2 +-
.../cloud/example_dags/example_automl_tables.py | 2 +-
.../example_dags/example_automl_translation.py | 4 +-
...ple_automl_video_intelligence_classification.py | 2 +-
.../example_automl_video_intelligence_tracking.py | 2 +-
.../example_automl_vision_classification.py | 2 +-
.../example_automl_vision_object_detection.py | 2 +-
.../example_dags/example_azure_fileshare_to_gcs.py | 2 +-
.../cloud/example_dags/example_bigquery_dts.py | 2 +-
.../example_dags/example_bigquery_operations.py | 35 +-
.../cloud/example_dags/example_bigquery_to_gcs.py | 2 +-
.../example_dags/example_bigquery_transfer.py | 2 +-
.../cloud/example_dags/example_cloud_build.py | 2 +-
.../example_dags/example_cloud_memorystore.py | 2 +-
.../google/cloud/example_dags/example_cloud_sql.py | 4 +-
.../cloud/example_dags/example_datacatalog.py | 2 +-
.../google/cloud/example_dags/example_dataflow.py | 10 +-
.../example_dags/example_dataflow_flex_template.py | 2 +-
.../google/cloud/example_dags/example_dataprep.py | 2 +-
.../google/cloud/example_dags/example_dlp.py | 2 +-
.../cloud/example_dags/example_life_sciences.py | 2 +-
.../google/cloud/example_dags/example_mlengine.py | 14 +-
.../cloud/example_dags/example_natural_language.py | 2 +-
.../cloud/example_dags/example_postgres_to_gcs.py | 2 +-
.../cloud/example_dags/example_presto_to_gcs.py | 2 +-
.../cloud/example_dags/example_speech_to_text.py | 2 +-
.../cloud/example_dags/example_translate_speech.py | 2 +-
.../cloud/example_dags/example_trino_to_gcs.py | 2 +-
.../example_dags/example_video_intelligence.py | 2 +-
.../google/cloud/example_dags/example_vision.py | 8 +-
airflow/providers/google/cloud/hooks/bigquery.py | 95 ++
.../providers/google/cloud/operators/bigquery.py | 112 ++
.../firebase/example_dags/example_firestore.py | 2 +-
.../example_dags/example_display_video.py | 2 +-
airflow/providers/http/.latest-doc-only-change.txt | 1 +
airflow/providers/http/hooks/http.py | 25 +-
airflow/providers/imap/.latest-doc-only-change.txt | 1 +
airflow/providers/jdbc/.latest-doc-only-change.txt | 2 +-
.../providers/jenkins/.latest-doc-only-change.txt | 2 +-
airflow/providers/jira/CHANGELOG.rst | 5 +
airflow/providers/jira/provider.yaml | 1 +
airflow/providers/microsoft/azure/CHANGELOG.rst | 27 +
.../example_dags/example_azure_blob_to_gcs.py | 2 +-
airflow/providers/microsoft/azure/hooks/wasb.py | 5 +-
.../microsoft/azure/log/wasb_task_handler.py | 2 +-
airflow/providers/microsoft/azure/provider.yaml | 1 +
.../microsoft/mssql/.latest-doc-only-change.txt | 2 +-
airflow/providers/microsoft/mssql/CHANGELOG.rst | 9 +
.../providers/microsoft/mssql/operators/mssql.py | 17 +-
airflow/providers/microsoft/mssql/provider.yaml | 1 +
airflow/providers/microsoft/winrm/CHANGELOG.rst | 5 +
airflow/providers/microsoft/winrm/provider.yaml | 1 +
.../providers/mongo/.latest-doc-only-change.txt | 1 +
.../providers/mysql/.latest-doc-only-change.txt | 1 +
.../providers/neo4j/.latest-doc-only-change.txt | 2 +-
airflow/providers/odbc/.latest-doc-only-change.txt | 2 +-
.../providers/openfaas/.latest-doc-only-change.txt | 2 +-
.../providers/oracle/.latest-doc-only-change.txt | 1 +
.../pagerduty/.latest-doc-only-change.txt | 2 +-
.../papermill/.latest-doc-only-change.txt | 2 +-
.../providers/plexus/.latest-doc-only-change.txt | 2 +-
airflow/providers/postgres/CHANGELOG.rst | 6 +
airflow/providers/postgres/hooks/postgres.py | 3 +-
airflow/providers/postgres/provider.yaml | 1 +
.../providers/presto/.latest-doc-only-change.txt | 2 +-
.../providers/qubole/.latest-doc-only-change.txt | 2 +-
airflow/providers/qubole/CHANGELOG.rst | 9 +
airflow/providers/qubole/hooks/qubole.py | 14 +-
airflow/providers/qubole/hooks/qubole_check.py | 2 +-
airflow/providers/qubole/operators/qubole.py | 12 +-
airflow/providers/qubole/provider.yaml | 1 +
.../providers/redis/.latest-doc-only-change.txt | 2 +-
.../providers/samba/.latest-doc-only-change.txt | 2 +-
.../providers/segment/.latest-doc-only-change.txt | 2 +-
.../providers/sendgrid/.latest-doc-only-change.txt | 2 +-
airflow/providers/sftp/CHANGELOG.rst | 9 +
airflow/providers/sftp/provider.yaml | 1 +
.../providers/slack/.latest-doc-only-change.txt | 2 +-
.../snowflake/.latest-doc-only-change.txt | 1 +
airflow/providers/snowflake/CHANGELOG.rst | 8 +
.../snowflake/example_dags/example_snowflake.py | 25 +-
airflow/providers/snowflake/hooks/snowflake.py | 53 +-
airflow/providers/snowflake/operators/snowflake.py | 2 +
airflow/providers/snowflake/provider.yaml | 1 +
.../providers/sqlite/.latest-doc-only-change.txt | 2 +-
airflow/providers/ssh/.latest-doc-only-change.txt | 1 +
.../providers/tableau/.latest-doc-only-change.txt | 2 +-
.../providers/telegram/.latest-doc-only-change.txt | 2 +-
.../providers/vertica/.latest-doc-only-change.txt | 2 +-
.../providers/yandex/.latest-doc-only-change.txt | 2 +-
.../providers/zendesk/.latest-doc-only-change.txt | 1 +
airflow/sensors/smart_sensor.py | 7 +
airflow/settings.py | 11 +
airflow/ti_deps/deps/trigger_rule_dep.py | 6 +-
airflow/typing_compat.py | 9 +
airflow/utils/db.py | 5 +-
airflow/utils/file.py | 2 +-
airflow/utils/log/secrets_masker.py | 223 +++
airflow/www/static/css/dags.css | 4 +
airflow/www/static/css/main.css | 26 +
airflow/www/templates/airflow/dag.html | 19 +-
airflow/www/templates/airflow/dags.html | 14 +-
airflow/www/utils.py | 57 +-
airflow/www/views.py | 5 +-
airflow/www/yarn.lock | 6 +-
breeze | 43 +
breeze-complete | 7 +
chart/files/pod-template-file.kubernetes-helm-yaml | 22 +-
chart/templates/_helpers.yaml | 141 +-
chart/templates/cleanup/cleanup-cronjob.yaml | 2 +-
.../templates/cleanup/cleanup-serviceaccount.yaml | 14 +-
chart/templates/flower/flower-deployment.yaml | 1 +
.../flower-serviceaccount.yaml} | 8 +-
.../create-user-job-serviceaccount.yaml} | 12 +-
chart/templates/{ => jobs}/create-user-job.yaml | 1 +
.../migrate-database-job-serviceaccount.yaml} | 12 +-
.../templates/{ => jobs}/migrate-database-job.yaml | 1 +
...ount.yaml => logs-persistent-volume-claim.yaml} | 29 +-
.../templates/pgbouncer/pgbouncer-deployment.yaml | 3 +
chart/templates/pgbouncer/pgbouncer-service.yaml | 2 -
.../pgbouncer-serviceaccount.yaml} | 8 +-
chart/templates/rbac/pod-cleanup-role.yaml | 2 +-
chart/templates/rbac/pod-cleanup-rolebinding.yaml | 4 +-
chart/templates/rbac/pod-launcher-role.yaml | 2 +-
chart/templates/rbac/pod-launcher-rolebinding.yaml | 6 +-
chart/templates/rbac/pod-log-reader-role.yaml | 2 +-
.../templates/rbac/pod-log-reader-rolebinding.yaml | 2 +-
.../redis-serviceaccount.yaml} | 8 +-
chart/templates/redis/redis-statefulset.yaml | 1 +
.../templates/scheduler/scheduler-deployment.yaml | 37 +-
.../scheduler/scheduler-serviceaccount.yaml | 6 +-
.../secrets/metadata-connection-secret.yaml | 11 +-
.../secrets/result-backend-connection-secret.yaml | 14 +-
chart/templates/statsd/statsd-deployment.yaml | 3 +
.../statsd-serviceaccount.yaml} | 8 +-
.../templates/webserver/webserver-deployment.yaml | 11 +-
.../webserver/webserver-serviceaccount.yaml | 6 +-
chart/templates/workers/worker-deployment.yaml | 16 +-
chart/templates/workers/worker-serviceaccount.yaml | 6 +-
chart/tests/test_annotations.py | 138 ++
chart/tests/test_basic_helm_chart.py | 18 +-
...ate_database_job.py => test_create_user_job.py} | 15 +-
chart/tests/test_flower.py | 24 +
chart/tests/test_git_sync_webserver.py | 4 +-
chart/tests/test_git_sync_worker.py | 4 +-
chart/tests/test_kerberos.py | 6 +
...igrate_database_job.py => test_limit_ranges.py} | 18 +-
chart/tests/test_logs_persistent_volume_claim.py | 69 +
chart/tests/test_metadata_connection_secret.py | 108 ++
chart/tests/test_migrate_database_job.py | 2 +-
chart/tests/test_pgbouncer.py | 205 ++-
chart/tests/test_pod_launcher_role.py | 4 +-
chart/tests/test_pod_template_file.py | 79 +-
chart/tests/test_rbac.py | 297 ++++
chart/tests/test_redis.py | 24 +
chart/tests/test_resource_quota.py | 47 +
.../tests/test_result_backend_connection_secret.py | 124 ++
chart/tests/test_scheduler.py | 44 +
chart/tests/test_statsd.py | 24 +
chart/tests/test_webserver_deployment.py | 53 +
chart/tests/test_worker.py | 48 +
chart/values.schema.json | 276 +++-
chart/values.yaml | 166 +-
dev/README_RELEASE_AIRFLOW.md | 54 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 5 +-
dev/airflow-license | 4 +-
dev/provider_packages/prepare_provider_packages.py | 26 +-
docs/apache-airflow-providers-airbyte/index.rst | 18 -
docs/apache-airflow-providers-amazon/commits.rst | 19 +
docs/apache-airflow-providers-amazon/index.rst | 29 +-
.../commits.rst | 18 +-
.../apache-airflow-providers-apache-beam/index.rst | 80 +-
.../index.rst | 9 -
.../index.rst | 9 -
.../apache-airflow-providers-apache-hdfs/index.rst | 9 -
.../apache-airflow-providers-apache-hive/index.rst | 9 -
.../index.rst | 9 -
.../apache-airflow-providers-apache-livy/index.rst | 9 -
docs/apache-airflow-providers-apache-pig/index.rst | 9 -
.../index.rst | 9 -
.../commits.rst | 24 +-
.../index.rst | 20 +-
.../index.rst | 9 -
docs/apache-airflow-providers-celery/index.rst | 9 -
docs/apache-airflow-providers-cloudant/index.rst | 9 -
.../commits.rst | 16 +
.../index.rst | 26 +-
docs/apache-airflow-providers-databricks/index.rst | 9 -
docs/apache-airflow-providers-datadog/index.rst | 9 -
docs/apache-airflow-providers-dingding/index.rst | 9 -
docs/apache-airflow-providers-discord/index.rst | 9 -
docs/apache-airflow-providers-docker/commits.rst | 14 +
docs/apache-airflow-providers-docker/index.rst | 22 +-
.../commits.rst | 18 +-
.../index.rst | 20 +-
docs/apache-airflow-providers-exasol/index.rst | 9 -
docs/apache-airflow-providers-facebook/index.rst | 9 -
docs/apache-airflow-providers-ftp/commits.rst | 24 +-
docs/apache-airflow-providers-ftp/index.rst | 19 +-
docs/apache-airflow-providers-google/commits.rst | 21 +
docs/apache-airflow-providers-google/index.rst | 82 +-
.../operators/ads.rst | 4 +-
.../operators/cloud/bigquery.rst | 17 +
.../operators/cloud/bigquery_dts.rst | 8 +-
.../operators/cloud/cloud_build.rst | 2 +-
.../operators/cloud/cloud_memorystore.rst | 20 +-
.../operators/cloud/datacatalog.rst | 42 +-
.../operators/cloud/datafusion.rst | 20 +-
.../operators/cloud/gcs.rst | 2 +-
.../operators/cloud/mlengine.rst | 4 +-
.../operators/cloud/natural_language.rst | 8 +-
.../operators/firebase/firestore.rst | 2 +-
.../operators/marketing_platform/analytics.rst | 6 +-
.../marketing_platform/campaign_manager.rst | 14 +-
.../operators/marketing_platform/display_video.rst | 20 +-
.../operators/marketing_platform/search_ads.rst | 6 +-
.../operators/suite/sheets.rst | 2 +-
.../operators/transfer/gcs_to_gdrive.rst | 2 +-
.../operators/transfer/gcs_to_sftp.rst | 2 +-
.../operators/transfer/gcs_to_sheets.rst | 2 +-
.../operators/transfer/gdrive_to_gcs.rst | 2 +-
.../operators/transfer/sftp_to_gcs.rst | 2 +-
.../operators/transfer/sheets_to_gcs.rst | 2 +-
docs/apache-airflow-providers-grpc/index.rst | 9 -
docs/apache-airflow-providers-hashicorp/index.rst | 9 -
docs/apache-airflow-providers-http/index.rst | 9 -
docs/apache-airflow-providers-imap/index.rst | 9 -
docs/apache-airflow-providers-jdbc/index.rst | 9 -
docs/apache-airflow-providers-jdbc/operators.rst | 2 +-
docs/apache-airflow-providers-jenkins/index.rst | 9 -
docs/apache-airflow-providers-jira/commits.rst | 22 +-
docs/apache-airflow-providers-jira/index.rst | 16 +-
.../commits.rst | 14 +
.../index.rst | 38 +-
.../commits.rst | 24 +-
.../index.rst | 39 +-
.../commits.rst | 11 +
.../index.rst | 16 +-
docs/apache-airflow-providers-mongo/index.rst | 9 -
docs/apache-airflow-providers-mysql/index.rst | 9 -
docs/apache-airflow-providers-neo4j/index.rst | 9 -
docs/apache-airflow-providers-odbc/index.rst | 9 -
docs/apache-airflow-providers-openfaas/index.rst | 9 -
docs/apache-airflow-providers-opsgenie/index.rst | 9 -
docs/apache-airflow-providers-oracle/index.rst | 9 -
docs/apache-airflow-providers-pagerduty/index.rst | 9 -
docs/apache-airflow-providers-papermill/index.rst | 9 -
docs/apache-airflow-providers-plexus/index.rst | 9 -
docs/apache-airflow-providers-postgres/commits.rst | 23 +-
docs/apache-airflow-providers-postgres/index.rst | 17 +-
docs/apache-airflow-providers-presto/index.rst | 9 -
docs/apache-airflow-providers-qubole/index.rst | 9 -
docs/apache-airflow-providers-redis/index.rst | 9 -
docs/apache-airflow-providers-salesforce/index.rst | 9 -
docs/apache-airflow-providers-samba/index.rst | 9 -
docs/apache-airflow-providers-segment/index.rst | 9 -
docs/apache-airflow-providers-sendgrid/index.rst | 9 -
docs/apache-airflow-providers-sftp/commits.rst | 17 +-
docs/apache-airflow-providers-sftp/index.rst | 20 +-
.../apache-airflow-providers-singularity/index.rst | 9 -
docs/apache-airflow-providers-slack/index.rst | 9 -
.../apache-airflow-providers-snowflake/commits.rst | 13 +
docs/apache-airflow-providers-snowflake/index.rst | 19 +-
docs/apache-airflow-providers-sqlite/index.rst | 9 -
docs/apache-airflow-providers-ssh/index.rst | 9 -
docs/apache-airflow-providers-tableau/index.rst | 9 -
docs/apache-airflow-providers-telegram/index.rst | 9 -
docs/apache-airflow-providers-trino/index.rst | 9 -
docs/apache-airflow-providers-vertica/index.rst | 9 -
docs/apache-airflow-providers-yandex/index.rst | 9 -
docs/apache-airflow-providers-zendesk/index.rst | 9 -
docs/apache-airflow/best-practices.rst | 2 +-
docs/apache-airflow/concepts.rst | 1708 --------------------
docs/apache-airflow/concepts/cluster-policies.rst | 92 ++
docs/apache-airflow/concepts/connections.rst | 37 +
docs/apache-airflow/concepts/dags.rst | 587 +++++++
.../{howto/operator => concepts}/index.rst | 42 +-
docs/apache-airflow/concepts/operators.rst | 143 ++
docs/apache-airflow/concepts/overview.rst | 96 ++
docs/apache-airflow/concepts/pools.rst | 46 +
docs/apache-airflow/{ => concepts}/scheduler.rst | 2 +-
docs/apache-airflow/concepts/sensors.rst | 33 +
.../smart-sensors.rst} | 14 +-
docs/apache-airflow/concepts/taskflow.rst | 72 +
docs/apache-airflow/concepts/tasks.rst | 167 ++
docs/apache-airflow/concepts/variables.rst | 48 +
docs/apache-airflow/concepts/xcoms.rst | 49 +
...est-api-ref.rst => deprecated-rest-api-ref.rst} | 15 +-
docs/apache-airflow/executor/index.rst | 54 +-
docs/apache-airflow/faq.rst | 2 +-
docs/apache-airflow/howto/connection.rst | 2 +-
docs/apache-airflow/howto/custom-operator.rst | 4 +-
docs/apache-airflow/howto/operator/bash.rst | 2 +-
docs/apache-airflow/howto/operator/index.rst | 2 +-
docs/apache-airflow/howto/operator/python.rst | 2 +-
docs/apache-airflow/howto/variable.rst | 2 +-
docs/apache-airflow/img/arch-diag-basic.png | Bin 16303 -> 16357 bytes
docs/apache-airflow/img/basic-dag.png | Bin 0 -> 5393 bytes
docs/apache-airflow/img/task_stages.png | Bin 12919 -> 0 bytes
docs/apache-airflow/index.rst | 6 +-
docs/apache-airflow/installation.rst | 2 +-
docs/apache-airflow/integration.rst | 2 +-
docs/apache-airflow/macros-ref.rst | 2 +-
docs/apache-airflow/operators-and-hooks-ref.rst | 2 +-
docs/apache-airflow/redirects.txt | 6 +
docs/apache-airflow/security/secrets/index.rst | 71 +-
docs/apache-airflow/security/webserver.rst | 12 +-
docs/apache-airflow/start/docker.rst | 56 +-
docs/apache-airflow/timezone.rst | 2 +-
docs/apache-airflow/tutorial.rst | 5 +-
docs/apache-airflow/tutorial_taskflow_api.rst | 8 +-
docs/apache-airflow/ui.rst | 10 +-
docs/apache-airflow/usage-cli.rst | 13 -
docs/build_docs.py | 5 +-
docs/docker-stack/entrypoint.rst | 22 +
docs/exts/docs_build/code_utils.py | 14 +-
docs/exts/docs_build/docs_builder.py | 20 +-
docs/helm-chart/airflow-configuration.rst | 1 -
docs/helm-chart/index.rst | 1 +
docs/helm-chart/manage-logs.rst | 89 +
docs/helm-chart/parameters-ref.rst | 108 +-
docs/publish_docs.py | 8 +-
docs/spelling_wordlist.txt | 4 +
kubernetes_tests/test_kubernetes_executor.py | 51 +-
kubernetes_tests/test_kubernetes_pod_operator.py | 28 -
.../test_kubernetes_pod_operator_backcompat.py | 69 -
scripts/ci/images/ci_build_dockerhub.sh | 17 +-
.../ci/images/ci_wait_for_and_verify_ci_image.sh | 2 +-
.../ci/images/ci_wait_for_and_verify_prod_image.sh | 2 +-
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 4 +-
scripts/ci/libraries/_build_images.sh | 60 +-
scripts/ci/libraries/_initialization.sh | 12 +
scripts/ci/libraries/_kind.sh | 9 +-
.../docker/install_from_docker_context_files.sh | 33 +-
scripts/in_container/bin/run_tmux | 2 +-
setup.cfg | 2 +-
tests/cli/commands/test_pool_command.py | 2 +-
tests/cli/commands/test_scheduler_command.py | 72 +
tests/cli/commands/test_user_command.py | 2 +-
tests/core/test_config_templates.py | 2 -
tests/dags/test_task_view_type_check.py | 4 +-
tests/executors/test_kubernetes_executor.py | 124 +-
tests/jobs/test_local_task_job.py | 33 +-
tests/jobs/test_scheduler_job.py | 4 +-
tests/models/test_connection.py | 48 +
tests/models/test_dag.py | 57 +
tests/models/test_renderedtifields.py | 28 +-
tests/models/test_taskinstance.py | 31 +-
tests/models/test_variable.py | 40 +
tests/operators/test_sql.py | 22 +-
tests/operators/test_weekday.py | 2 +-
.../amazon/aws/log/test_cloudwatch_task_handler.py | 2 +-
.../amazon/aws/log/test_s3_task_handler.py | 2 +-
.../kubernetes/operators/test_kubernetes_pod.py | 21 +
.../providers/google/cloud/hooks/test_bigquery.py | 172 ++
.../google/cloud/operators/test_bigquery.py | 31 +
tests/providers/http/hooks/test_http.py | 74 +
tests/providers/http/sensors/test_http.py | 3 +
tests/providers/jenkins/hooks/test_jenkins.py | 2 +-
tests/providers/microsoft/azure/hooks/test_wasb.py | 2 +-
.../microsoft/azure/log/test_wasb_task_handler.py | 2 +-
.../microsoft/mssql/operators/test_mssql.py | 47 +-
tests/providers/postgres/hooks/test_postgres.py | 12 +
tests/providers/slack/hooks/test_slack.py | 12 +-
tests/providers/snowflake/hooks/test_snowflake.py | 19 +
tests/providers/yandex/hooks/test_yandex.py | 2 +-
tests/utils/log/test_secrets_masker.py | 236 +++
tests/utils/test_task_group.py | 52 +-
tests/www/test_utils.py | 43 -
433 files changed, 7129 insertions(+), 3501 deletions(-)
create mode 100644 airflow/providers/apache/hdfs/.latest-doc-only-change.txt
create mode 100644 airflow/providers/apache/hive/.latest-doc-only-change.txt
create mode 100644 airflow/providers/databricks/.latest-doc-only-change.txt
create mode 100644 airflow/providers/http/.latest-doc-only-change.txt
create mode 100644 airflow/providers/imap/.latest-doc-only-change.txt
create mode 100644 airflow/providers/mongo/.latest-doc-only-change.txt
create mode 100644 airflow/providers/mysql/.latest-doc-only-change.txt
create mode 100644 airflow/providers/oracle/.latest-doc-only-change.txt
create mode 100644 airflow/providers/snowflake/.latest-doc-only-change.txt
create mode 100644 airflow/providers/ssh/.latest-doc-only-change.txt
create mode 100644 airflow/providers/zendesk/.latest-doc-only-change.txt
create mode 100644 airflow/utils/log/secrets_masker.py
copy chart/templates/{webserver/webserver-serviceaccount.yaml => flower/flower-serviceaccount.yaml} (80%)
copy chart/templates/{webserver/webserver-serviceaccount.yaml => jobs/create-user-job-serviceaccount.yaml} (75%)
rename chart/templates/{ => jobs}/create-user-job.yaml (97%)
copy chart/templates/{webserver/webserver-serviceaccount.yaml => jobs/migrate-database-job-serviceaccount.yaml} (76%)
rename chart/templates/{ => jobs}/migrate-database-job.yaml (97%)
copy chart/templates/{scheduler/scheduler-serviceaccount.yaml => logs-persistent-volume-claim.yaml} (63%)
copy chart/templates/{webserver/webserver-serviceaccount.yaml => pgbouncer/pgbouncer-serviceaccount.yaml} (83%)
copy chart/templates/{webserver/webserver-serviceaccount.yaml => redis/redis-serviceaccount.yaml} (79%)
copy chart/templates/{webserver/webserver-serviceaccount.yaml => statsd/statsd-serviceaccount.yaml} (84%)
create mode 100644 chart/tests/test_annotations.py
copy chart/tests/{test_migrate_database_job.py => test_create_user_job.py} (68%)
copy chart/tests/{test_migrate_database_job.py => test_limit_ranges.py} (59%)
create mode 100644 chart/tests/test_logs_persistent_volume_claim.py
create mode 100644 chart/tests/test_metadata_connection_secret.py
create mode 100644 chart/tests/test_rbac.py
create mode 100644 chart/tests/test_resource_quota.py
create mode 100644 chart/tests/test_result_backend_connection_secret.py
delete mode 100644 docs/apache-airflow/concepts.rst
create mode 100644 docs/apache-airflow/concepts/cluster-policies.rst
create mode 100644 docs/apache-airflow/concepts/connections.rst
create mode 100644 docs/apache-airflow/concepts/dags.rst
copy docs/apache-airflow/{howto/operator => concepts}/index.rst (63%)
create mode 100644 docs/apache-airflow/concepts/operators.rst
create mode 100644 docs/apache-airflow/concepts/overview.rst
create mode 100644 docs/apache-airflow/concepts/pools.rst
rename docs/apache-airflow/{ => concepts}/scheduler.rst (99%)
create mode 100644 docs/apache-airflow/concepts/sensors.rst
rename docs/apache-airflow/{smart-sensor.rst => concepts/smart-sensors.rst} (93%)
create mode 100644 docs/apache-airflow/concepts/taskflow.rst
create mode 100644 docs/apache-airflow/concepts/tasks.rst
create mode 100644 docs/apache-airflow/concepts/variables.rst
create mode 100644 docs/apache-airflow/concepts/xcoms.rst
rename docs/apache-airflow/{rest-api-ref.rst => deprecated-rest-api-ref.rst} (90%)
mode change 100644 => 100755 docs/apache-airflow/img/arch-diag-basic.png
create mode 100755 docs/apache-airflow/img/basic-dag.png
delete mode 100644 docs/apache-airflow/img/task_stages.png
create mode 100644 docs/helm-chart/manage-logs.rst
create mode 100644 tests/cli/commands/test_scheduler_command.py
create mode 100644 tests/utils/log/test_secrets_masker.py