You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2022/03/20 17:53:13 UTC
[airflow] branch optimize-multiplatform-builds updated (191b06e -> 22e8022)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch optimize-multiplatform-builds
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 191b06e fixup! Optimize Multiplatform cache builds
omit ad4e939 Optimize Multiplatform cache builds
add 4f6d24f use different logger to avoid duplicate log entry (#22256)
add c1ab8e2 Protect against accidental misuse of XCom.get_value() (#22244)
add 87c1246 Add Dataplex operators (#20377)
add 152539f Add vertical scrolling to grid view (#22134)
add 46c61ed EMR Sample DAG and Docs Update (#22189)
add 86cc07b Soften the wording in issue templates (#22200)
add 16adc03 Add documentation for Classifier release for March 2022 (#22226)
add 1950c18 Pause autorefresh if scheduler isn't running (#22151)
add a66c072 Addressed some issues in the tutorial mentioned in discussion #22233 (#22236)
add d6ed9cb Add support for private key in connection for Snowflake (#22266)
add 06e1d74 Fixed issue generation to always include last release (#22265)
add 3452f7c Enhance `db upgrade` args (#22102)
add 6448b24 [FIX] typo doc of gcs operator (#22290)
add 9b63df8 Set queued_dttm when submitting task to directly to executor (#22259)
add e93cd4b add a few more fields to the taskinstance finished log message (#22262)
add e07bc63 Filter out default configs when overrides exist. (#21539)
add b00fc78 Fail with error when extending image with pip run as root (#22292)
add 926f6d1 Add arguments to filter list: start_after_key, from_datetime, to_datetime, object_filter callable (#22231)
add d010b0d Masking extras in GET /connections/<connection> endpoint (#22227)
add cc92096 Operator for updating Databricks Repos (#22278)
add dadb132 Added Quick Algorithm Analytics to the list of companies using Apache Airflow (#22279)
add 774ca08 Enable JSON serialization for connections (#19857)
add 3401804 Add test to run offline SQL generation in the CI (#22177)
add 14a2d9d add an option for run id in the ui trigger screen (#21851)
add df6058c Disable default_pool delete on web ui (#21658)
add 6d1d53b Add generic connection type (#22310)
add 7bd165f Remove RefreshConfiguration workaround for K8s token refreshing (#20759)
add 4a1503b Add recipe for BeamRunGoPipelineOperator (#22296)
add 4f1dcdd Remove incorrect deprecation warning in secrets backend (#22326)
add ecc5b74 Stronger language about Docker Compose customizability (#22304)
add 0ec5677 adds ability to pass config params to postgres operator (#21551)
add 1f7836e Add back celery intersphinx mapping (#22370)
add a8de170 Fix broken links to celery documentation (#22364)
add 6a01036 Patch sql_alchemy_conn if old postgres scheme used (#22333)
add 3b47f04 fix deprecation warning in test_default_views.py (#22346)
add 8840203 Add dataflow_default_options to templated_fields (#22367)
add 5eb6335 Update sample dag and doc for S3CreateBucketOperator, S3PutBucketTaggingOperator, S3GetBucketTaggingOperator, S3DeleteBucketTaggingOperator, S3DeleteBucketOperator (#22312)
add 87d363e Correctly handle task_id mangling during unmapping (#22355)
add f309ea7 Reduce DB load incurred by Stale DAG deactivation (#21399)
add 3bc0da3 Add documentation on specifying a DB schema. (#22347)
add 9372aab Add description on the vendoring process we use (#22204)
add 68aa019 Add cgroupspy to _vendor folder (#22206)
add 43dfec3 Expose try_number in airflow vars (#22297)
add a3ffbee Fix skipping non-GCS located jars (#22302)
add 172df9e Apply import fixes to vendored cgroupspy library (#22207)
add ab4ba6f Fix mistakenly added install_requires for all providers (#22382)
add 76d6089 Fix python 3.10 support in vendored in cgroupspy (#22208)
add d8009e5 Optimize Multiplatform cache builds
add 22e8022 fixup! Optimize Multiplatform cache builds
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (191b06e)
\
N -- N -- N refs/heads/optimize-multiplatform-builds (22e8022)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 2 +-
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 4 +-
.../airflow_helmchart_bug_report.yml | 2 +-
.../airflow_providers_bug_report.yml | 2 +-
.github/ISSUE_TEMPLATE/feature_request.yml | 2 +-
.pre-commit-config.yaml | 7 +
BREEZE.rst | 26 +-
Dockerfile | 8 +-
INTHEWILD.md | 1 +
LICENSE | 1 +
STATIC_CODE_CHECKS.rst | 2 +
UPDATING.md | 4 +
airflow/_vendor/README.md | 37 ++
.../_vendor/cgroupspy/__init__.py | 23 +-
airflow/_vendor/cgroupspy/contenttypes.py | 155 ++++++++
airflow/_vendor/cgroupspy/controllers.py | 324 ++++++++++++++++
airflow/_vendor/cgroupspy/interfaces.py | 339 ++++++++++++++++
airflow/_vendor/cgroupspy/nodes.py | 283 ++++++++++++++
airflow/_vendor/cgroupspy/trees.py | 246 ++++++++++++
airflow/_vendor/cgroupspy/utils.py | 69 ++++
airflow/_vendor/vendor.md | 3 +
airflow/api/common/experimental/pool.py | 2 +-
airflow/api_connexion/schemas/connection_schema.py | 20 +-
airflow/cli/cli_parser.py | 99 +++--
airflow/cli/commands/connection_command.py | 164 +++++---
airflow/cli/commands/db_command.py | 52 ++-
airflow/config_templates/config.yml | 8 +
airflow/config_templates/default_airflow.cfg | 4 +
airflow/configuration.py | 79 ++++
airflow/dag_processing/manager.py | 43 ++-
airflow/dag_processing/processor.py | 11 -
airflow/decorators/base.py | 6 +-
airflow/jobs/scheduler_job.py | 6 +-
airflow/kubernetes/kube_client.py | 47 +--
airflow/kubernetes/refresh_config.py | 124 ------
airflow/models/baseoperator.py | 7 +-
airflow/models/connection.py | 31 +-
airflow/models/mappedoperator.py | 5 +-
airflow/models/pool.py | 19 +-
airflow/providers/airbyte/CHANGELOG.rst | 8 +
airflow/providers/airbyte/provider.yaml | 1 +
airflow/providers/alibaba/CHANGELOG.rst | 16 +
airflow/providers/alibaba/provider.yaml | 1 +
airflow/providers/amazon/CHANGELOG.rst | 32 +-
.../example_emr_job_flow_automatic_steps.py | 41 +-
.../example_emr_job_flow_manual_steps.py | 55 +--
.../amazon/aws/example_dags/example_s3_bucket.py | 73 ++--
.../aws/example_dags/example_s3_bucket_tagging.py | 62 ---
airflow/providers/amazon/aws/hooks/base_aws.py | 7 +-
airflow/providers/amazon/aws/hooks/s3.py | 59 ++-
airflow/providers/amazon/aws/operators/emr.py | 19 +-
airflow/providers/amazon/aws/sensors/emr.py | 12 +
airflow/providers/amazon/provider.yaml | 2 +-
airflow/providers/apache/beam/CHANGELOG.rst | 8 +
airflow/providers/apache/beam/hooks/beam.py | 10 +-
airflow/providers/apache/beam/provider.yaml | 1 +
airflow/providers/apache/cassandra/CHANGELOG.rst | 8 +
airflow/providers/apache/cassandra/provider.yaml | 1 +
airflow/providers/apache/drill/CHANGELOG.rst | 8 +
airflow/providers/apache/drill/provider.yaml | 1 +
airflow/providers/apache/druid/CHANGELOG.rst | 8 +
airflow/providers/apache/druid/provider.yaml | 1 +
airflow/providers/apache/hdfs/CHANGELOG.rst | 8 +
airflow/providers/apache/hdfs/provider.yaml | 1 +
airflow/providers/apache/hive/CHANGELOG.rst | 8 +
airflow/providers/apache/hive/provider.yaml | 1 +
airflow/providers/apache/kylin/CHANGELOG.rst | 8 +
airflow/providers/apache/kylin/provider.yaml | 1 +
airflow/providers/apache/livy/CHANGELOG.rst | 8 +
airflow/providers/apache/livy/provider.yaml | 1 +
airflow/providers/apache/pig/CHANGELOG.rst | 8 +
airflow/providers/apache/pig/provider.yaml | 1 +
airflow/providers/apache/pinot/CHANGELOG.rst | 8 +
airflow/providers/apache/pinot/provider.yaml | 1 +
airflow/providers/apache/spark/CHANGELOG.rst | 8 +
airflow/providers/apache/spark/provider.yaml | 1 +
airflow/providers/apache/sqoop/CHANGELOG.rst | 8 +
airflow/providers/apache/sqoop/provider.yaml | 1 +
airflow/providers/asana/CHANGELOG.rst | 8 +
airflow/providers/asana/provider.yaml | 1 +
airflow/providers/celery/CHANGELOG.rst | 8 +
airflow/providers/celery/provider.yaml | 1 +
airflow/providers/cloudant/CHANGELOG.rst | 8 +
airflow/providers/cloudant/provider.yaml | 1 +
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 8 +
airflow/providers/cncf/kubernetes/provider.yaml | 1 +
.../providers/cncf/kubernetes/utils/pod_manager.py | 8 +-
airflow/providers/databricks/CHANGELOG.rst | 14 +
.../example_dags/example_databricks_repos.py | 56 +++
airflow/providers/databricks/hooks/databricks.py | 24 ++
.../databricks/operators/databricks_repos.py | 104 +++++
airflow/providers/databricks/provider.yaml | 10 +
airflow/providers/datadog/CHANGELOG.rst | 8 +
airflow/providers/datadog/provider.yaml | 1 +
airflow/providers/dbt/cloud/operators/dbt.py | 2 +-
airflow/providers/dbt/cloud/provider.yaml | 2 +-
airflow/providers/dingding/CHANGELOG.rst | 8 +
airflow/providers/dingding/provider.yaml | 1 +
airflow/providers/discord/CHANGELOG.rst | 8 +
airflow/providers/discord/provider.yaml | 1 +
airflow/providers/docker/CHANGELOG.rst | 13 +
airflow/providers/docker/provider.yaml | 1 +
airflow/providers/elasticsearch/CHANGELOG.rst | 8 +
airflow/providers/elasticsearch/provider.yaml | 1 +
airflow/providers/exasol/CHANGELOG.rst | 8 +
airflow/providers/exasol/provider.yaml | 1 +
airflow/providers/facebook/CHANGELOG.rst | 8 +
airflow/providers/facebook/provider.yaml | 1 +
airflow/providers/ftp/CHANGELOG.rst | 8 +
airflow/providers/ftp/provider.yaml | 1 +
airflow/providers/github/CHANGELOG.rst | 8 +
airflow/providers/github/provider.yaml | 1 +
airflow/providers/google/CHANGELOG.rst | 28 ++
.../google/cloud/example_dags/example_dataplex.py | 122 ++++++
airflow/providers/google/cloud/hooks/dataplex.py | 247 ++++++++++++
airflow/providers/google/cloud/links/base.py | 2 +-
airflow/providers/google/cloud/links/dataplex.py | 76 ++++
airflow/providers/google/cloud/links/dataproc.py | 4 +-
.../providers/google/cloud/operators/bigquery.py | 2 +-
.../providers/google/cloud/operators/dataflow.py | 45 +--
.../providers/google/cloud/operators/dataplex.py | 428 +++++++++++++++++++++
.../google/cloud/operators/dataproc_metastore.py | 4 +-
airflow/providers/google/cloud/operators/gcs.py | 4 +-
airflow/providers/google/cloud/sensors/dataplex.py | 119 ++++++
airflow/providers/google/provider.yaml | 17 +
airflow/providers/grpc/CHANGELOG.rst | 8 +
airflow/providers/grpc/provider.yaml | 1 +
airflow/providers/hashicorp/CHANGELOG.rst | 8 +
airflow/providers/hashicorp/provider.yaml | 1 +
airflow/providers/http/CHANGELOG.rst | 8 +
airflow/providers/http/provider.yaml | 1 +
airflow/providers/imap/CHANGELOG.rst | 8 +
airflow/providers/imap/provider.yaml | 1 +
airflow/providers/influxdb/CHANGELOG.rst | 8 +
airflow/providers/influxdb/provider.yaml | 1 +
airflow/providers/jdbc/CHANGELOG.rst | 8 +
airflow/providers/jdbc/provider.yaml | 1 +
airflow/providers/jenkins/CHANGELOG.rst | 8 +
airflow/providers/jenkins/provider.yaml | 1 +
airflow/providers/jira/CHANGELOG.rst | 8 +
airflow/providers/jira/provider.yaml | 1 +
airflow/providers/microsoft/azure/CHANGELOG.rst | 13 +
.../microsoft/azure/operators/data_factory.py | 2 +-
airflow/providers/microsoft/azure/provider.yaml | 1 +
airflow/providers/microsoft/mssql/CHANGELOG.rst | 8 +
airflow/providers/microsoft/mssql/provider.yaml | 1 +
airflow/providers/microsoft/psrp/CHANGELOG.rst | 8 +
airflow/providers/microsoft/psrp/provider.yaml | 1 +
airflow/providers/microsoft/winrm/CHANGELOG.rst | 8 +
airflow/providers/microsoft/winrm/provider.yaml | 1 +
airflow/providers/mongo/CHANGELOG.rst | 8 +
airflow/providers/mongo/provider.yaml | 1 +
airflow/providers/mysql/CHANGELOG.rst | 8 +
airflow/providers/mysql/provider.yaml | 1 +
airflow/providers/neo4j/CHANGELOG.rst | 8 +
airflow/providers/neo4j/provider.yaml | 1 +
airflow/providers/odbc/CHANGELOG.rst | 8 +
airflow/providers/odbc/provider.yaml | 1 +
airflow/providers/openfaas/CHANGELOG.rst | 8 +
airflow/providers/openfaas/provider.yaml | 1 +
airflow/providers/opsgenie/CHANGELOG.rst | 8 +
airflow/providers/opsgenie/provider.yaml | 1 +
airflow/providers/oracle/CHANGELOG.rst | 8 +
airflow/providers/oracle/provider.yaml | 1 +
airflow/providers/pagerduty/CHANGELOG.rst | 8 +
airflow/providers/pagerduty/provider.yaml | 1 +
airflow/providers/papermill/CHANGELOG.rst | 8 +
airflow/providers/papermill/provider.yaml | 1 +
airflow/providers/plexus/CHANGELOG.rst | 8 +
airflow/providers/plexus/provider.yaml | 1 +
airflow/providers/postgres/CHANGELOG.rst | 15 +-
.../postgres/example_dags/example_postgres.py | 11 +-
airflow/providers/postgres/operators/postgres.py | 23 +-
airflow/providers/postgres/provider.yaml | 1 +
airflow/providers/presto/CHANGELOG.rst | 8 +
airflow/providers/presto/provider.yaml | 1 +
airflow/providers/qubole/CHANGELOG.rst | 13 +
airflow/providers/qubole/operators/qubole.py | 2 +-
airflow/providers/qubole/provider.yaml | 1 +
airflow/providers/redis/CHANGELOG.rst | 8 +
airflow/providers/redis/provider.yaml | 1 +
airflow/providers/salesforce/CHANGELOG.rst | 8 +
airflow/providers/salesforce/provider.yaml | 1 +
airflow/providers/samba/CHANGELOG.rst | 8 +
airflow/providers/samba/provider.yaml | 1 +
airflow/providers/segment/CHANGELOG.rst | 8 +
airflow/providers/segment/provider.yaml | 1 +
airflow/providers/sendgrid/CHANGELOG.rst | 8 +
airflow/providers/sendgrid/provider.yaml | 1 +
airflow/providers/sftp/CHANGELOG.rst | 8 +
airflow/providers/sftp/provider.yaml | 1 +
airflow/providers/singularity/CHANGELOG.rst | 8 +
airflow/providers/singularity/provider.yaml | 1 +
airflow/providers/slack/CHANGELOG.rst | 7 +
airflow/providers/slack/provider.yaml | 1 +
airflow/providers/snowflake/CHANGELOG.rst | 8 +
airflow/providers/snowflake/hooks/snowflake.py | 66 +++-
airflow/providers/snowflake/provider.yaml | 1 +
airflow/providers/sqlite/CHANGELOG.rst | 8 +
airflow/providers/sqlite/provider.yaml | 1 +
airflow/providers/ssh/CHANGELOG.rst | 8 +
airflow/providers/ssh/provider.yaml | 1 +
airflow/providers/tableau/CHANGELOG.rst | 8 +
airflow/providers/tableau/provider.yaml | 1 +
airflow/providers/telegram/CHANGELOG.rst | 8 +
airflow/providers/telegram/provider.yaml | 1 +
airflow/providers/trino/CHANGELOG.rst | 18 +
airflow/providers/trino/provider.yaml | 1 +
airflow/providers/vertica/CHANGELOG.rst | 8 +
airflow/providers/vertica/provider.yaml | 1 +
airflow/providers/yandex/CHANGELOG.rst | 8 +
airflow/providers/yandex/provider.yaml | 1 +
airflow/providers/zendesk/CHANGELOG.rst | 8 +
airflow/providers/zendesk/provider.yaml | 1 +
airflow/secrets/base_secrets.py | 70 +++-
airflow/secrets/environment_variables.py | 18 +-
airflow/serialization/serialized_objects.py | 1 +
airflow/utils/db.py | 202 +++++-----
airflow/utils/log/secrets_masker.py | 2 +
airflow/utils/operator_helpers.py | 7 +
airflow/www/static/js/graph.js | 3 +-
airflow/www/static/js/tree/StatusBox.jsx | 34 +-
airflow/www/static/js/tree/Tree.jsx | 32 +-
airflow/www/static/js/tree/dagRuns/Bar.jsx | 44 +--
airflow/www/static/js/tree/dagRuns/index.jsx | 7 +-
airflow/www/static/js/tree/renderTaskRows.jsx | 53 ++-
airflow/www/static/js/tree/useTreeData.js | 10 +-
airflow/www/static/js/tree/useTreeData.test.jsx | 15 +-
airflow/www/templates/airflow/main.html | 7 +
airflow/www/templates/airflow/trigger.html | 11 +-
airflow/www/views.py | 27 +-
breeze-complete | 1 +
dev/breeze/src/airflow_breeze/pre_commit_ids.py | 1 +
dev/provider_packages/SETUP_TEMPLATE.cfg.jinja2 | 40 +-
dev/provider_packages/SETUP_TEMPLATE.py.jinja2 | 52 +--
dev/provider_packages/prepare_provider_packages.py | 20 +-
docs/apache-airflow-providers-airbyte/commits.rst | 3 +-
docs/apache-airflow-providers-airbyte/index.rst | 6 +-
docs/apache-airflow-providers-alibaba/commits.rst | 14 +-
docs/apache-airflow-providers-alibaba/index.rst | 2 +-
docs/apache-airflow-providers-amazon/commits.rst | 28 +-
docs/apache-airflow-providers-amazon/index.rst | 6 +-
.../operators/emr.rst | 149 ++++---
.../operators/s3.rst | 90 +++--
.../commits.rst | 3 +-
.../apache-airflow-providers-apache-beam/index.rst | 6 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 11 +
.../index.rst | 6 +-
.../commits.rst | 3 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 2 +-
.../commits.rst | 3 +-
.../apache-airflow-providers-apache-hive/index.rst | 6 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 3 +-
.../apache-airflow-providers-apache-livy/index.rst | 6 +-
.../commits.rst | 3 +-
docs/apache-airflow-providers-apache-pig/index.rst | 2 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 9 +-
.../index.rst | 2 +-
docs/apache-airflow-providers-asana/commits.rst | 3 +-
docs/apache-airflow-providers-asana/index.rst | 2 +-
docs/apache-airflow-providers-celery/commits.rst | 3 +-
docs/apache-airflow-providers-celery/index.rst | 2 +-
docs/apache-airflow-providers-cloudant/commits.rst | 3 +-
docs/apache-airflow-providers-cloudant/index.rst | 2 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 16 +-
docs/apache-airflow-providers-databricks/index.rst | 2 +-
.../operators/repos_update.rst | 66 ++++
.../operators/run_now.rst | 2 +-
docs/apache-airflow-providers-datadog/commits.rst | 3 +-
docs/apache-airflow-providers-datadog/index.rst | 2 +-
.../apache-airflow-providers-dbt-cloud/commits.rst | 14 +-
docs/apache-airflow-providers-dingding/commits.rst | 3 +-
docs/apache-airflow-providers-dingding/index.rst | 6 +-
docs/apache-airflow-providers-discord/commits.rst | 3 +-
docs/apache-airflow-providers-discord/index.rst | 6 +-
docs/apache-airflow-providers-docker/commits.rst | 12 +
docs/apache-airflow-providers-docker/index.rst | 2 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
docs/apache-airflow-providers-exasol/commits.rst | 11 +
docs/apache-airflow-providers-exasol/index.rst | 2 +-
docs/apache-airflow-providers-facebook/commits.rst | 3 +-
docs/apache-airflow-providers-facebook/index.rst | 2 +-
docs/apache-airflow-providers-ftp/commits.rst | 3 +-
docs/apache-airflow-providers-ftp/index.rst | 2 +-
docs/apache-airflow-providers-github/commits.rst | 3 +-
docs/apache-airflow-providers-github/index.rst | 2 +-
docs/apache-airflow-providers-google/commits.rst | 24 ++
docs/apache-airflow-providers-google/index.rst | 7 +-
.../operators/cloud/dataplex.rst | 105 +++++
docs/apache-airflow-providers-grpc/commits.rst | 3 +-
docs/apache-airflow-providers-grpc/index.rst | 2 +-
.../apache-airflow-providers-hashicorp/commits.rst | 3 +-
docs/apache-airflow-providers-hashicorp/index.rst | 6 +-
docs/apache-airflow-providers-http/commits.rst | 3 +-
docs/apache-airflow-providers-http/index.rst | 2 +-
docs/apache-airflow-providers-imap/commits.rst | 11 +
docs/apache-airflow-providers-imap/index.rst | 2 +-
docs/apache-airflow-providers-influxdb/commits.rst | 3 +-
docs/apache-airflow-providers-influxdb/index.rst | 2 +-
docs/apache-airflow-providers-jdbc/commits.rst | 11 +
docs/apache-airflow-providers-jdbc/index.rst | 2 +-
docs/apache-airflow-providers-jenkins/commits.rst | 3 +-
docs/apache-airflow-providers-jenkins/index.rst | 2 +-
docs/apache-airflow-providers-jira/commits.rst | 3 +-
docs/apache-airflow-providers-jira/index.rst | 2 +-
.../commits.rst | 15 +-
.../index.rst | 6 +-
.../commits.rst | 11 +
.../index.rst | 10 +-
.../commits.rst | 3 +-
.../index.rst | 2 +-
.../commits.rst | 9 +-
.../index.rst | 2 +-
docs/apache-airflow-providers-mongo/commits.rst | 3 +-
docs/apache-airflow-providers-mongo/index.rst | 2 +-
docs/apache-airflow-providers-mysql/commits.rst | 9 +-
docs/apache-airflow-providers-mysql/index.rst | 16 +-
docs/apache-airflow-providers-neo4j/commits.rst | 3 +-
docs/apache-airflow-providers-neo4j/index.rst | 2 +-
docs/apache-airflow-providers-odbc/commits.rst | 11 +
docs/apache-airflow-providers-odbc/index.rst | 2 +-
docs/apache-airflow-providers-openfaas/commits.rst | 3 +-
docs/apache-airflow-providers-openfaas/index.rst | 2 +-
docs/apache-airflow-providers-opsgenie/commits.rst | 3 +-
docs/apache-airflow-providers-opsgenie/index.rst | 2 +-
docs/apache-airflow-providers-oracle/commits.rst | 9 +-
docs/apache-airflow-providers-oracle/index.rst | 2 +-
.../apache-airflow-providers-pagerduty/commits.rst | 3 +-
docs/apache-airflow-providers-pagerduty/index.rst | 2 +-
.../apache-airflow-providers-papermill/commits.rst | 3 +-
docs/apache-airflow-providers-papermill/index.rst | 2 +-
docs/apache-airflow-providers-plexus/commits.rst | 3 +-
docs/apache-airflow-providers-plexus/index.rst | 2 +-
docs/apache-airflow-providers-postgres/commits.rst | 9 +-
docs/apache-airflow-providers-postgres/index.rst | 6 +-
.../operators/postgres_operator_howto_guide.rst | 15 +-
docs/apache-airflow-providers-presto/commits.rst | 3 +-
docs/apache-airflow-providers-presto/index.rst | 6 +-
docs/apache-airflow-providers-qubole/commits.rst | 15 +-
docs/apache-airflow-providers-qubole/index.rst | 2 +-
docs/apache-airflow-providers-redis/commits.rst | 3 +-
docs/apache-airflow-providers-redis/index.rst | 2 +-
.../commits.rst | 3 +-
docs/apache-airflow-providers-salesforce/index.rst | 6 +-
docs/apache-airflow-providers-samba/commits.rst | 3 +-
docs/apache-airflow-providers-samba/index.rst | 2 +-
docs/apache-airflow-providers-segment/commits.rst | 3 +-
docs/apache-airflow-providers-segment/index.rst | 2 +-
docs/apache-airflow-providers-sendgrid/commits.rst | 11 +
docs/apache-airflow-providers-sendgrid/index.rst | 2 +-
docs/apache-airflow-providers-sftp/commits.rst | 3 +-
docs/apache-airflow-providers-sftp/index.rst | 6 +-
.../commits.rst | 3 +-
.../apache-airflow-providers-singularity/index.rst | 2 +-
docs/apache-airflow-providers-slack/commits.rst | 11 +
docs/apache-airflow-providers-slack/index.rst | 6 +-
.../apache-airflow-providers-snowflake/commits.rst | 22 ++
.../connections/snowflake.rst | 3 +-
docs/apache-airflow-providers-snowflake/index.rst | 16 +-
docs/apache-airflow-providers-sqlite/commits.rst | 11 +
docs/apache-airflow-providers-sqlite/index.rst | 2 +-
docs/apache-airflow-providers-ssh/commits.rst | 11 +
docs/apache-airflow-providers-ssh/index.rst | 2 +-
docs/apache-airflow-providers-tableau/commits.rst | 11 +
docs/apache-airflow-providers-tableau/index.rst | 2 +-
docs/apache-airflow-providers-telegram/commits.rst | 3 +-
docs/apache-airflow-providers-telegram/index.rst | 2 +-
docs/apache-airflow-providers-trino/commits.rst | 3 +-
docs/apache-airflow-providers-trino/index.rst | 6 +-
docs/apache-airflow-providers-vertica/commits.rst | 11 +
docs/apache-airflow-providers-vertica/index.rst | 2 +-
docs/apache-airflow-providers-yandex/commits.rst | 1 +
docs/apache-airflow-providers-yandex/index.rst | 2 +-
docs/apache-airflow-providers-zendesk/commits.rst | 3 +-
docs/apache-airflow-providers-zendesk/index.rst | 2 +-
.../howto/create-update-providers.rst | 38 ++
docs/apache-airflow/concepts/connections.rst | 2 +
docs/apache-airflow/executor/celery.rst | 4 +-
docs/apache-airflow/howto/connection.rst | 335 ++++++++--------
docs/apache-airflow/howto/set-config.rst | 4 +
docs/apache-airflow/howto/set-up-database.rst | 10 +
docs/apache-airflow/img/connections.png | Bin 79451 -> 0 bytes
docs/apache-airflow/img/new_tutorial-3.png | Bin 0 -> 58198 bytes
docs/apache-airflow/start/docker.rst | 22 +-
docs/apache-airflow/tutorial.rst | 224 +++++++----
docs/apache-airflow/usage-cli.rst | 92 ++++-
docs/conf.py | 2 +-
docs/docker-stack/build.rst | 8 +-
.../{gcloud.Dockerfile => go-beam.Dockerfile} | 29 +-
docs/docker-stack/recipes.rst | 20 +
docs/exts/docs_build/third_party_inventories.py | 2 +-
docs/spelling_wordlist.txt | 3 +
licenses/LICENSE-cgroupspy.txt | 27 ++
scripts/ci/libraries/_testing.sh | 50 +++
..._type.py => pre_commit_check_xcom_get_value.py} | 42 +-
scripts/ci/testing/run_downgrade_test.sh | 48 +--
.../run_offline_sql_test.sh} | 16 +-
scripts/docker/pip | 15 +
setup.cfg | 1 +
setup.py | 3 +-
tests/always/test_connection.py | 46 +++
.../endpoints/test_connection_endpoint.py | 16 +
tests/cli/commands/test_connection_command.py | 206 +++++++---
tests/cli/commands/test_db_command.py | 84 +++-
tests/core/test_configuration.py | 46 +++
tests/dag_processing/test_manager.py | 48 +++
tests/dag_processing/test_processor.py | 25 --
tests/dags/test_default_views.py | 2 +-
tests/kubernetes/test_client.py | 22 +-
tests/kubernetes/test_refresh_config.py | 106 -----
tests/models/test_pool.py | 6 +
tests/models/test_taskinstance.py | 40 ++
tests/providers/amazon/aws/hooks/test_base_aws.py | 4 +-
tests/providers/amazon/aws/hooks/test_s3.py | 12 +
tests/providers/apache/beam/hooks/test_beam.py | 21 +-
tests/providers/apache/hive/hooks/test_hive.py | 3 +
.../databricks/operators/test_databricks_repos.py | 64 +++
.../providers/google/cloud/hooks/test_dataplex.py | 120 ++++++
.../google/cloud/operators/test_dataflow.py | 63 +++
.../google/cloud/operators/test_dataplex.py | 179 +++++++++
.../test_dataplex_system.py} | 23 +-
.../google/cloud/sensors/test_dataplex.py | 103 +++++
.../providers/postgres/operators/test_postgres.py | 15 +
tests/providers/snowflake/hooks/test_snowflake.py | 26 +-
tests/serialization/test_dag_serialization.py | 3 +
tests/utils/test_db.py | 107 ++----
tests/utils/test_operator_helpers.py | 7 +-
tests/www/views/test_views_tasks.py | 31 ++
tests/www/views/test_views_trigger_dag.py | 21 +-
442 files changed, 7213 insertions(+), 1766 deletions(-)
create mode 100644 airflow/_vendor/README.md
copy licenses/LICENSE-flask-kerberos.txt => airflow/_vendor/cgroupspy/__init__.py (50%)
create mode 100644 airflow/_vendor/cgroupspy/contenttypes.py
create mode 100644 airflow/_vendor/cgroupspy/controllers.py
create mode 100644 airflow/_vendor/cgroupspy/interfaces.py
create mode 100644 airflow/_vendor/cgroupspy/nodes.py
create mode 100644 airflow/_vendor/cgroupspy/trees.py
create mode 100644 airflow/_vendor/cgroupspy/utils.py
create mode 100644 airflow/_vendor/vendor.md
delete mode 100644 airflow/kubernetes/refresh_config.py
delete mode 100644 airflow/providers/amazon/aws/example_dags/example_s3_bucket_tagging.py
create mode 100644 airflow/providers/databricks/example_dags/example_databricks_repos.py
create mode 100644 airflow/providers/databricks/operators/databricks_repos.py
create mode 100644 airflow/providers/google/cloud/example_dags/example_dataplex.py
create mode 100644 airflow/providers/google/cloud/hooks/dataplex.py
create mode 100644 airflow/providers/google/cloud/links/dataplex.py
create mode 100644 airflow/providers/google/cloud/operators/dataplex.py
create mode 100644 airflow/providers/google/cloud/sensors/dataplex.py
create mode 100644 docs/apache-airflow-providers-databricks/operators/repos_update.rst
create mode 100644 docs/apache-airflow-providers-google/operators/cloud/dataplex.rst
delete mode 100644 docs/apache-airflow/img/connections.png
create mode 100644 docs/apache-airflow/img/new_tutorial-3.png
copy docs/docker-stack/docker-images-recipes/{gcloud.Dockerfile => go-beam.Dockerfile} (55%)
create mode 100644 licenses/LICENSE-cgroupspy.txt
copy scripts/ci/pre_commit/{pre_commit_docstring_param_type.py => pre_commit_check_xcom_get_value.py} (53%)
copy scripts/ci/{constraints/ci_generate_constraints.sh => testing/run_offline_sql_test.sh} (77%)
create mode 100644 scripts/docker/pip
delete mode 100644 tests/kubernetes/test_refresh_config.py
create mode 100644 tests/providers/databricks/operators/test_databricks_repos.py
create mode 100644 tests/providers/google/cloud/hooks/test_dataplex.py
create mode 100644 tests/providers/google/cloud/operators/test_dataplex.py
copy tests/providers/google/cloud/{transfers/test_gdrive_to_gcs_system.py => operators/test_dataplex_system.py} (73%)
create mode 100644 tests/providers/google/cloud/sensors/test_dataplex.py