You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ta...@apache.org on 2024/01/09 15:43:11 UTC

(airflow) branch pendulum-3 updated (e623348429 -> 669d9e1e7b)

This is an automated email from the ASF dual-hosted git repository.

taragolis pushed a change to branch pendulum-3
in repository https://gitbox.apache.org/repos/asf/airflow.git


    omit e623348429 Update airflow/serialization/serialized_objects.py
    omit 72b806371d Add backcompat to pendulum 2
    omit dd07a6c99b Add support of Pendulum 3
     add 71c726d52d Update BREEZE.rst with different test example (#36234)
     add 8b723e498d Use RST headers instead of Markdown (#36452)
     add 9e55f51a9f Remove unused `_parse_version` function (#36450)
     add d73bef2a43 Add Amazon Athena query results extra link (#36447)
     add 127c0725b9 Revert "Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36443)" (#36453)
     add 949fc5788e Fix get_leaves calculation for teardown in nested group (#36456)
     add 71314b86cf Yet another attempt to fix flakey `test_disable_logging` test (#36455)
     add cba3ca7067 Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36443) (#36457)
     add 5b133e03ee Update Provider's release documentation: (#36461)
     add 8fea49f90a Update providers metadata 2023-12-28 (#36459)
     add 49ce3ed006 Remove backcompat code for stackdriver (#36442)
     add c0019e10d4 Remove Plexus and sqoop providers (#36460)
     add 9b5d6bfe27 Add documentation for 3rd wave of providers in Deember (#36464)
     add c16b421872 Remove pypitest from the release process (#36466)
     add a3e5a971ed Fix preparing rc candidates for providers (#36465)
     add 22294abf68 Use base aws classes in AWS Step Functions Operators/Sensors/Triggers (#36468)
     add e3fb20d358 Add utkarsharma2 to committers list (#36474)
     add 0a741b2fe6 Handle  list like input objects in weavaite's 'create_or_replace_document_objects' hook method (#36475)
     add 5d88f6f9a4 Improve generation of "Status of testing" issue (#36470)
     add 7cd326ccbd fix: Repair defferable operator list in docs (#36476)
     add 5551e14f6c Check executable permission for entrypoints at breeze start (#36482)
     add ed9080ae6a change spark connection form and add spark connections docs (#36419)
     add 07226795ae Fix assignment of template field in `__init__` in `hive_to_samba.py` (#36486)
     add 718efc0c6c Add further details to replacement documentation (#36485)
     add 918552acad prevent templated field logic checks in operators __init__ (#36489)
     add eac3d95584 remove unnecessary templated filed (#36490)
     add 0d9a26ceef Add branching based on mapped task group example to dynamic-task-mapping.rst (#36480)
     add f070efa95c remove unecessary templated field (#36491)
     add 2bc34ffcb5 Add zlib1g-dev package to Airflow images (#36493)
     add 3d6ecdfd9b Review and update our Pull Request review process and policy (#36472)
     add dea715dd4e Add description on the ways how users should approach DB monitoring (#36483)
     add 13e4905a60 Bump stalebot to version 9 (#36494)
     add 09603ff23f Adding versioned unit tests for kerberos init container (#36364)
     add 31b06d5b12 Add jira connection docs and UI form (#36458)
     add 83bdc297ce added cli command to list auth managers under `airflow providers` (#36445)
     add bed2789c24 Add few tests on the mapped task group. (#36149)
     add db0679de12 Added Check for Cancel Workflow Invocation and added new Query Workflow Invocation operator (#36351)
     add 9d45db9e2c Refactor _manage_executor_state by refreshing TIs in batch (#36418)
     add 465c2f6946 Fix the .asf.yml indentation (#36496)
     add 84063e74fb Add flask config: `MAX_CONTENT_LENGTH` (#36401)
     add 72f43fcc83 Revert "Refactor _manage_executor_state by refreshing TIs in batch (#36418)" (#36500)
     add 6937ae7647 Speed up autocompletion of Breeze by simplifying provider state (#36499)
     add f0e05e8ff6 Fixes small issues related to suspended/removed providers (#36501)
     add 9cf5f6f084 Refactor _manage_executor_state by refreshing TIs in batch (#36502)
     add c87ef553bc Fix multiple issues in release notes does not have links (#36503)
     add 876b3fa372 docs: `Add AzureSynapseRunPipelineOperator` (#36495)
     add d7cb1a0498 Add fab provider to boring-cyborg.yml (#36505)
     add 3aeb31b513 Update providers metadata 2023-12-31 (#36507)
     add 24a532fb4c Prepare documentation for weaviate ad-hoc rc2 release (#36508)
     add 52a16bf332 Update description of release process to include options for next RCs (#36506)
     add fd0facc9f0 Clarify how to find changelog for the RC candidates of providers (#36512)
     add 326ae6bdc2 Add docs for opsgenie connection (#36519)
     add 9f90a655e8 Update installation prerequisites after upgrading to Debian Bookworm (#36521)
     add eecb4793ab Announce MSSQL support end in Airflow 2.9.0, add migration script hints (#36509)
     add 383ad31c76 Raise error when ``DagRun`` fails while running ``dag test`` (#36517)
     add 7e26f79d4b feat: K8S 1.29 support (#36527)
     add e28627f6a5 Cli export / import roles including permissions (#36347)
     add 223a98420b Update providers metadata 2024-01-02 (#36531)
     add 18b7013581 Fix details tab not showing when using dynamic task mapping (#36522)
     add 75aa4a3385 Preserve ASCII control characters directly through the BigQuery load API (#36533)
     add 3f738d19ee Add docs and user-friendly connection form for Samba connection (#36543)
     add ef9e8b0e7a Update dags.rst with information on DAG pausing (#36540)
     add dec78ab3f1 Remove MSSQL support form Airflow core (#36514)
     add eab75fac95 Remove MSSQL support from breeze (#36515)
     add 2f15c95a28 Changing wording in docstring for CNCF provider (#36547)
     add f0e3e612ba feat: Add openlineage docs ext with list of supported operators and hooks. (#36311)
     add bd1d2f4448 Rewording text in CONTRIBUTING guide (#36534)
     add 3598a52a2d Sanitize filenames in MySQLHook (#33328)
     add dc228f9233 Fix test `test_cli_import_roles` (#36558)
     add 59c76cfb30 Update collaborators for Airflow (#36564)
     add 2093b6f3b9 Fix security manager inheritance in fab provider (#36538)
     add 9d1eba087b Add pre-commit check to check integrations table. (#36497)
     add f28643b7bd Implement Google Analytics Admin (GA4) operators (#36276)
     add 28cad70223 Move config related to FAB auth manager to FAB provider (#36232)
     add e89b1aac0a Support git-sync v4 in Helm Chart (#34731)
     add 8fba23fc84 Fix configuration of mypy plugins to point to paths not modules (#36563)
     add 2c15dc9dd1 Fix copy&paste victim for installation instructions (#36572)
     add 125c7af1b8 Improve TaskInstance typing hints (#36487)
     add c2115b810f Add Aritra to collaborators (#36568)
     add 574f86ee1e Improve the error message displayed when there is a webserver error (#36570)
     add 66f9b385f5 Add username authenticating to the Redis hook (#36562)
     add 08f6e2e5d2 Fix misconfiguration of redis client with ssl (#36561)
     add fc2478eed6 Fix failing test for redis caused by cross-merging 2 PRs (#36579)
     add 9829e86cf6 Add docs to redis connection (#36581)
     add 2d083cb208 Fix an edge case when parallel spell-checking fails (#36591)
     add 5cf2560cce Some improvements to Airflow IO code (#36259)
     add 928dab4c5e Adding Pinecone system tests (#36590)
     add 421703c741 Adding Pgvector system tests (#36592)
     add 6e935491f1 Adding Weaviate system tests (#36573)
     add 33996a49f1 Add support for openlineage to AFS and common.io (#36410)
     add 44b97e1687 Add OpenLineage support for Redshift SQL. (#35794)
     add e5964ed1c1 Metrics Tagging (#36528)
     add a95d0e6d38 Remove Python 3.12 limitation in order to test Python 3.12 builds (#36595)
     add ac4073b737 Make it possible to change the default cron timetable (#34851)
     add ebd588b9f4 Add AWS Step Functions links (#36599)
     add a877bde5a3 Fix assignment of template field in `__init__` in `DataSyncOperator` (#36605)
     add 0c10ddb3c6 Ignore MyPy error introduced by the new Apache Beam (#36607)
     add 142c7376c6 Optimise getting changelogs in airflow-github (#36548)
     add 60aa611f04 Remove option ot set a task instance to running state in UI (#36518)
     add b3b8ae99ca Tracking airflow-github changelog activities using progress bar (#36610)
     add c1bba9906c Fix assignment of template field in `__init__` in `AwsToAwsBaseOperator` (#36604)
     add 16361f18d8 Fix broken link for Redshift connection (#36614)
     add 1cc9fe1df1 Add flake8-implicit-str-concat check to Ruff (#36597)
     add 034e618347 Use base aws classes in Amazon SNS Operators (#36615)
     add 16d16e2933 Use base aws classes in Amazon SQS Operators/Sensors/Triggers (#36613)
     add c47dcc59e5 Improve and add more complete description in the architecture diagrams (#36513)
     add 70be78f4e7 Fix run type icon alignment with run type text (#36616)
     add ba20baeafd Replace numpy example with practical exercise demonstrating top-level code (#35097)
     add 9f275cf890 Avoid using dict as default value in call_regular_interval (#36608)
     add 365f206a32 Select ruff B006 to detect the usage of mutable values as argument default (#36626)
     add b5f4783407 Add more labels to Airflow project (#36632)
     add f569d3cb2c Limit to 20 GitHub labels for the repo (#36633)
     add 535c8be599 Redirect to index when user does not have permission to access a page (#36623)
     add 1d41fc7ddb Check redshift cluster state before deferring to triggerer (#36416)
     add c5de0db05e Change detection mechanism for Breeze self-upgrade (#36635)
     add 4469baad4e Add docs on pagerduty connection (#36636)
     add ef1498831a Add section about live-upgrading Airflow (#36637)
     add 19ebcac239 Prepare docs 1st wave of Providers January 2024 (#36640)
     add 75bc05ce1f Upgrade to latest versions of `pip` and `pipx` in CI runners (#36646)
     add f7b663d9af Run mypy checks for full packages in CI (#36638)
     add 9a20aa8f0f Add Airflow logo to the README (#36645)
     add 89f1737afb Make `graphviz` dependency optional (#36647)
     add 579c4b5c59 Remove build errors output from spellcheck-only output (#36648)
     add 11c46fd2ec Upgrade to latest ruff and remove ISC001 warning from output (#36649)
     add a039cfb365 Add Github social media preview image (#36653)
     add da7de797a6 Allow custom columns in cli dags list (#35250)
     add a3ebc4d5bb In docs use logical_date instead of deprecated execution_date (#36654)
     add 98f5ce269a Fix the type hint for tis_query in _process_executor_events (#36655)
     add 3dc99d8a28 feat: Add openlineage support for CopyFromExternalStageToSnowflakeOperator (#36535)
     add ded01a5aba Bump min version for grpcio-status in spark provider (#36662)
     add 90fb783953 Update EMR index.rst (#36665)
     add 43afb2f6b8 Implement `is_authorized_dag` in AWS auth manager (#36619)
     add 298c37d355 Bump min version of amazon-provider related dependencies (#36660)
     add 9797f9278a Bump Cohere min version to limit backtracking on upgrade (#36666)
     add 7cb954fb5d Fix reference to MANAGING_PROVIDERS_LIFECYCLE.rst (#36667)
     add c29632aab4 Bump min version of mysql-connector-python (#36668)
     add 4d5e05b28b Add deferrable mode to RedshiftClusterSensor (#36550)
     add b5c6aead44 Bump min provider version for papermill (#36669)
     add 1f6d764334 Bump min telegram-bot version (#36670)
     add 9264a4b4e2 Add version check for k8s setup venv command (#36673)
     add 8e8c080050 Provide the logger_name param to base hook in order to override the logger name (#36674)
     add 584087f087 Add templated fields to `BigQueryToSqlBaseOperator` from `BigQueryToPostgresOperator` (#36663)
     add a818a8cf3a Include Restb.ai in INTHEWILD.md (#36676)
     add 95a83102e8 feat: Add dag_id when generating OpenLineage run_id for task instance. (#36659)
     add 0bde945930 Add support of Pendulum 3
     add 13bf620ce6 Add backcompat to pendulum 2
     add e6e1b78b94 Update airflow/serialization/serialized_objects.py
     add 669d9e1e7b Add newsfragments

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (e623348429)
            \
             N -- N -- N   refs/heads/pendulum-3 (669d9e1e7b)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .asf.yaml                                          |    42 +-
 .github/boring-cyborg.yml                          |    16 +-
 .github/workflows/ci.yml                           |   136 +-
 .github/workflows/recheck-old-bug-report.yml       |     8 +-
 .github/workflows/stale.yml                        |     2 +-
 .pre-commit-config.yaml                            |    53 +-
 BREEZE.rst                                         |     7 +-
 CONTRIBUTING.rst                                   |   262 +-
 Dockerfile                                         |     4 +-
 Dockerfile.ci                                      |     7 +-
 INSTALL                                            |    14 +-
 INTHEWILD.md                                       |     1 +
 PROVIDERS.rst                                      |     4 +-
 README.md                                          |    28 +-
 STATIC_CODE_CHECKS.rst                             |    38 +-
 TESTING.rst                                        |    47 +-
 airflow/cli/cli_config.py                          |    15 +-
 airflow/cli/commands/dag_command.py                |    32 +-
 airflow/cli/commands/db_command.py                 |     7 -
 airflow/cli/commands/provider_command.py           |    15 +-
 airflow/config_templates/config.yml                |    32 +
 airflow/contrib/hooks/__init__.py                  |     3 -
 airflow/contrib/operators/__init__.py              |   192 +-
 airflow/contrib/secrets/__init__.py                |     2 +-
 airflow/contrib/sensors/__init__.py                |    10 +-
 airflow/contrib/utils/__init__.py                  |     4 +-
 airflow/decorators/__init__.pyi                    |    20 +-
 airflow/hooks/filesystem.py                        |     4 +-
 airflow/hooks/package_index.py                     |     4 +-
 airflow/hooks/subprocess.py                        |     4 +-
 airflow/io/path.py                                 |    11 +-
 airflow/io/store/__init__.py                       |    30 +-
 airflow/jobs/backfill_job_runner.py                |    34 +-
 airflow/jobs/scheduler_job_runner.py               |     8 +-
 airflow/models/base.py                             |    13 +-
 airflow/models/dag.py                              |    10 +-
 airflow/models/dagrun.py                           |     7 +-
 airflow/models/dataset.py                          |     6 +-
 airflow/models/renderedtifields.py                 |     5 +-
 airflow/models/serialized_dag.py                   |     3 -
 airflow/models/taskfail.py                         |     4 +-
 airflow/models/taskinstance.py                     |    58 +-
 airflow/models/taskmap.py                          |     4 +-
 airflow/models/taskreschedule.py                   |    21 +-
 airflow/models/xcom.py                             |     8 +-
 airflow/operators/latest_only.py                   |     2 +-
 airflow/provider.yaml.schema.json                  |    29 +-
 airflow/provider_info.schema.json                  |     7 +
 airflow/providers/MANAGING_PROVIDERS_LIFECYCLE.rst |    90 +-
 .../providers/airbyte/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/airbyte/provider.yaml            |     2 +-
 .../providers/alibaba/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/alibaba/CHANGELOG.rst            |    12 +
 airflow/providers/alibaba/__init__.py              |     2 +-
 airflow/providers/alibaba/provider.yaml            |     5 +-
 airflow/providers/amazon/CHANGELOG.rst             |    51 +
 airflow/providers/amazon/__init__.py               |     2 +-
 .../amazon/aws/auth_manager/avp/entities.py        |     1 +
 .../amazon/aws/auth_manager/avp/facade.py          |    53 +-
 .../amazon/aws/auth_manager/aws_auth_manager.py    |    18 +-
 .../providers/amazon/aws/auth_manager/constants.py |     1 +
 airflow/providers/amazon/aws/hooks/redshift_sql.py |    61 +
 airflow/providers/amazon/aws/hooks/s3.py           |     4 +-
 .../__init__.py => amazon/aws/links/athena.py}     |    14 +
 .../providers/amazon/aws/links/step_function.py    |    52 +
 airflow/providers/amazon/aws/operators/athena.py   |     9 +
 airflow/providers/amazon/aws/operators/datasync.py |     8 +-
 .../amazon/aws/operators/redshift_cluster.py       |   129 +-
 .../providers/amazon/aws/operators/sagemaker.py    |     4 +-
 airflow/providers/amazon/aws/operators/sns.py      |    31 +-
 airflow/providers/amazon/aws/operators/sqs.py      |    25 +-
 .../amazon/aws/operators/step_function.py          |    93 +-
 .../amazon/aws/sensors/lambda_function.py          |     4 +-
 .../amazon/aws/sensors/redshift_cluster.py         |    44 +-
 airflow/providers/amazon/aws/sensors/sqs.py        |    34 +-
 .../providers/amazon/aws/sensors/step_function.py  |    36 +-
 airflow/providers/amazon/aws/transfers/base.py     |     9 +-
 .../amazon/aws/transfers/dynamodb_to_s3.py         |     3 +-
 .../amazon/aws/transfers/redshift_to_s3.py         |     4 +-
 .../amazon/aws/transfers/s3_to_redshift.py         |     4 +-
 .../amazon/aws/triggers/redshift_cluster.py        |    56 +-
 airflow/providers/amazon/aws/triggers/sqs.py       |    21 +-
 .../providers/amazon/aws/triggers/step_function.py |     9 +-
 airflow/providers/amazon/provider.yaml             |    34 +-
 .../apache/beam/.latest-doc-only-change.txt        |     2 +-
 airflow/providers/apache/beam/provider.yaml        |     2 +-
 .../apache/cassandra/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/apache/cassandra/provider.yaml   |     2 +-
 .../apache/drill/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/drill/provider.yaml       |     2 +-
 .../apache/druid/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/druid/hooks/druid.py      |     4 +-
 airflow/providers/apache/druid/provider.yaml       |     2 +-
 .../apache/flink/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/flink/provider.yaml       |     2 +-
 .../apache/hdfs/.latest-doc-only-change.txt        |     2 +-
 airflow/providers/apache/hdfs/CHANGELOG.rst        |    12 +
 airflow/providers/apache/hdfs/__init__.py          |     2 +-
 airflow/providers/apache/hdfs/provider.yaml        |     5 +-
 airflow/providers/apache/hive/CHANGELOG.rst        |    12 +
 airflow/providers/apache/hive/__init__.py          |     2 +-
 airflow/providers/apache/hive/provider.yaml        |     5 +-
 .../apache/hive/transfers/hive_to_samba.py         |     3 +-
 .../apache/impala/.latest-doc-only-change.txt      |     2 +-
 airflow/providers/apache/impala/provider.yaml      |     2 +-
 .../apache/kafka/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/kafka/provider.yaml       |     2 +-
 .../apache/kylin/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/kylin/CHANGELOG.rst       |    12 +
 airflow/providers/apache/kylin/__init__.py         |     2 +-
 airflow/providers/apache/kylin/provider.yaml       |     5 +-
 .../apache/livy/.latest-doc-only-change.txt        |     2 +-
 airflow/providers/apache/livy/CHANGELOG.rst        |    14 +
 airflow/providers/apache/livy/__init__.py          |     2 +-
 airflow/providers/apache/livy/operators/livy.py    |     3 -
 airflow/providers/apache/livy/provider.yaml        |     5 +-
 .../apache/pig/.latest-doc-only-change.txt         |     2 +-
 airflow/providers/apache/pig/provider.yaml         |     2 +-
 .../apache/pinot/.latest-doc-only-change.txt       |     2 +-
 airflow/providers/apache/pinot/provider.yaml       |     2 +-
 airflow/providers/apache/spark/CHANGELOG.rst       |     9 +
 airflow/providers/apache/spark/__init__.py         |     2 +-
 airflow/providers/apache/spark/hooks/spark_jdbc.py |     2 +-
 airflow/providers/apache/spark/hooks/spark_sql.py  |    25 +
 .../providers/apache/spark/hooks/spark_submit.py   |    45 +-
 .../providers/apache/spark/operators/spark_jdbc.py |     2 +-
 .../apache/spark/operators/spark_submit.py         |     2 +-
 airflow/providers/apache/spark/provider.yaml       |     7 +-
 .../apache/sqoop/.latest-doc-only-change.txt       |     1 -
 airflow/providers/apache/sqoop/CHANGELOG.rst       |   300 -
 airflow/providers/apache/sqoop/__init__.py         |    42 -
 airflow/providers/apache/sqoop/hooks/sqoop.py      |   411 -
 airflow/providers/apache/sqoop/operators/sqoop.py  |   264 -
 airflow/providers/apache/sqoop/provider.yaml       |    71 -
 .../providers/apprise/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/apprise/provider.yaml            |     2 +-
 .../providers/arangodb/.latest-doc-only-change.txt |     2 +-
 airflow/providers/arangodb/provider.yaml           |     2 +-
 .../providers/asana/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/asana/provider.yaml              |     2 +-
 .../atlassian/jira/.latest-doc-only-change.txt     |     2 +-
 airflow/providers/atlassian/jira/CHANGELOG.rst     |    14 +
 airflow/providers/atlassian/jira/__init__.py       |     2 +-
 airflow/providers/atlassian/jira/hooks/jira.py     |    34 +-
 airflow/providers/atlassian/jira/provider.yaml     |     5 +-
 .../providers/celery/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/celery/provider.yaml             |     2 +-
 .../providers/cloudant/.latest-doc-only-change.txt |     2 +-
 airflow/providers/cloudant/provider.yaml           |     2 +-
 .../cncf/kubernetes/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/cncf/kubernetes/CHANGELOG.rst    |    20 +
 airflow/providers/cncf/kubernetes/__init__.py      |     2 +-
 airflow/providers/cncf/kubernetes/operators/pod.py |     2 +-
 airflow/providers/cncf/kubernetes/provider.yaml    |     5 +-
 .../providers/cohere/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/cohere/provider.yaml             |     4 +-
 .../common/io/.latest-doc-only-change.txt          |     2 +-
 airflow/providers/common/io/CHANGELOG.rst          |    16 +
 airflow/providers/common/io/__init__.py            |     2 +-
 .../providers/common/io/operators/file_transfer.py |    37 +-
 airflow/providers/common/io/provider.yaml          |     5 +-
 .../common/sql/.latest-doc-only-change.txt         |     2 +-
 airflow/providers/common/sql/provider.yaml         |     2 +-
 .../databricks/.latest-doc-only-change.txt         |     2 +-
 .../providers/databricks/hooks/databricks_sql.py   |     4 +-
 airflow/providers/databricks/provider.yaml         |     2 +-
 .../providers/datadog/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/datadog/provider.yaml            |     2 +-
 .../dbt/cloud/.latest-doc-only-change.txt          |     2 +-
 airflow/providers/dbt/cloud/provider.yaml          |     2 +-
 airflow/providers/dbt/cloud/utils/openlineage.py   |     5 +-
 .../providers/dingding/.latest-doc-only-change.txt |     2 +-
 airflow/providers/dingding/provider.yaml           |     2 +-
 .../providers/discord/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/discord/provider.yaml            |     2 +-
 .../providers/docker/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/docker/provider.yaml             |     2 +-
 .../elasticsearch/.latest-doc-only-change.txt      |     2 +-
 airflow/providers/elasticsearch/CHANGELOG.rst      |    12 +
 airflow/providers/elasticsearch/__init__.py        |     2 +-
 airflow/providers/elasticsearch/provider.yaml      |     5 +-
 .../providers/exasol/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/exasol/hooks/exasol.py           |     6 +-
 airflow/providers/exasol/provider.yaml             |     2 +-
 .../fab/auth_manager/cli_commands/role_command.py  |    64 +-
 .../providers/fab/auth_manager/fab_auth_manager.py |    19 +-
 .../fab/auth_manager/security_manager/override.py  |     2 +
 airflow/providers/fab/provider.yaml                |    34 +-
 .../providers/facebook/.latest-doc-only-change.txt |     2 +-
 airflow/providers/facebook/provider.yaml           |     2 +-
 airflow/providers/ftp/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/ftp/provider.yaml                |     2 +-
 .../providers/github/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/github/provider.yaml             |     2 +-
 airflow/providers/google/CHANGELOG.rst             |    16 +
 airflow/providers/google/__init__.py               |     2 +-
 airflow/providers/google/cloud/hooks/cloud_run.py  |     2 +-
 airflow/providers/google/cloud/hooks/dataform.py   |    63 +-
 .../google/cloud/log/stackdriver_task_handler.py   |    10 +-
 .../providers/google/cloud/operators/bigquery.py   |     2 +-
 .../providers/google/cloud/operators/dataform.py   |    84 +
 .../providers/google/cloud/operators/dataproc.py   |    96 +-
 .../google/cloud/secrets/secret_manager.py         |     6 -
 .../google/cloud/transfers/bigquery_to_postgres.py |     4 -
 .../google/cloud/transfers/bigquery_to_sql.py      |     6 +
 .../google/cloud/transfers/gcs_to_bigquery.py      |     1 +
 .../providers/google/cloud/triggers/cloud_run.py   |     2 +-
 .../google/cloud/utils/bigquery_get_data.py        |     4 +-
 .../google/cloud/utils/credentials_provider.py     |     2 +-
 .../providers/google/common/hooks/base_google.py   |     2 +-
 .../google/common/utils/id_token_credentials.py    |     4 +-
 .../google/marketing_platform/hooks/analytics.py   |     9 +
 .../marketing_platform/hooks/analytics_admin.py    |   234 +
 .../google/marketing_platform/links}/__init__.py   |     0
 .../marketing_platform/links/analytics_admin.py    |    65 +
 .../marketing_platform/operators/analytics.py      |    53 +
 .../operators/analytics_admin.py                   |   579 +
 airflow/providers/google/provider.yaml             |    19 +-
 airflow/providers/grpc/.latest-doc-only-change.txt |     2 +-
 airflow/providers/grpc/hooks/grpc.py               |     2 +-
 airflow/providers/grpc/provider.yaml               |     2 +-
 .../hashicorp/.latest-doc-only-change.txt          |     2 +-
 airflow/providers/hashicorp/provider.yaml          |     2 +-
 airflow/providers/http/.latest-doc-only-change.txt |     2 +-
 airflow/providers/http/provider.yaml               |     2 +-
 airflow/providers/imap/.latest-doc-only-change.txt |     2 +-
 airflow/providers/imap/provider.yaml               |     2 +-
 .../providers/influxdb/.latest-doc-only-change.txt |     2 +-
 airflow/providers/influxdb/provider.yaml           |     2 +-
 airflow/providers/jdbc/.latest-doc-only-change.txt |     2 +-
 airflow/providers/jdbc/provider.yaml               |     2 +-
 .../providers/jenkins/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/jenkins/provider.yaml            |     2 +-
 .../microsoft/azure/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/microsoft/azure/CHANGELOG.rst    |    12 +
 airflow/providers/microsoft/azure/__init__.py      |     2 +-
 airflow/providers/microsoft/azure/provider.yaml    |     5 +-
 .../providers/microsoft/azure/secrets/key_vault.py |     6 -
 .../microsoft/mssql/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/microsoft/mssql/provider.yaml    |     2 +-
 .../microsoft/psrp/.latest-doc-only-change.txt     |     2 +-
 airflow/providers/microsoft/psrp/provider.yaml     |     2 +-
 .../microsoft/winrm/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/microsoft/winrm/provider.yaml    |     2 +-
 .../providers/mongo/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/mongo/provider.yaml              |     2 +-
 .../providers/mysql/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/mysql/CHANGELOG.rst              |    14 +
 airflow/providers/mysql/__init__.py                |     2 +-
 airflow/providers/mysql/hooks/mysql.py             |    20 +-
 airflow/providers/mysql/provider.yaml              |     7 +-
 .../providers/neo4j/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/neo4j/provider.yaml              |     2 +-
 airflow/providers/odbc/.latest-doc-only-change.txt |     2 +-
 airflow/providers/odbc/provider.yaml               |     2 +-
 .../providers/openai/.latest-doc-only-change.txt   |     1 +
 airflow/providers/openai/provider.yaml             |     2 +-
 .../providers/openfaas/.latest-doc-only-change.txt |     2 +-
 airflow/providers/openfaas/provider.yaml           |     2 +-
 airflow/providers/openlineage/CHANGELOG.rst        |    12 +
 airflow/providers/openlineage/__init__.py          |     2 +-
 airflow/providers/openlineage/plugins/adapter.py   |     4 +-
 airflow/providers/openlineage/plugins/listener.py  |    27 +-
 airflow/providers/openlineage/plugins/macros.py    |    10 +-
 airflow/providers/openlineage/provider.yaml        |     5 +-
 airflow/providers/openlineage/sqlparser.py         |    13 +-
 airflow/providers/openlineage/utils/sql.py         |    97 +-
 .../opensearch/.latest-doc-only-change.txt         |     2 +-
 airflow/providers/opensearch/provider.yaml         |     2 +-
 .../providers/opsgenie/.latest-doc-only-change.txt |     2 +-
 airflow/providers/opsgenie/CHANGELOG.rst           |    15 +
 airflow/providers/opsgenie/__init__.py             |     2 +-
 airflow/providers/opsgenie/hooks/opsgenie.py       |    10 +
 airflow/providers/opsgenie/provider.yaml           |     5 +-
 .../providers/oracle/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/oracle/provider.yaml             |     2 +-
 airflow/providers/pagerduty/CHANGELOG.rst          |    12 +
 airflow/providers/pagerduty/__init__.py            |     2 +-
 airflow/providers/pagerduty/hooks/pagerduty.py     |    19 +-
 airflow/providers/pagerduty/provider.yaml          |     5 +-
 .../papermill/.latest-doc-only-change.txt          |     2 +-
 airflow/providers/papermill/provider.yaml          |     4 +-
 .../providers/pgvector/.latest-doc-only-change.txt |     2 +-
 airflow/providers/pgvector/provider.yaml           |     2 +-
 .../providers/pinecone/.latest-doc-only-change.txt |     2 +-
 airflow/providers/pinecone/provider.yaml           |     2 +-
 .../providers/plexus/.latest-doc-only-change.txt   |     1 -
 airflow/providers/plexus/CHANGELOG.rst             |   256 -
 airflow/providers/plexus/__init__.py               |    42 -
 airflow/providers/plexus/hooks/plexus.py           |    77 -
 airflow/providers/plexus/operators/__init__.py     |    16 -
 airflow/providers/plexus/operators/job.py          |   156 -
 airflow/providers/plexus/provider.yaml             |    61 -
 .../providers/postgres/.latest-doc-only-change.txt |     2 +-
 airflow/providers/postgres/hooks/postgres.py       |     4 +-
 airflow/providers/postgres/provider.yaml           |     2 +-
 .../providers/presto/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/presto/provider.yaml             |     2 +-
 .../providers/redis/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/redis/CHANGELOG.rst              |    20 +
 airflow/providers/redis/__init__.py                |     2 +-
 airflow/providers/redis/hooks/redis.py             |    77 +-
 airflow/providers/redis/provider.yaml              |     5 +-
 .../salesforce/.latest-doc-only-change.txt         |     2 +-
 airflow/providers/salesforce/provider.yaml         |     2 +-
 .../providers/samba/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/samba/CHANGELOG.rst              |    14 +
 airflow/providers/samba/__init__.py                |     2 +-
 airflow/providers/samba/hooks/samba.py             |    10 +-
 airflow/providers/samba/provider.yaml              |     5 +-
 .../providers/segment/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/segment/provider.yaml            |     2 +-
 .../providers/sendgrid/.latest-doc-only-change.txt |     2 +-
 airflow/providers/sendgrid/provider.yaml           |     2 +-
 airflow/providers/sftp/.latest-doc-only-change.txt |     2 +-
 airflow/providers/sftp/provider.yaml               |     2 +-
 .../singularity/.latest-doc-only-change.txt        |     2 +-
 airflow/providers/singularity/provider.yaml        |     2 +-
 .../providers/slack/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/slack/provider.yaml              |     2 +-
 airflow/providers/smtp/.latest-doc-only-change.txt |     2 +-
 airflow/providers/smtp/provider.yaml               |     2 +-
 .../snowflake/.latest-doc-only-change.txt          |     2 +-
 airflow/providers/snowflake/hooks/snowflake.py     |     6 +-
 airflow/providers/snowflake/provider.yaml          |     2 +-
 .../snowflake/transfers/copy_into_snowflake.py     |   163 +-
 .../providers/sqlite/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/sqlite/provider.yaml             |     2 +-
 airflow/providers/ssh/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/ssh/provider.yaml                |     2 +-
 .../providers/tableau/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/tableau/provider.yaml            |     2 +-
 .../providers/tabular/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/tabular/provider.yaml            |     2 +-
 .../providers/telegram/.latest-doc-only-change.txt |     2 +-
 airflow/providers/telegram/provider.yaml           |     4 +-
 .../providers/trino/.latest-doc-only-change.txt    |     2 +-
 airflow/providers/trino/operators/trino.py         |     8 +-
 airflow/providers/trino/provider.yaml              |     2 +-
 .../providers/vertica/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/vertica/hooks/vertica.py         |     2 +-
 airflow/providers/vertica/provider.yaml            |     2 +-
 .../providers/weaviate/.latest-doc-only-change.txt |     2 +-
 airflow/providers/weaviate/CHANGELOG.rst           |    23 +
 airflow/providers/weaviate/__init__.py             |     2 +-
 airflow/providers/weaviate/hooks/weaviate.py       |    12 +-
 airflow/providers/weaviate/provider.yaml           |     5 +-
 .../providers/yandex/.latest-doc-only-change.txt   |     2 +-
 airflow/providers/yandex/provider.yaml             |     2 +-
 .../providers/zendesk/.latest-doc-only-change.txt  |     2 +-
 airflow/providers/zendesk/CHANGELOG.rst            |    12 +
 airflow/providers/zendesk/__init__.py              |     2 +-
 airflow/providers/zendesk/provider.yaml            |     5 +-
 airflow/providers_manager.py                       |    31 +-
 airflow/sensors/base.py                            |     4 +-
 airflow/settings.py                                |    29 +-
 airflow/utils/cli_action_loggers.py                |     1 -
 airflow/utils/db.py                                |    34 +-
 airflow/utils/db_cleanup.py                        |     5 -
 airflow/utils/dot_renderer.py                      |    15 +-
 airflow/utils/event_scheduler.py                   |     4 +-
 airflow/utils/operator_helpers.py                  |     2 +-
 airflow/utils/sqlalchemy.py                        |    62 +-
 airflow/utils/task_group.py                        |    13 +-
 airflow/www/app.py                                 |     2 +
 airflow/www/auth.py                                |     6 +-
 airflow/www/extensions/init_appbuilder.py          |    32 +-
 airflow/www/static/js/components/RunTypeIcon.tsx   |    13 +-
 airflow/www/static/js/dag/details/index.tsx        |     2 +-
 airflow/www/templates/airflow/traceback.html       |    17 +-
 airflow/www/views.py                               |    26 +-
 chart/templates/_helpers.yaml                      |    40 +
 chart/values.schema.json                           |    19 +-
 chart/values.yaml                                  |    14 +-
 dev/README_RELEASE_PROVIDER_PACKAGES.md            |   207 +-
 dev/airflow-github                                 |    50 +-
 dev/breeze/README.md                               |     2 +-
 dev/breeze/SELECTIVE_CHECKS.md                     |     3 -
 dev/breeze/pyproject.toml                          |     1 +
 dev/breeze/src/airflow_breeze/breeze.py            |     1 +
 .../src/airflow_breeze/commands/ci_commands.py     |     4 +-
 .../airflow_breeze/commands/ci_image_commands.py   |     2 +-
 .../src/airflow_breeze/commands/common_options.py  |     9 -
 .../airflow_breeze/commands/developer_commands.py  |     7 -
 .../commands/developer_commands_config.py          |     3 -
 .../src/airflow_breeze/commands/main_command.py    |     2 -
 .../commands/production_image_commands.py          |     2 +-
 .../commands/release_management_commands.py        |    55 +-
 .../commands/release_management_commands_config.py |     1 -
 .../src/airflow_breeze/commands/setup_commands.py  |     4 -
 .../commands/setup_commands_config.py              |     1 -
 .../airflow_breeze/commands/testing_commands.py    |     8 -
 .../commands/testing_commands_config.py            |     3 -
 dev/breeze/src/airflow_breeze/global_constants.py  |    13 +-
 .../src/airflow_breeze/params/shell_params.py      |    39 +-
 dev/breeze/src/airflow_breeze/pre_commit_ids.py    |     2 +
 .../prepare_providers/provider_documentation.py    |     6 +-
 .../prepare_providers/provider_packages.py         |    10 +-
 .../provider_issue_TEMPLATE.md.jinja2              |     8 +-
 .../airflow_breeze/utils/docker_command_utils.py   |    24 +-
 .../src/airflow_breeze/utils/kubernetes_utils.py   |    28 +-
 dev/breeze/src/airflow_breeze/utils/packages.py    |    57 +-
 dev/breeze/src/airflow_breeze/utils/path_utils.py  |    26 +-
 .../src/airflow_breeze/utils/selective_checks.py   |    89 +-
 dev/breeze/src/airflow_breeze/utils/visuals.py     |     4 -
 dev/breeze/tests/test_cache.py                     |     4 +-
 dev/breeze/tests/test_find_airflow_directory.py    |     2 +-
 dev/breeze/tests/test_packages.py                  |     8 +-
 dev/breeze/tests/test_selective_checks.py          |   238 +-
 docs/apache-airflow-providers-alibaba/commits.rst  |    15 +-
 docs/apache-airflow-providers-alibaba/index.rst    |     2 +-
 docs/apache-airflow-providers-amazon/commits.rst   |    45 +-
 docs/apache-airflow-providers-amazon/index.rst     |     6 +-
 .../operators/emr/index.rst                        |     7 +
 .../operators/redshift/redshift_sql.rst            |     2 +-
 .../operators/sns.rst                              |     5 +
 .../operators/sqs.rst                              |     5 +
 .../operators/step_functions.rst                   |     5 +
 .../commits.rst                                    |    22 +-
 .../apache-airflow-providers-apache-hdfs/index.rst |     2 +-
 .../commits.rst                                    |    22 +-
 .../apache-airflow-providers-apache-hive/index.rst |     6 +-
 .../commits.rst                                    |    15 +-
 .../index.rst                                      |     2 +-
 .../commits.rst                                    |    17 +-
 .../apache-airflow-providers-apache-livy/index.rst |     6 +-
 .../commits.rst                                    |    22 +-
 .../connections/index.rst}                         |    12 +-
 .../connections/{spark.rst => spark-connect.rst}   |    32 +-
 .../connections/spark-sql.rst                      |    48 +
 .../connections/{spark.rst => spark-submit.rst}    |    31 +-
 .../index.rst                                      |     8 +-
 .../operators.rst                                  |     4 +-
 .../commits.rst                                    |   343 -
 .../index.rst                                      |    97 -
 .../security.rst                                   |    18 -
 .../commits.rst                                    |    17 +-
 .../connections.rst}                               |    36 +-
 .../index.rst                                      |     3 +-
 .../commits.rst                                    |    26 +-
 .../index.rst                                      |     2 +-
 .../apache-airflow-providers-common-io/commits.rst |    19 +-
 docs/apache-airflow-providers-common-io/index.rst  |    30 +-
 .../commits.rst                                    |    15 +-
 .../index.rst                                      |     6 +-
 .../configurations-ref.rst                         |     0
 docs/apache-airflow-providers-fab/index.rst        |     1 +
 docs/apache-airflow-providers-google/commits.rst   |    20 +-
 docs/apache-airflow-providers-google/index.rst     |     6 +-
 .../operators/cloud/dataform.rst                   |    13 +
 .../operators/marketing_platform/analytics.rst     |     5 +
 .../marketing_platform/analytics_admin.rst         |   151 +
 .../secrets-backends/hashicorp-vault.rst           |     4 +-
 .../commits.rst                                    |    22 +-
 .../index.rst                                      |     6 +-
 .../operators/azure_synapse.rst                    |    11 +
 docs/apache-airflow-providers-mysql/commits.rst    |    17 +-
 docs/apache-airflow-providers-mysql/index.rst      |     6 +-
 .../commits.rst                                    |    22 +-
 .../apache-airflow-providers-openlineage/index.rst |     7 +-
 .../supported_classes.rst}                         |    15 +-
 docs/apache-airflow-providers-opsgenie/commits.rst |    17 +-
 .../connections.rst}                               |    22 +-
 docs/apache-airflow-providers-opsgenie/index.rst   |     3 +-
 .../apache-airflow-providers-pagerduty/commits.rst |    22 +-
 .../connections/index.rst}                         |    12 +-
 .../connections/pagerdurty.rst}                    |    27 +-
 .../connections/pagerduty-events.rst}              |    21 +-
 docs/apache-airflow-providers-pagerduty/index.rst  |     3 +-
 docs/apache-airflow-providers-plexus/commits.rst   |   282 -
 docs/apache-airflow-providers-plexus/index.rst     |   105 -
 docs/apache-airflow-providers-plexus/security.rst  |    18 -
 docs/apache-airflow-providers-redis/commits.rst    |    19 +-
 .../apache-airflow-providers-redis/connections.rst |    64 +
 docs/apache-airflow-providers-redis/index.rst      |     3 +-
 docs/apache-airflow-providers-samba/commits.rst    |    17 +-
 .../connections.rst}                               |    36 +-
 docs/apache-airflow-providers-samba/index.rst      |     7 +-
 docs/apache-airflow-providers-weaviate/commits.rst |    21 +-
 docs/apache-airflow-providers-weaviate/index.rst   |     2 +-
 docs/apache-airflow-providers-zendesk/commits.rst  |    15 +-
 docs/apache-airflow-providers-zendesk/index.rst    |     2 +-
 .../logging-monitoring/metrics.rst                 |     2 +
 .../production-deployment.rst                      |    68 +-
 .../administration-and-deployment/scheduler.rst    |     3 +-
 .../dynamic-task-mapping.rst                       |    44 +-
 docs/apache-airflow/best-practices.rst             |    74 +-
 docs/apache-airflow/core-concepts/dags.rst         |     5 +-
 .../apache-airflow/core-concepts/objectstorage.rst |     8 +-
 docs/apache-airflow/core-concepts/overview.rst     |   159 +-
 docs/apache-airflow/core-concepts/tasks.rst        |     4 +-
 docs/apache-airflow/extra-packages-ref.rst         |     2 +
 docs/apache-airflow/howto/set-up-database.rst      |   139 +-
 .../img/diagram_basic_airflow_architecture.md5sum  |     2 +-
 .../img/diagram_basic_airflow_architecture.png     |   Bin 87096 -> 117106 bytes
 .../img/diagram_basic_airflow_architecture.py      |    64 +-
 ...agram_dag_processor_airflow_architecture.md5sum |     2 +-
 .../diagram_dag_processor_airflow_architecture.png |   Bin 106642 -> 238002 bytes
 .../diagram_dag_processor_airflow_architecture.py  |    56 +-
 ...diagram_distributed_airflow_architecture.md5sum |     1 +
 .../diagram_distributed_airflow_architecture.png   |   Bin 0 -> 192331 bytes
 ...=> diagram_distributed_airflow_architecture.py} |    71 +-
 .../img/logos/github_repository_social_image.png   |   Bin 0 -> 58203 bytes
 docs/apache-airflow/installation/dependencies.rst  |    46 +-
 docs/apache-airflow/installation/prerequisites.rst |     6 +-
 docs/apache-airflow/installation/upgrading.rst     |     2 +-
 docs/apache-airflow/static/gh-jira-links.js        |     6 +-
 docs/apache-airflow/templates-ref.rst              |    14 +-
 docs/build_docs.py                                 |   219 +-
 docs/conf.py                                       |     1 +
 docs/diagrams/database.png                         |   Bin 0 -> 41772 bytes
 docs/diagrams/multiple_files.png                   |   Bin 0 -> 69430 bytes
 docs/diagrams/packages.png                         |   Bin 0 -> 205387 bytes
 docs/docker-stack/build-arg-ref.rst                |     1 +
 docs/exts/docs_build/package_filter.py             |     2 +-
 docs/exts/operators_and_hooks_ref.py               |     8 +-
 docs/exts/provider_yaml_utils.py                   |     2 +-
 docs/exts/providers_extensions.py                  |   188 +
 .../templates/deferrable_operators_list.rst.jinja2 |     7 +-
 docs/exts/templates/openlineage.rst.jinja2         |    51 +
 docs/integration-logos/apache/sqoop.png            |   Bin 42874 -> 0 bytes
 docs/integration-logos/plexus/Plexus.png           |   Bin 3881 -> 0 bytes
 docs/spelling_wordlist.txt                         |     1 +
 generated/PYPI_README.md                           |    26 +-
 generated/provider_dependencies.json               |   282 +-
 generated/provider_metadata.json                   |   540 +-
 helm_tests/airflow_aux/test_pod_template_file.py   |    33 +-
 helm_tests/airflow_core/test_worker.py             |    23 +-
 helm_tests/other/test_git_sync_scheduler.py        |    89 +
 images/breeze/output-commands.svg                  |   100 +-
 images/breeze/output_build-docs.svg                |    68 +-
 images/breeze/output_build-docs.txt                |     2 +-
 images/breeze/output_k8s_configure-cluster.svg     |     4 +-
 images/breeze/output_k8s_configure-cluster.txt     |     2 +-
 images/breeze/output_k8s_create-cluster.svg        |     4 +-
 images/breeze/output_k8s_create-cluster.txt        |     2 +-
 images/breeze/output_k8s_delete-cluster.svg        |     2 +-
 images/breeze/output_k8s_delete-cluster.txt        |     2 +-
 images/breeze/output_k8s_deploy-airflow.svg        |     4 +-
 images/breeze/output_k8s_deploy-airflow.txt        |     2 +-
 images/breeze/output_k8s_k9s.svg                   |     2 +-
 images/breeze/output_k8s_k9s.txt                   |     2 +-
 images/breeze/output_k8s_logs.svg                  |     2 +-
 images/breeze/output_k8s_logs.txt                  |     2 +-
 images/breeze/output_k8s_run-complete-tests.svg    |     4 +-
 images/breeze/output_k8s_run-complete-tests.txt    |     2 +-
 images/breeze/output_k8s_shell.svg                 |     2 +-
 images/breeze/output_k8s_shell.txt                 |     2 +-
 images/breeze/output_k8s_status.svg                |     2 +-
 images/breeze/output_k8s_status.txt                |     2 +-
 images/breeze/output_k8s_tests.svg                 |     4 +-
 images/breeze/output_k8s_tests.txt                 |     2 +-
 images/breeze/output_k8s_upload-k8s-image.svg      |     4 +-
 images/breeze/output_k8s_upload-k8s-image.txt      |     2 +-
 images/breeze/output_prod-image_build.txt          |     2 +-
 ...tput_release-management_add-back-references.svg |    16 +-
 ...tput_release-management_add-back-references.txt |     2 +-
 ...put_release-management_generate-constraints.svg |     6 +-
 ...management_generate-issue-content-providers.svg |    18 +-
 ...management_generate-issue-content-providers.txt |     2 +-
 .../output_release-management_publish-docs.svg     |    16 +-
 .../output_release-management_publish-docs.txt     |     2 +-
 images/breeze/output_setup_config.svg              |    26 +-
 images/breeze/output_setup_config.txt              |     2 +-
 images/breeze/output_shell.svg                     |   170 +-
 images/breeze/output_shell.txt                     |     2 +-
 images/breeze/output_start-airflow.svg             |   152 +-
 images/breeze/output_start-airflow.txt             |     2 +-
 images/breeze/output_static-checks.svg             |   134 +-
 images/breeze/output_static-checks.txt             |     2 +-
 images/breeze/output_testing_db-tests.svg          |    82 +-
 images/breeze/output_testing_db-tests.txt          |     2 +-
 images/breeze/output_testing_integration-tests.svg |    44 +-
 images/breeze/output_testing_integration-tests.txt |     2 +-
 images/breeze/output_testing_tests.svg             |    86 +-
 images/breeze/output_testing_tests.txt             |     2 +-
 kubernetes_tests/test_kubernetes_pod_operator.py   |     7 +-
 newsfragments/36281.significant.rst                |     4 +
 newsfragments/36514.significant.rst                |    13 +
 newsfragments/36647.significant.rst                |    23 +
 pyproject.toml                                     |     4 +-
 .../docker-compose/backend-mssql-docker-volume.yml |    26 -
 scripts/ci/docker-compose/backend-mssql-port.yml   |    21 -
 .../docker-compose/backend-mssql-tmpfs-volume.yml  |    30 -
 scripts/ci/docker-compose/backend-mssql.yml        |    58 -
 .../ci/docker-compose/integration-cassandra.yml    |     3 +
 scripts/ci/docker-compose/integration-celery.yml   |     3 +
 scripts/ci/docker-compose/integration-kafka.yml    |     3 +
 scripts/ci/docker-compose/integration-kerberos.yml |     3 +
 scripts/ci/docker-compose/integration-mongo.yml    |     3 +
 .../ci/docker-compose/integration-openlineage.yml  |     4 +-
 scripts/ci/docker-compose/integration-otel.yml     |     3 +
 scripts/ci/docker-compose/integration-pinot.yml    |     3 +
 scripts/ci/docker-compose/integration-statsd.yml   |     3 +
 scripts/ci/docker-compose/integration-trino.yml    |     3 +
 .../ci/docker-compose/mssql_create_airflow_db.sql  |    21 -
 scripts/ci/install_breeze.sh                       |     5 +-
 scripts/ci/pre_commit/common_precommit_utils.py    |    28 +-
 .../pre_commit_check_integrations_list.py          |   202 +
 .../pre_commit/pre_commit_check_provider_docs.py   |     4 +-
 scripts/ci/pre_commit/pre_commit_mypy.py           |    31 +-
 .../ci/pre_commit/pre_commit_ruff_format.py        |    11 +-
 .../pre_commit_update_providers_dependencies.py    |    15 +-
 scripts/docker/install_os_dependencies.sh          |     2 +-
 scripts/in_container/run_generate_constraints.py   |     2 +-
 .../in_container/run_provider_yaml_files_check.py  |    25 +-
 setup.cfg                                          |    16 +-
 setup.py                                           |    15 +-
 tests/always/test_example_dags.py                  |     2 +-
 tests/always/test_project_structure.py             |     2 -
 tests/always/test_providers_manager.py             |     5 +
 .../test_mapped_task_instance_endpoint.py          |     4 +-
 .../api_connexion/endpoints/test_xcom_endpoint.py  |     2 +-
 tests/cli/commands/test_dag_command.py             |    44 +-
 tests/conftest.py                                  |     6 +-
 tests/core/test_sqlalchemy_config.py               |     2 +-
 tests/executors/test_executor_loader.py            |     2 +-
 tests/io/test_path.py                              |    13 +-
 tests/models/test_mappedoperator.py                |    59 +
 tests/models/test_renderedtifields.py              |    20 +-
 tests/models/test_taskinstance.py                  |     9 +-
 .../amazon/aws/auth_manager/avp/test_facade.py     |   103 +-
 .../aws/auth_manager/test_aws_auth_manager.py      |   129 +-
 .../amazon/aws/auth_manager/test_constants.py      |     4 +
 .../amazon/aws/hooks/test_redshift_sql.py          |    44 +
 .../providers/amazon/aws/links/test_athena.py      |    24 +-
 tests/providers/amazon/aws/links/test_batch.py     |     2 +-
 tests/providers/amazon/aws/links/test_emr.py       |     4 +-
 .../amazon/aws/links/test_step_function.py         |    74 +
 .../providers/amazon/aws/operators/test_athena.py  |    25 +-
 .../amazon/aws/operators/test_redshift_cluster.py  |    73 +-
 .../amazon/aws/operators/test_redshift_sql.py      |   241 +
 tests/providers/amazon/aws/operators/test_sns.py   |    67 +-
 tests/providers/amazon/aws/operators/test_sqs.py   |   111 +-
 .../amazon/aws/operators/test_step_function.py     |   179 +-
 .../amazon/aws/sensors/test_redshift_cluster.py    |    58 +
 tests/providers/amazon/aws/sensors/test_sqs.py     |   386 +-
 .../amazon/aws/sensors/test_step_function.py       |   112 +-
 .../amazon/aws/triggers/test_redshift_cluster.py   |   119 +
 tests/providers/amazon/aws/triggers/test_sqs.py    |    45 +-
 tests/providers/apache/sqoop/__init__.py           |    17 -
 tests/providers/apache/sqoop/hooks/__init__.py     |    17 -
 tests/providers/apache/sqoop/hooks/test_sqoop.py   |   406 -
 tests/providers/apache/sqoop/operators/__init__.py |    17 -
 .../providers/apache/sqoop/operators/test_sqoop.py |   189 -
 tests/providers/atlassian/jira/hooks/test_jira.py  |    55 +-
 .../common/io/operators/test_file_transfer.py      |    24 +
 .../auth_manager/cli_commands/test_role_command.py |    66 +-
 .../fab/auth_manager/test_fab_auth_manager.py      |    30 +-
 .../providers/google/cloud/hooks/test_dataform.py  |    66 +-
 .../google/cloud/operators/test_dataform.py        |    28 +
 .../cloud/utils/test_credentials_provider.py       |    40 +-
 .../hooks/test_analytics_admin.py                  |   192 +
 .../google/marketing_platform/links}/__init__.py   |     0
 .../links/test_analytics_admin.py                  |    71 +
 .../operators/test_analytics_admin.py              |   310 +
 tests/providers/mysql/hooks/test_mysql.py          |    33 +-
 .../providers/openlineage/plugins/test_listener.py |    57 +-
 tests/providers/openlineage/plugins/test_macros.py |    52 +
 .../plugins/test_openlineage_adapter.py            |    44 +-
 tests/providers/openlineage/utils/test_sql.py      |    62 +-
 tests/providers/plexus/__init__.py                 |    16 -
 tests/providers/plexus/hooks/__init__.py           |    16 -
 tests/providers/plexus/hooks/test_plexus.py        |    66 -
 tests/providers/plexus/operators/__init__.py       |    16 -
 tests/providers/plexus/operators/test_job.py       |   192 -
 tests/providers/redis/hooks/test_redis.py          |    50 +-
 .../transfers/test_copy_into_snowflake.py          |   168 +-
 tests/providers/weaviate/hooks/test_weaviate.py    |     8 +-
 .../google/cloud/dataform/example_dataform.py      |    14 +
 .../marketing_platform/example_analytics_admin.py  |   203 +
 .../azure/example_synapse_run_pipeline.py          |     4 +-
 .../providers/pgvector/example_pgvector_openai.py  |    96 +
 .../providers/pinecone/example_pinecone_cohere.py  |    78 +
 .../providers/pinecone/example_pinecone_openai.py  |   118 +
 tests/system/providers/plexus/__init__.py          |    16 -
 tests/system/providers/plexus/example_plexus.py    |    56 -
 .../providers/weaviate/example_weaviate_cohere.py  |   122 +
 .../example_weaviate_dynamic_mapping_dag.py        |    97 +
 .../providers/weaviate/example_weaviate_openai.py  |   133 +
 .../weaviate/example_weaviate_operator.py          |   130 +-
 .../weaviate/example_weaviate_using_hook.py        |   156 +
 .../weaviate/example_weaviate_vectorizer_dag.py    |   106 +
 .../example_weaviate_without_vectorizer_dag.py     |   121 +
 .../weaviate/jeopardy_data_with_vectors.json       | 15432 +++++++++++++++++++
 .../weaviate/jeopardy_data_without_vectors.json    |    52 +
 .../jeopardy_doc_data_without_vectors.json         |    62 +
 tests/utils/test_db.py                             |     9 -
 tests/utils/test_task_group.py                     |    47 +
 tests/www/test_auth.py                             |    18 +-
 tests/www/views/conftest.py                        |     2 +-
 tests/www/views/test_views_log.py                  |     2 +-
 tests/www/views/test_views_rate_limit.py           |     4 +-
 tests/www/views/test_views_tasks.py                |     4 +-
 694 files changed, 27613 insertions(+), 7483 deletions(-)
 rename airflow/providers/{plexus/hooks/__init__.py => amazon/aws/links/athena.py} (63%)
 create mode 100644 airflow/providers/amazon/aws/links/step_function.py
 delete mode 100644 airflow/providers/apache/sqoop/.latest-doc-only-change.txt
 delete mode 100644 airflow/providers/apache/sqoop/CHANGELOG.rst
 delete mode 100644 airflow/providers/apache/sqoop/__init__.py
 delete mode 100644 airflow/providers/apache/sqoop/hooks/sqoop.py
 delete mode 100644 airflow/providers/apache/sqoop/operators/sqoop.py
 delete mode 100644 airflow/providers/apache/sqoop/provider.yaml
 create mode 100644 airflow/providers/google/marketing_platform/hooks/analytics_admin.py
 copy airflow/{api_connexion => providers/google/marketing_platform/links}/__init__.py (100%)
 create mode 100644 airflow/providers/google/marketing_platform/links/analytics_admin.py
 create mode 100644 airflow/providers/google/marketing_platform/operators/analytics_admin.py
 create mode 100644 airflow/providers/openai/.latest-doc-only-change.txt
 delete mode 100644 airflow/providers/plexus/.latest-doc-only-change.txt
 delete mode 100644 airflow/providers/plexus/CHANGELOG.rst
 delete mode 100644 airflow/providers/plexus/__init__.py
 delete mode 100644 airflow/providers/plexus/hooks/plexus.py
 delete mode 100644 airflow/providers/plexus/operators/__init__.py
 delete mode 100644 airflow/providers/plexus/operators/job.py
 delete mode 100644 airflow/providers/plexus/provider.yaml
 rename docs/{apache-airflow-providers-plexus/installing-providers-from-sources.rst => apache-airflow-providers-apache-spark/connections/index.rst} (88%)
 copy docs/apache-airflow-providers-apache-spark/connections/{spark.rst => spark-connect.rst} (51%)
 create mode 100644 docs/apache-airflow-providers-apache-spark/connections/spark-sql.rst
 rename docs/apache-airflow-providers-apache-spark/connections/{spark.rst => spark-submit.rst} (58%)
 delete mode 100644 docs/apache-airflow-providers-apache-sqoop/commits.rst
 delete mode 100644 docs/apache-airflow-providers-apache-sqoop/index.rst
 delete mode 100644 docs/apache-airflow-providers-apache-sqoop/security.rst
 copy docs/{apache-airflow-providers-apache-sqoop/operators.rst => apache-airflow-providers-atlassian-jira/connections.rst} (53%)
 copy docs/{apache-airflow-providers-amazon => apache-airflow-providers-fab}/configurations-ref.rst (100%)
 create mode 100644 docs/apache-airflow-providers-google/operators/marketing_platform/analytics_admin.rst
 rename docs/{apache-airflow-providers-plexus/changelog.rst => apache-airflow-providers-openlineage/supported_classes.rst} (65%)
 rename docs/{apache-airflow-providers-apache-sqoop/changelog.rst => apache-airflow-providers-opsgenie/connections.rst} (61%)
 rename docs/{apache-airflow-providers-apache-sqoop/installing-providers-from-sources.rst => apache-airflow-providers-pagerduty/connections/index.rst} (89%)
 copy docs/{apache-airflow-providers-amazon/operators/emr/index.rst => apache-airflow-providers-pagerduty/connections/pagerdurty.rst} (51%)
 copy docs/{apache-airflow-providers-amazon/operators/emr/index.rst => apache-airflow-providers-pagerduty/connections/pagerduty-events.rst} (58%)
 delete mode 100644 docs/apache-airflow-providers-plexus/commits.rst
 delete mode 100644 docs/apache-airflow-providers-plexus/index.rst
 delete mode 100644 docs/apache-airflow-providers-plexus/security.rst
 create mode 100644 docs/apache-airflow-providers-redis/connections.rst
 rename docs/{apache-airflow-providers-apache-sqoop/operators.rst => apache-airflow-providers-samba/connections.rst} (52%)
 create mode 100644 docs/apache-airflow/img/diagram_distributed_airflow_architecture.md5sum
 create mode 100644 docs/apache-airflow/img/diagram_distributed_airflow_architecture.png
 copy docs/apache-airflow/img/{diagram_basic_airflow_architecture.py => diagram_distributed_airflow_architecture.py} (51%)
 create mode 100644 docs/apache-airflow/img/logos/github_repository_social_image.png
 create mode 100644 docs/diagrams/database.png
 create mode 100644 docs/diagrams/multiple_files.png
 create mode 100644 docs/diagrams/packages.png
 create mode 100644 docs/exts/providers_extensions.py
 create mode 100644 docs/exts/templates/openlineage.rst.jinja2
 delete mode 100644 docs/integration-logos/apache/sqoop.png
 delete mode 100644 docs/integration-logos/plexus/Plexus.png
 create mode 100644 newsfragments/36281.significant.rst
 create mode 100644 newsfragments/36514.significant.rst
 create mode 100644 newsfragments/36647.significant.rst
 delete mode 100644 scripts/ci/docker-compose/backend-mssql-docker-volume.yml
 delete mode 100644 scripts/ci/docker-compose/backend-mssql-port.yml
 delete mode 100644 scripts/ci/docker-compose/backend-mssql-tmpfs-volume.yml
 delete mode 100644 scripts/ci/docker-compose/backend-mssql.yml
 delete mode 100644 scripts/ci/docker-compose/mssql_create_airflow_db.sql
 create mode 100755 scripts/ci/pre_commit/pre_commit_check_integrations_list.py
 rename airflow/providers/apache/sqoop/operators/__init__.py => scripts/ci/pre_commit/pre_commit_ruff_format.py (71%)
 mode change 100644 => 100755
 copy airflow/providers/amazon/aws/auth_manager/constants.py => tests/providers/amazon/aws/links/test_athena.py (55%)
 create mode 100644 tests/providers/amazon/aws/links/test_step_function.py
 create mode 100644 tests/providers/amazon/aws/operators/test_redshift_sql.py
 create mode 100644 tests/providers/amazon/aws/triggers/test_redshift_cluster.py
 delete mode 100644 tests/providers/apache/sqoop/__init__.py
 delete mode 100644 tests/providers/apache/sqoop/hooks/__init__.py
 delete mode 100644 tests/providers/apache/sqoop/hooks/test_sqoop.py
 delete mode 100644 tests/providers/apache/sqoop/operators/__init__.py
 delete mode 100644 tests/providers/apache/sqoop/operators/test_sqoop.py
 create mode 100644 tests/providers/google/marketing_platform/hooks/test_analytics_admin.py
 rename {airflow/providers/apache/sqoop/hooks => tests/providers/google/marketing_platform/links}/__init__.py (100%)
 create mode 100644 tests/providers/google/marketing_platform/links/test_analytics_admin.py
 create mode 100644 tests/providers/google/marketing_platform/operators/test_analytics_admin.py
 create mode 100644 tests/providers/openlineage/plugins/test_macros.py
 delete mode 100644 tests/providers/plexus/__init__.py
 delete mode 100644 tests/providers/plexus/hooks/__init__.py
 delete mode 100644 tests/providers/plexus/hooks/test_plexus.py
 delete mode 100644 tests/providers/plexus/operators/__init__.py
 delete mode 100644 tests/providers/plexus/operators/test_job.py
 create mode 100644 tests/system/providers/google/marketing_platform/example_analytics_admin.py
 create mode 100644 tests/system/providers/pgvector/example_pgvector_openai.py
 create mode 100644 tests/system/providers/pinecone/example_pinecone_cohere.py
 create mode 100644 tests/system/providers/pinecone/example_pinecone_openai.py
 delete mode 100644 tests/system/providers/plexus/__init__.py
 delete mode 100644 tests/system/providers/plexus/example_plexus.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_cohere.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_dynamic_mapping_dag.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_openai.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_using_hook.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_vectorizer_dag.py
 create mode 100644 tests/system/providers/weaviate/example_weaviate_without_vectorizer_dag.py
 create mode 100644 tests/system/providers/weaviate/jeopardy_data_with_vectors.json
 create mode 100644 tests/system/providers/weaviate/jeopardy_data_without_vectors.json
 create mode 100644 tests/system/providers/weaviate/jeopardy_doc_data_without_vectors.json