You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2023/02/23 12:25:46 UTC
[airflow-site] branch add-missing-docs-for-latest-providers created (now 2f29024feb)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch add-missing-docs-for-latest-providers
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
at 2f29024feb Add docs for recently released providers
This branch includes the following new commits:
new 2f29024feb Add docs for recently released providers
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[airflow-site] 01/01: Add docs for recently released providers
Posted by po...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch add-missing-docs-for-latest-providers
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit 2f29024febd3ff8ffd2b71d0eee5a71818469a06
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Thu Feb 23 13:24:12 2023 +0100
Add docs for recently released providers
Recent providers documentation has been missing from the latest
docs PR (needs to investigate why). This PR adds them back.
---
.../providers/airbyte/hooks/airbyte/index.html | 2 +-
.../7.2.1/.buildinfo | 4 +
.../providers/amazon/aws/exceptions}/index.html | 160 +-
.../providers/amazon/aws/hooks/appflow}/index.html | 176 +-
.../providers/amazon/aws/hooks/athena}/index.html | 303 +-
.../amazon/aws/hooks/base_aws}/index.html | 704 +-
.../amazon/aws/hooks/batch_client}/index.html | 716 +-
.../amazon/aws/hooks/batch_waiters}/index.html | 303 +-
.../amazon/aws/hooks/cloud_formation}/index.html | 167 +-
.../amazon/aws/hooks/datasync}/index.html | 451 +-
.../providers/amazon/aws/hooks/dms}/index.html | 329 +-
.../amazon/aws/hooks/dynamodb}/index.html | 199 +-
.../providers/amazon/aws/hooks/ec2}/index.html | 331 +-
.../providers/amazon/aws/hooks/ecr}/index.html | 236 +-
.../providers/amazon/aws/hooks/ecs}/index.html | 630 +-
.../providers/amazon/aws/hooks/eks}/index.html | 912 +-
.../elasticache_replication_group}/index.html | 329 +-
.../providers/amazon/aws/hooks/emr}/index.html | 645 +-
.../providers/amazon/aws/hooks/glacier}/index.html | 171 +-
.../providers/amazon/aws/hooks/glue}/index.html | 367 +-
.../amazon/aws/hooks/glue_catalog}/index.html | 284 +-
.../amazon/aws/hooks/glue_crawler}/index.html | 296 +-
.../airflow/providers/amazon/aws/hooks}/index.html | 179 +-
.../providers/amazon/aws/hooks/kinesis}/index.html | 197 +-
.../amazon/aws/hooks/lambda_function}/index.html | 211 +-
.../providers/amazon/aws/hooks/logs}/index.html | 157 +-
.../amazon/aws/hooks/quicksight}/index.html | 222 +-
.../providers/amazon/aws/hooks/rds}/index.html | 428 +-
.../amazon/aws/hooks/redshift_cluster}/index.html | 273 +-
.../amazon/aws/hooks/redshift_data}/index.html | 194 +-
.../amazon/aws/hooks/redshift_sql}/index.html | 194 +-
.../providers/amazon/aws/hooks/s3}/index.html | 1158 +-
.../amazon/aws/hooks/sagemaker/index.html | 1978 +++
.../amazon/aws/hooks/secrets_manager}/index.html | 155 +-
.../providers/amazon/aws/hooks/ses}/index.html | 155 +-
.../providers/amazon/aws/hooks/sns}/index.html | 208 +-
.../providers/amazon/aws/hooks/sqs}/index.html | 165 +-
.../providers/amazon/aws/hooks/ssm}/index.html | 197 +-
.../amazon/aws/hooks/step_function}/index.html | 159 +-
.../providers/amazon/aws/hooks/sts}/index.html | 194 +-
.../_api/airflow/providers/amazon/aws}/index.html | 454 +-
.../amazon/aws/links/base_aws}/index.html | 196 +-
.../providers/amazon/aws/links/batch}/index.html | 222 +-
.../providers/amazon/aws/links/emr}/index.html | 162 +-
.../providers/amazon/aws/links/glue}/index.html | 194 +-
.../airflow/providers/amazon/aws/links/index.html} | 219 +-
.../providers/amazon/aws/links/logs}/index.html | 198 +-
.../aws/log/cloudwatch_task_handler}/index.html | 165 +-
.../airflow/providers/amazon/aws/log/index.html} | 216 +-
.../amazon/aws/log/s3_task_handler}/index.html | 223 +-
.../amazon/aws/operators/appflow}/index.html | 581 +-
.../amazon/aws/operators/athena}/index.html | 172 +-
.../amazon/aws/operators/aws_lambda/index.html} | 217 +-
.../amazon/aws/operators/batch}/index.html | 306 +-
.../aws/operators/cloud_formation}/index.html | 209 +-
.../amazon/aws/operators/datasync}/index.html | 243 +-
.../providers/amazon/aws/operators/dms}/index.html | 573 +-
.../providers/amazon/aws/operators/ec2}/index.html | 201 +-
.../providers/amazon/aws/operators/ecs}/index.html | 682 +-
.../providers/amazon/aws/operators/eks}/index.html | 1036 +-
.../providers/amazon/aws/operators/emr/index.html | 1690 ++
.../amazon/aws/operators/glacier}/index.html | 185 +-
.../amazon/aws/operators/glue}/index.html | 176 +-
.../amazon/aws/operators/glue_crawler}/index.html | 138 +-
.../providers/amazon/aws/operators}/index.html | 168 +-
.../aws/operators/lambda_function}/index.html | 224 +-
.../amazon/aws/operators/quicksight}/index.html | 163 +-
.../providers/amazon/aws/operators/rds}/index.html | 988 +-
.../aws/operators/redshift_cluster}/index.html | 670 +-
.../amazon/aws/operators/redshift_data}/index.html | 184 +-
.../amazon/aws/operators/redshift_sql}/index.html | 130 +-
.../providers/amazon/aws/operators/s3/index.html | 1700 ++
.../amazon/aws/operators/sagemaker/index.html | 1874 ++
.../providers/amazon/aws/operators/sns}/index.html | 131 +-
.../providers/amazon/aws/operators/sqs}/index.html | 141 +-
.../amazon/aws/operators/step_function}/index.html | 200 +-
.../providers/amazon/aws/secrets/index.html} | 216 +-
.../amazon/aws/secrets/secrets_manager}/index.html | 233 +-
.../amazon/aws/secrets/systems_manager}/index.html | 218 +-
.../amazon/aws/sensors/athena}/index.html | 156 +-
.../providers/amazon/aws/sensors/batch}/index.html | 298 +-
.../amazon/aws/sensors/cloud_formation}/index.html | 212 +-
.../providers/amazon/aws/sensors/dms}/index.html | 199 +-
.../providers/amazon/aws/sensors/ec2}/index.html | 136 +-
.../providers/amazon/aws/sensors/ecs}/index.html | 293 +-
.../providers/amazon/aws/sensors/eks}/index.html | 613 +-
.../providers/amazon/aws/sensors/emr}/index.html | 1040 +-
.../amazon/aws/sensors/glacier}/index.html | 166 +-
.../providers/amazon/aws/sensors/glue}/index.html | 123 +-
.../aws/sensors/glue_catalog_partition}/index.html | 152 +-
.../amazon/aws/sensors/glue_crawler}/index.html | 138 +-
.../providers/amazon/aws/sensors}/index.html | 163 +-
.../amazon/aws/sensors/lambda_function}/index.html | 131 +-
.../amazon/aws/sensors/quicksight}/index.html | 148 +-
.../providers/amazon/aws/sensors/rds}/index.html | 225 +-
.../aws/sensors/redshift_cluster}/index.html | 137 +-
.../providers/amazon/aws/sensors/s3}/index.html | 286 +-
.../amazon/aws/sensors/sagemaker}/index.html | 1002 +-
.../providers/amazon/aws/sensors/sqs}/index.html | 225 +-
.../amazon/aws/sensors/step_function}/index.html | 183 +-
.../aws/transfers/dynamodb_to_s3}/index.html | 184 +-
.../amazon/aws/transfers/exasol_to_s3}/index.html | 167 +-
.../amazon/aws/transfers/ftp_to_s3}/index.html | 146 +-
.../amazon/aws/transfers/gcs_to_s3}/index.html | 194 +-
.../aws/transfers/glacier_to_gcs}/index.html | 146 +-
.../aws/transfers/google_api_to_s3}/index.html | 199 +-
.../aws/transfers/hive_to_dynamodb}/index.html | 162 +-
.../transfers/imap_attachment_to_s3}/index.html | 134 +-
.../providers/amazon/aws/transfers}/index.html | 161 +-
.../amazon/aws/transfers/local_to_s3}/index.html | 156 +-
.../amazon/aws/transfers/mongo_to_s3}/index.html | 170 +-
.../aws/transfers/redshift_to_s3}/index.html | 187 +-
.../amazon/aws/transfers/s3_to_ftp}/index.html | 192 +-
.../aws/transfers/s3_to_redshift}/index.html | 198 +-
.../amazon/aws/transfers/s3_to_sftp}/index.html | 139 +-
.../amazon/aws/transfers/s3_to_sql}/index.html | 175 +-
.../aws/transfers/salesforce_to_s3}/index.html | 164 +-
.../amazon/aws/transfers/sftp_to_s3}/index.html | 143 +-
.../amazon/aws/transfers/sql_to_s3}/index.html | 241 +-
.../aws/utils/connection_wrapper}/index.html | 317 +-
.../amazon/aws/utils/eks_get_token}/index.html | 229 +-
.../providers/amazon/aws/utils/emailer}/index.html | 191 +-
.../airflow/providers/amazon/aws/utils}/index.html | 194 +-
.../providers/amazon/aws/utils/rds}/index.html | 187 +-
.../amazon/aws/utils/redshift}/index.html | 219 +-
.../amazon/aws/utils/sagemaker}/index.html | 194 +-
.../providers/amazon/aws/utils/tags}/index.html | 192 +-
.../providers/amazon/aws/utils/waiter}/index.html | 172 +-
.../amazon/aws/waiters/base_waiter}/index.html | 180 +-
.../providers/amazon/aws/waiters/index.html} | 215 +-
.../_api/airflow/providers/amazon}/index.html | 449 +-
.../amazon/aws/example_athena}/index.html | 214 +-
.../providers/amazon/aws/example_batch}/index.html | 307 +-
.../amazon/aws/example_cloudformation}/index.html | 224 +-
.../amazon/aws/example_datasync}/index.html | 297 +-
.../providers/amazon/aws/example_dms}/index.html | 315 +-
.../amazon/aws/example_dynamodb_to_s3}/index.html | 253 +-
.../providers/amazon/aws/example_ec2}/index.html | 210 +-
.../providers/amazon/aws/example_ecs}/index.html | 196 +-
.../amazon/aws/example_ecs_fargate}/index.html | 247 +-
.../index.html | 175 +-
.../example_eks_with_fargate_profile}/index.html | 182 +-
.../index.html | 168 +-
.../aws/example_eks_with_nodegroups}/index.html | 231 +-
.../providers/amazon/aws/example_emr}/index.html | 264 +-
.../amazon/aws/example_emr_eks}/index.html | 293 +-
.../aws/example_emr_notebook_execution}/index.html | 231 +-
.../amazon/aws/example_emr_serverless}/index.html | 224 +-
.../providers/amazon/aws/example_glue}/index.html | 257 +-
.../example_google_api_youtube_to_s3}/index.html | 300 +-
.../amazon/aws/example_lambda}/index.html | 212 +-
.../amazon/aws/example_local_to_s3}/index.html | 206 +-
.../amazon/aws/example_quicksight}/index.html | 274 +-
.../amazon/aws/example_rds_event}/index.html | 188 +-
.../amazon/aws/example_rds_export}/index.html | 194 +-
.../amazon/aws/example_rds_instance}/index.html | 231 +-
.../amazon/aws/example_rds_snapshot}/index.html | 217 +-
.../amazon/aws/example_redshift}/index.html | 261 +-
.../aws/example_redshift_s3_transfers}/index.html | 316 +-
.../providers/amazon/aws/example_s3}/index.html | 196 +-
.../amazon/aws/example_s3_to_sql}/index.html | 289 +-
.../amazon/aws/example_sagemaker}/index.html | 328 +-
.../aws/example_sagemaker_endpoint}/index.html | 278 +-
.../providers/amazon/aws/example_sns}/index.html | 188 +-
.../amazon/aws/example_sql_to_s3}/index.html | 291 +-
.../providers/amazon/aws/example_sqs}/index.html | 188 +-
.../amazon/aws/example_step_functions}/index.html | 206 +-
.../tests/system/providers/amazon/aws}/index.html | 199 +-
.../providers/amazon/aws/utils/ec2}/index.html | 293 +-
.../system/providers/amazon/aws/utils}/index.html | 421 +-
.../_api/tests/system/providers/amazon}/index.html | 248 +-
.../7.2.1/_images/aws-base-conn-airflow.png | Bin 0 -> 186727 bytes
.../7.2.1/_images/aws-secrets-manager-json.png | Bin 0 -> 86477 bytes
.../7.2.1/_images/aws-secrets-manager-uri.png | Bin 0 -> 60559 bytes
.../_images/aws-web-identity-federation-gcp.png | Bin 0 -> 40170 bytes
.../airflow/providers/amazon/aws/exceptions.html} | 283 +-
.../providers/amazon/aws/hooks/appflow.html} | 335 +-
.../providers/amazon/aws/hooks/athena.html} | 555 +-
.../providers/amazon/aws/hooks/base_aws.html | 1690 ++
.../providers/amazon/aws/hooks/batch_client.html} | 785 +-
.../providers/amazon/aws/hooks/batch_waiters.html} | 493 +-
.../amazon/aws/hooks/cloud_formation.html} | 265 +-
.../providers/amazon/aws/hooks/datasync.html} | 584 +-
.../airflow/providers/amazon/aws/hooks/dms.html} | 499 +-
.../providers/amazon/aws/hooks/dynamodb.html} | 246 +-
.../airflow/providers/amazon/aws/hooks/ec2.html} | 471 +-
.../airflow/providers/amazon/aws/hooks/ecr.html} | 276 +-
.../airflow/providers/amazon/aws/hooks/ecs.html} | 492 +-
.../airflow/providers/amazon/aws/hooks/eks.html} | 881 +-
.../aws/hooks/elasticache_replication_group.html} | 515 +-
.../airflow/providers/amazon/aws/hooks/emr.html} | 772 +-
.../providers/amazon/aws/hooks/glacier.html} | 261 +-
.../airflow/providers/amazon/aws/hooks/glue.html} | 563 +-
.../providers/amazon/aws/hooks/glue_catalog.html} | 386 +-
.../providers/amazon/aws/hooks/glue_crawler.html} | 497 +-
.../providers/amazon/aws/hooks/kinesis.html} | 290 +-
.../amazon/aws/hooks/lambda_function.html} | 370 +-
.../airflow/providers/amazon/aws/hooks/logs.html} | 278 +-
.../providers/amazon/aws/hooks/quicksight.html} | 346 +-
.../airflow/providers/amazon/aws/hooks/rds.html} | 593 +-
.../amazon/aws/hooks/redshift_cluster.html} | 480 +-
.../providers/amazon/aws/hooks/redshift_data.html} | 282 +-
.../providers/amazon/aws/hooks/redshift_sql.html} | 322 +-
.../airflow/providers/amazon/aws/hooks/s3.html | 1943 +++
.../providers/amazon/aws/hooks/sagemaker.html | 2141 +++
.../amazon/aws/hooks/secrets_manager.html} | 245 +-
.../airflow/providers/amazon/aws/hooks/ses.html} | 279 +-
.../airflow/providers/amazon/aws/hooks/sns.html} | 271 +-
.../airflow/providers/amazon/aws/hooks/sqs.html} | 259 +-
.../airflow/providers/amazon/aws/hooks/ssm.html} | 237 +-
.../providers/amazon/aws/hooks/step_function.html} | 257 +-
.../airflow/providers/amazon/aws/hooks/sts.html} | 284 +-
.../providers/amazon/aws/links/base_aws.html} | 271 +-
.../airflow/providers/amazon/aws/links/batch.html} | 221 +-
.../airflow/providers/amazon/aws/links/emr.html} | 274 +-
.../airflow/providers/amazon/aws/links/glue.html} | 266 +-
.../airflow/providers/amazon/aws/links/logs.html} | 279 +-
.../amazon/aws/log/cloudwatch_task_handler.html} | 317 +-
.../providers/amazon/aws/log/s3_task_handler.html} | 475 +-
.../providers/amazon/aws/operators/appflow.html} | 731 +-
.../providers/amazon/aws/operators/athena.html} | 350 +-
.../providers/amazon/aws/operators/batch.html} | 600 +-
.../amazon/aws/operators/cloud_formation.html} | 291 +-
.../providers/amazon/aws/operators/datasync.html} | 667 +-
.../providers/amazon/aws/operators/dms.html} | 528 +-
.../providers/amazon/aws/operators/ec2.html} | 311 +-
.../providers/amazon/aws/operators/ecs.html | 1481 ++
.../providers/amazon/aws/operators/eks.html | 1544 ++
.../providers/amazon/aws/operators/emr.html | 1840 ++
.../providers/amazon/aws/operators/glacier.html} | 282 +-
.../providers/amazon/aws/operators/glue.html} | 454 +-
.../amazon/aws/operators/glue_crawler.html} | 264 +-
.../amazon/aws/operators/lambda_function.html} | 474 +-
.../amazon/aws/operators/quicksight.html} | 275 +-
.../providers/amazon/aws/operators/rds.html | 1562 ++
.../amazon/aws/operators/redshift_cluster.html} | 790 +-
.../amazon/aws/operators/redshift_data.html} | 453 +-
.../amazon/aws/operators/redshift_sql.html} | 233 +-
.../airflow/providers/amazon/aws/operators/s3.html | 1583 ++
.../providers/amazon/aws/operators/sagemaker.html | 1925 +++
.../providers/amazon/aws/operators/sns.html} | 260 +-
.../providers/amazon/aws/operators/sqs.html} | 272 +-
.../amazon/aws/operators/step_function.html} | 307 +-
.../amazon/aws/secrets/secrets_manager.html} | 577 +-
.../amazon/aws/secrets/systems_manager.html} | 377 +-
.../providers/amazon/aws/sensors/athena.html} | 267 +-
.../providers/amazon/aws/sensors/batch.html} | 490 +-
.../amazon/aws/sensors/cloud_formation.html} | 302 +-
.../airflow/providers/amazon/aws/sensors/dms.html} | 312 +-
.../airflow/providers/amazon/aws/sensors/ec2.html} | 249 +-
.../airflow/providers/amazon/aws/sensors/ecs.html} | 466 +-
.../airflow/providers/amazon/aws/sensors/eks.html} | 534 +-
.../airflow/providers/amazon/aws/sensors/emr.html} | 761 +-
.../providers/amazon/aws/sensors/glacier.html} | 296 +-
.../providers/amazon/aws/sensors/glue.html} | 268 +-
.../aws/sensors/glue_catalog_partition.html} | 271 +-
.../amazon/aws/sensors/glue_crawler.html} | 252 +-
.../amazon/aws/sensors/lambda_function.html} | 262 +-
.../providers/amazon/aws/sensors/quicksight.html} | 265 +-
.../airflow/providers/amazon/aws/sensors/rds.html} | 386 +-
.../amazon/aws/sensors/redshift_cluster.html} | 251 +-
.../airflow/providers/amazon/aws/sensors/s3.html} | 526 +-
.../providers/amazon/aws/sensors/sagemaker.html} | 602 +-
.../airflow/providers/amazon/aws/sensors/sqs.html} | 505 +-
.../amazon/aws/sensors/step_function.html} | 273 +-
.../amazon/aws/transfers/dynamodb_to_s3.html} | 353 +-
.../amazon/aws/transfers/exasol_to_s3.html} | 303 +-
.../providers/amazon/aws/transfers/ftp_to_s3.html} | 345 +-
.../providers/amazon/aws/transfers/gcs_to_s3.html} | 474 +-
.../amazon/aws/transfers/glacier_to_gcs.html} | 309 +-
.../amazon/aws/transfers/google_api_to_s3.html} | 471 +-
.../amazon/aws/transfers/hive_to_dynamodb.html} | 303 +-
.../aws/transfers/imap_attachment_to_s3.html} | 308 +-
.../amazon/aws/transfers/local_to_s3.html} | 284 +-
.../amazon/aws/transfers/mongo_to_s3.html} | 350 +-
.../amazon/aws/transfers/redshift_to_s3.html} | 353 +-
.../providers/amazon/aws/transfers/s3_to_ftp.html} | 256 +-
.../amazon/aws/transfers/s3_to_redshift.html} | 444 +-
.../amazon/aws/transfers/s3_to_sftp.html} | 272 +-
.../providers/amazon/aws/transfers/s3_to_sql.html} | 321 +-
.../amazon/aws/transfers/salesforce_to_s3.html} | 326 +-
.../amazon/aws/transfers/sftp_to_s3.html} | 272 +-
.../providers/amazon/aws/transfers/sql_to_s3.html} | 469 +-
.../airflow/providers/amazon/aws/utils.html} | 279 +-
.../amazon/aws/utils/connection_wrapper.html} | 720 +-
.../providers/amazon/aws/utils/eks_get_token.html} | 247 +-
.../providers/amazon/aws/utils/emailer.html} | 231 +-
.../airflow/providers/amazon/aws/utils/rds.html} | 265 +-
.../providers/amazon/aws/utils/redshift.html} | 289 +-
.../providers/amazon/aws/utils/sagemaker.html} | 267 +-
.../airflow/providers/amazon/aws/utils/tags.html} | 277 +-
.../providers/amazon/aws/utils/waiter.html} | 258 +-
.../providers/amazon/aws/waiters/base_waiter.html} | 273 +-
.../7.2.1/_modules/index.html} | 404 +-
.../providers/amazon/aws/example_athena.html} | 379 +-
.../providers/amazon/aws/example_batch.html} | 551 +-
.../amazon/aws/example_cloudformation.html} | 296 +-
.../providers/amazon/aws/example_datasync.html} | 524 +-
.../system/providers/amazon/aws/example_dms.html} | 713 +-
.../amazon/aws/example_dynamodb_to_s3.html} | 355 +-
.../system/providers/amazon/aws/example_ec2.html} | 350 +-
.../system/providers/amazon/aws/example_ecs.html} | 421 +-
.../providers/amazon/aws/example_ecs_fargate.html} | 340 +-
.../aws/example_eks_with_fargate_in_one_step.html} | 338 +-
.../aws/example_eks_with_fargate_profile.html} | 373 +-
.../example_eks_with_nodegroup_in_one_step.html} | 326 +-
.../amazon/aws/example_eks_with_nodegroups.html} | 365 +-
.../system/providers/amazon/aws/example_emr.html} | 392 +-
.../providers/amazon/aws/example_emr_eks.html} | 581 +-
.../aws/example_emr_notebook_execution.html} | 320 +-
.../amazon/aws/example_emr_serverless.html} | 344 +-
.../system/providers/amazon/aws/example_glue.html} | 406 +-
.../aws/example_google_api_youtube_to_s3.html} | 484 +-
.../providers/amazon/aws/example_lambda.html} | 333 +-
.../providers/amazon/aws/example_local_to_s3.html} | 279 +-
.../providers/amazon/aws/example_quicksight.html} | 508 +-
.../providers/amazon/aws/example_rds_event.html} | 324 +-
.../providers/amazon/aws/example_rds_export.html} | 381 +-
.../amazon/aws/example_rds_instance.html} | 299 +-
.../amazon/aws/example_rds_snapshot.html} | 343 +-
.../providers/amazon/aws/example_redshift.html} | 582 +-
.../amazon/aws/example_redshift_s3_transfers.html} | 558 +-
.../system/providers/amazon/aws/example_s3.html} | 555 +-
.../providers/amazon/aws/example_s3_to_sql.html} | 561 +-
.../providers/amazon/aws/example_sagemaker.html | 1529 ++
.../amazon/aws/example_sagemaker_endpoint.html} | 582 +-
.../system/providers/amazon/aws/example_sns.html} | 263 +-
.../providers/amazon/aws/example_sql_to_s3.html} | 499 +-
.../system/providers/amazon/aws/example_sqs.html} | 288 +-
.../amazon/aws/example_step_functions.html} | 317 +-
.../tests/system/providers/amazon/aws/utils.html} | 593 +-
.../system/providers/amazon/aws/utils/ec2.html} | 357 +-
.../providers/amazon/aws/exceptions/index.rst.txt | 40 +
.../amazon/aws/hooks/appflow/index.rst.txt | 71 +
.../amazon/aws/hooks/athena/index.rst.txt | 159 +
.../amazon/aws/hooks/base_aws/index.rst.txt | 312 +
.../amazon/aws/hooks/batch_client/index.rst.txt | 409 +
.../amazon/aws/hooks/batch_waiters/index.rst.txt | 177 +
.../amazon/aws/hooks/cloud_formation/index.rst.txt | 70 +
.../amazon/aws/hooks/datasync/index.rst.txt | 199 +
.../providers/amazon/aws/hooks/dms/index.rst.txt | 149 +
.../amazon/aws/hooks/dynamodb/index.rst.txt | 54 +
.../providers/amazon/aws/hooks/ec2/index.rst.txt | 130 +
.../providers/amazon/aws/hooks/ecr/index.rst.txt | 94 +
.../providers/amazon/aws/hooks/ecs/index.rst.txt | 267 +
.../providers/amazon/aws/hooks/eks/index.rst.txt | 405 +
.../elasticache_replication_group/index.rst.txt | 139 +
.../providers/amazon/aws/hooks/emr/index.rst.txt | 293 +
.../amazon/aws/hooks/glacier/index.rst.txt | 66 +
.../providers/amazon/aws/hooks/glue/index.rst.txt | 166 +
.../amazon/aws/hooks/glue_catalog/index.rst.txt | 143 +
.../amazon/aws/hooks/glue_crawler/index.rst.txt | 114 +
.../providers/amazon/aws/hooks/index.rst.txt | 50 +
.../amazon/aws/hooks/kinesis/index.rst.txt | 50 +
.../amazon/aws/hooks/lambda_function/index.rst.txt | 100 +
.../providers/amazon/aws/hooks/logs/index.rst.txt | 60 +
.../amazon/aws/hooks/quicksight/index.rst.txt | 87 +
.../providers/amazon/aws/hooks/rds/index.rst.txt | 195 +
.../aws/hooks/redshift_cluster/index.rst.txt | 125 +
.../amazon/aws/hooks/redshift_data/index.rst.txt | 35 +
.../amazon/aws/hooks/redshift_sql/index.rst.txt | 91 +
.../providers/amazon/aws/hooks/s3/index.rst.txt | 532 +
.../amazon/aws/hooks/sagemaker/index.rst.txt | 619 +
.../amazon/aws/hooks/secrets_manager/index.rst.txt | 54 +
.../providers/amazon/aws/hooks/ses/index.rst.txt | 63 +
.../providers/amazon/aws/hooks/sns/index.rst.txt | 59 +
.../providers/amazon/aws/hooks/sqs/index.rst.txt | 65 +
.../providers/amazon/aws/hooks/ssm/index.rst.txt | 45 +
.../amazon/aws/hooks/step_function/index.rst.txt | 57 +
.../providers/amazon/aws/hooks/sts/index.rst.txt | 41 +
.../airflow/providers/amazon/aws/index.rst.txt | 32 +
.../amazon/aws/links/base_aws/index.rst.txt | 81 +
.../providers/amazon/aws/links/batch/index.rst.txt | 84 +
.../providers/amazon/aws/links/emr/index.rst.txt | 62 +
.../providers/amazon/aws/links/glue/index.rst.txt | 40 +
.../providers/amazon/aws/links/index.rst.txt | 19 +
.../providers/amazon/aws/links/logs/index.rst.txt | 48 +
.../aws/log/cloudwatch_task_handler/index.rst.txt | 69 +
.../airflow/providers/amazon/aws/log/index.rst.txt | 16 +
.../amazon/aws/log/s3_task_handler/index.rst.txt | 87 +
.../amazon/aws/operators/appflow/index.rst.txt | 216 +
.../amazon/aws/operators/athena/index.rst.txt | 81 +
.../amazon/aws/operators/aws_lambda/index.rst.txt | 11 +
.../amazon/aws/operators/batch/index.rst.txt | 188 +
.../aws/operators/cloud_formation/index.rst.txt | 111 +
.../amazon/aws/operators/datasync/index.rst.txt | 143 +
.../amazon/aws/operators/dms/index.rst.txt | 240 +
.../amazon/aws/operators/ec2/index.rst.txt | 102 +
.../amazon/aws/operators/ecs/index.rst.txt | 287 +
.../amazon/aws/operators/eks/index.rst.txt | 438 +
.../amazon/aws/operators/emr/index.rst.txt | 547 +
.../amazon/aws/operators/glacier/index.rst.txt | 82 +
.../amazon/aws/operators/glue/index.rst.txt | 80 +
.../aws/operators/glue_crawler/index.rst.txt | 60 +
.../providers/amazon/aws/operators/index.rst.txt | 39 +
.../aws/operators/lambda_function/index.rst.txt | 112 +
.../amazon/aws/operators/quicksight/index.rst.txt | 79 +
.../amazon/aws/operators/rds/index.rst.txt | 340 +
.../aws/operators/redshift_cluster/index.rst.txt | 300 +
.../aws/operators/redshift_data/index.rst.txt | 81 +
.../aws/operators/redshift_sql/index.rst.txt | 55 +
.../amazon/aws/operators/s3/index.rst.txt | 577 +
.../amazon/aws/operators/sagemaker/index.rst.txt | 662 +
.../amazon/aws/operators/sns/index.rst.txt | 66 +
.../amazon/aws/operators/sqs/index.rst.txt | 68 +
.../aws/operators/step_function/index.rst.txt | 105 +
.../providers/amazon/aws/secrets/index.rst.txt | 16 +
.../aws/secrets/secrets_manager/index.rst.txt | 131 +
.../aws/secrets/systems_manager/index.rst.txt | 101 +
.../amazon/aws/sensors/athena/index.rst.txt | 81 +
.../amazon/aws/sensors/batch/index.rst.txt | 160 +
.../aws/sensors/cloud_formation/index.rst.txt | 99 +
.../providers/amazon/aws/sensors/dms/index.rst.txt | 86 +
.../providers/amazon/aws/sensors/ec2/index.rst.txt | 64 +
.../providers/amazon/aws/sensors/ecs/index.rst.txt | 138 +
.../providers/amazon/aws/sensors/eks/index.rst.txt | 228 +
.../providers/amazon/aws/sensors/emr/index.rst.txt | 418 +
.../amazon/aws/sensors/glacier/index.rst.txt | 80 +
.../amazon/aws/sensors/glue/index.rst.txt | 49 +
.../sensors/glue_catalog_partition/index.rst.txt | 66 +
.../amazon/aws/sensors/glue_crawler/index.rst.txt | 53 +
.../providers/amazon/aws/sensors/index.rst.txt | 34 +
.../aws/sensors/lambda_function/index.rst.txt | 55 +
.../amazon/aws/sensors/quicksight/index.rst.txt | 58 +
.../providers/amazon/aws/sensors/rds/index.rst.txt | 98 +
.../aws/sensors/redshift_cluster/index.rst.txt | 52 +
.../providers/amazon/aws/sensors/s3/index.rst.txt | 143 +
.../amazon/aws/sensors/sagemaker/index.rst.txt | 374 +
.../providers/amazon/aws/sensors/sqs/index.rst.txt | 103 +
.../amazon/aws/sensors/step_function/index.rst.txt | 83 +
.../aws/transfers/dynamodb_to_s3/index.rst.txt | 85 +
.../aws/transfers/exasol_to_s3/index.rst.txt | 76 +
.../amazon/aws/transfers/ftp_to_s3/index.rst.txt | 69 +
.../amazon/aws/transfers/gcs_to_s3/index.rst.txt | 99 +
.../aws/transfers/glacier_to_gcs/index.rst.txt | 68 +
.../aws/transfers/google_api_to_s3/index.rst.txt | 108 +
.../aws/transfers/hive_to_dynamodb/index.rst.txt | 78 +
.../transfers/imap_attachment_to_s3/index.rst.txt | 59 +
.../providers/amazon/aws/transfers/index.rst.txt | 32 +
.../amazon/aws/transfers/local_to_s3/index.rst.txt | 73 +
.../amazon/aws/transfers/mongo_to_s3/index.rst.txt | 80 +
.../aws/transfers/redshift_to_s3/index.rst.txt | 95 +
.../amazon/aws/transfers/s3_to_ftp/index.rst.txt | 54 +
.../aws/transfers/s3_to_redshift/index.rst.txt | 92 +
.../amazon/aws/transfers/s3_to_sftp/index.rst.txt | 60 +
.../amazon/aws/transfers/s3_to_sql/index.rst.txt | 80 +
.../aws/transfers/salesforce_to_s3/index.rst.txt | 76 +
.../amazon/aws/transfers/sftp_to_s3/index.rst.txt | 64 +
.../amazon/aws/transfers/sql_to_s3/index.rst.txt | 111 +
.../aws/utils/connection_wrapper/index.rst.txt | 163 +
.../amazon/aws/utils/eks_get_token/index.rst.txt | 43 +
.../amazon/aws/utils/emailer/index.rst.txt | 29 +
.../providers/amazon/aws/utils/index.rst.txt | 60 +
.../providers/amazon/aws/utils/rds/index.rst.txt | 38 +
.../amazon/aws/utils/redshift/index.rst.txt | 41 +
.../amazon/aws/utils/sagemaker/index.rst.txt | 41 +
.../providers/amazon/aws/utils/tags/index.rst.txt | 31 +
.../amazon/aws/utils/waiter/index.rst.txt | 54 +
.../amazon/aws/waiters/base_waiter/index.rst.txt | 29 +
.../providers/amazon/aws/waiters/index.rst.txt | 15 +
.../_api/airflow/providers/amazon/index.rst.txt | 15 +
.../amazon/aws/example_athena/index.rst.txt | 81 +
.../amazon/aws/example_batch/index.rst.txt | 98 +
.../aws/example_cloudformation/index.rst.txt | 30 +
.../amazon/aws/example_datasync/index.rst.txt | 88 +
.../providers/amazon/aws/example_dms/index.rst.txt | 119 +
.../aws/example_dynamodb_to_s3/index.rst.txt | 79 +
.../providers/amazon/aws/example_ec2/index.rst.txt | 62 +
.../providers/amazon/aws/example_ecs/index.rst.txt | 62 +
.../amazon/aws/example_ecs_fargate/index.rst.txt | 82 +
.../index.rst.txt | 41 +
.../example_eks_with_fargate_profile/index.rst.txt | 45 +
.../index.rst.txt | 36 +
.../aws/example_eks_with_nodegroups/index.rst.txt | 36 +
.../providers/amazon/aws/example_emr/index.rst.txt | 87 +
.../amazon/aws/example_emr_eks/index.rst.txt | 117 +
.../example_emr_notebook_execution/index.rst.txt | 36 +
.../aws/example_emr_serverless/index.rst.txt | 31 +
.../amazon/aws/example_glue/index.rst.txt | 110 +
.../example_google_api_youtube_to_s3/index.rst.txt | 127 +
.../amazon/aws/example_lambda/index.rst.txt | 81 +
.../amazon/aws/example_local_to_s3/index.rst.txt | 66 +
.../amazon/aws/example_quicksight/index.rst.txt | 98 +
.../amazon/aws/example_rds_event/index.rst.txt | 54 +
.../amazon/aws/example_rds_export/index.rst.txt | 62 +
.../amazon/aws/example_rds_instance/index.rst.txt | 36 +
.../amazon/aws/example_rds_snapshot/index.rst.txt | 26 +
.../amazon/aws/example_redshift/index.rst.txt | 87 +
.../example_redshift_s3_transfers/index.rst.txt | 126 +
.../providers/amazon/aws/example_s3/index.rst.txt | 67 +
.../amazon/aws/example_s3_to_sql/index.rst.txt | 114 +
.../amazon/aws/example_sagemaker/index.rst.txt | 138 +
.../aws/example_sagemaker_endpoint/index.rst.txt | 101 +
.../providers/amazon/aws/example_sns/index.rst.txt | 54 +
.../amazon/aws/example_sql_to_s3/index.rst.txt | 102 +
.../providers/amazon/aws/example_sqs/index.rst.txt | 54 +
.../aws/example_step_functions/index.rst.txt | 65 +
.../system/providers/amazon/aws/index.rst.txt | 59 +
.../providers/amazon/aws/utils/ec2/index.rst.txt | 65 +
.../providers/amazon/aws/utils/index.rst.txt | 203 +
.../tests/system/providers/amazon/index.rst.txt | 15 +
.../7.2.1/_sources/commits.rst.txt | 1111 ++
.../7.2.1/_sources/connections/aws.rst.txt | 792 +
.../7.2.1/_sources/connections/emr.rst.txt | 43 +
.../7.2.1/_sources/connections/index.rst.txt | 28 +
.../7.2.1/_sources/connections/redshift.rst.txt | 91 +
.../7.2.1/_sources/example-dags.rst.txt | 24 +
.../7.2.1/_sources/index.rst.txt | 145 +
.../installing-providers-from-sources.rst.txt | 18 +
.../logging/cloud-watch-task-handlers.rst.txt | 38 +
.../7.2.1/_sources/logging/index.rst.txt | 25 +
.../7.2.1/_sources/logging/s3-task-handler.rst.txt | 140 +
.../7.2.1/_sources/operators/appflow.rst.txt | 146 +
.../7.2.1/_sources/operators/athena.rst.txt | 75 +
.../7.2.1/_sources/operators/batch.rst.txt | 111 +
.../_sources/operators/cloudformation.rst.txt | 99 +
.../7.2.1/_sources/operators/datasync.rst.txt | 114 +
.../7.2.1/_sources/operators/dms.rst.txt | 133 +
.../7.2.1/_sources/operators/ec2.rst.txt | 81 +
.../7.2.1/_sources/operators/ecs.rst.txt | 262 +
.../7.2.1/_sources/operators/eks.rst.txt | 247 +
.../7.2.1/_sources/operators/emr.rst.txt | 196 +
.../7.2.1/_sources/operators/emr_eks.rst.txt | 124 +
.../_sources/operators/emr_serverless.rst.txt | 113 +
.../7.2.1/_sources/operators/glacier.rst.txt | 83 +
.../7.2.1/_sources/operators/glue.rst.txt | 107 +
.../7.2.1/_sources/operators/index.rst.txt | 29 +
.../7.2.1/_sources/operators/lambda.rst.txt | 85 +
.../7.2.1/_sources/operators/quicksight.rst.txt | 69 +
.../7.2.1/_sources/operators/rds.rst.txt | 252 +
.../_sources/operators/redshift_cluster.rst.txt | 139 +
.../7.2.1/_sources/operators/redshift_data.rst.txt | 55 +
.../7.2.1/_sources/operators/redshift_sql.rst.txt | 64 +
.../7.2.1/_sources/operators/s3.rst.txt | 271 +
.../7.2.1/_sources/operators/sagemaker.rst.txt | 316 +
.../7.2.1/_sources/operators/sns.rst.txt | 55 +
.../7.2.1/_sources/operators/sqs.rst.txt | 74 +
.../_sources/operators/step_functions.rst.txt | 82 +
.../operators/transfer/dynamodb_to_s3.rst.txt | 70 +
.../_sources/operators/transfer/ftp_to_s3.rst.txt | 53 +
.../_sources/operators/transfer/gcs_to_s3.rst.txt | 52 +
.../operators/transfer/glacier_to_gcs.rst.txt | 55 +
.../operators/transfer/google_api_to_s3.rst.txt | 81 +
.../operators/transfer/hive_to_dynamodb.rst.txt | 57 +
.../transfer/imap_attachment_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/index.rst.txt | 28 +
.../operators/transfer/local_to_s3.rst.txt | 54 +
.../operators/transfer/mongo_to_s3.rst.txt | 59 +
.../operators/transfer/redshift_to_s3.rst.txt | 59 +
.../_sources/operators/transfer/s3_to_ftp.rst.txt | 54 +
.../operators/transfer/s3_to_redshift.rst.txt | 67 +
.../_sources/operators/transfer/s3_to_sftp.rst.txt | 55 +
.../_sources/operators/transfer/s3_to_sql.rst.txt | 65 +
.../operators/transfer/salesforce_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/sftp_to_s3.rst.txt | 54 +
.../_sources/operators/transfer/sql_to_s3.rst.txt | 56 +
.../secrets-backends/aws-secrets-manager.rst.txt | 137 +
.../aws-ssm-parameter-store.rst.txt | 103 +
.../7.2.1/_sources/secrets-backends/index.rst.txt | 27 +
.../7.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../7.2.1/_static/_gen/css/main.min.css | 7 +
.../7.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../7.2.1/_static/basic.css | 899 +
.../7.2.1/_static/check-solid.svg | 4 +
.../7.2.1/_static/clipboard.min.js | 7 +
.../7.2.1/_static/copy-button.svg | 5 +
.../7.2.1/_static/copybutton.css | 94 +
.../7.2.1/_static/copybutton.js | 248 +
.../7.2.1/_static/copybutton_funcs.js | 73 +
.../7.2.1/_static/doctools.js | 156 +
.../7.2.1/_static/documentation_options.js | 14 +
.../7.2.1/_static/file.png | Bin 0 -> 286 bytes
.../7.2.1/_static/graphviz.css | 19 +
.../7.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../7.2.1/_static/jquery.js | 2 +
.../7.2.1/_static/js/globaltoc.js | 24 +
.../7.2.1/_static/language_data.js | 199 +
.../7.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../7.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../7.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../7.2.1/_static/pygments.css | 74 +
.../7.2.1/_static/searchtools.js | 566 +
.../7.2.1/_static/sphinx_highlight.js | 144 +
.../7.2.1/_static/underscore-1.13.1.js | 2042 +++
.../7.2.1/_static/underscore.js | 6 +
.../7.2.1/commits.html | 4623 +++++
.../7.2.1/connections/aws.html} | 760 +-
.../7.2.1/connections/emr.html} | 180 +-
.../7.2.1/connections/index.html} | 169 +-
.../7.2.1/connections/redshift.html} | 221 +-
.../7.2.1/example-dags.html} | 211 +-
.../7.2.1/genindex.html | 6356 +++++++
.../7.2.1/index.html | 2050 +++
.../7.2.1/installing-providers-from-sources.html} | 259 +-
.../7.2.1/logging/cloud-watch-task-handlers.html} | 177 +-
.../7.2.1/logging/index.html} | 168 +-
.../7.2.1/logging/s3-task-handler.html} | 216 +-
.../7.2.1/objects.inv | Bin 0 -> 22275 bytes
.../7.2.1/operators/appflow.html} | 265 +-
.../7.2.1/operators/athena.html} | 233 +-
.../7.2.1/operators/batch.html} | 227 +-
.../7.2.1/operators/cloudformation.html} | 206 +-
.../7.2.1/operators/datasync.html} | 241 +-
.../7.2.1/operators/dms.html} | 247 +-
.../7.2.1/operators/ec2.html} | 189 +-
.../7.2.1/operators/ecs.html} | 462 +-
.../7.2.1/operators/eks.html} | 468 +-
.../7.2.1/operators/emr.html} | 399 +-
.../7.2.1/operators/emr_eks.html} | 241 +-
.../7.2.1/operators/emr_serverless.html} | 224 +-
.../7.2.1/operators/glacier.html} | 187 +-
.../7.2.1/operators/glue.html} | 221 +-
.../7.2.1/operators/google_api_to_s3_transfer.html | 1 +
.../7.2.1/operators/imap_attachment_to_s3.html | 1 +
.../7.2.1/operators/index.html} | 192 +-
.../7.2.1/operators/lambda.html} | 198 +-
.../7.2.1/operators/quicksight.html} | 229 +-
.../7.2.1/operators/rds.html} | 441 +-
.../7.2.1/operators/redshift_cluster.html} | 323 +-
.../7.2.1/operators/redshift_data.html} | 218 +-
.../7.2.1/operators/redshift_sql.html} | 217 +-
.../7.2.1/operators/s3.html} | 470 +-
.../7.2.1/operators/s3_to_redshift.html | 1 +
.../7.2.1/operators/sagemaker.html} | 495 +-
.../7.2.1/operators/salesforce_to_s3.html | 1 +
.../7.2.1/operators/sns.html} | 205 +-
.../7.2.1/operators/sqs.html} | 197 +-
.../7.2.1/operators/sqs_publish.html | 1 +
.../7.2.1/operators/step_functions.html} | 186 +-
.../7.2.1/operators/transfer/dynamodb_to_s3.html} | 284 +-
.../7.2.1/operators/transfer/ftp_to_s3.html} | 249 +-
.../7.2.1/operators/transfer/gcs_to_s3.html} | 248 +-
.../7.2.1/operators/transfer/glacier_to_gcs.html} | 258 +-
.../operators/transfer/google_api_to_s3.html} | 308 +-
.../operators/transfer/hive_to_dynamodb.html} | 253 +-
.../operators/transfer/imap_attachment_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/index.html} | 227 +-
.../7.2.1/operators/transfer/local_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/mongo_to_s3.html} | 258 +-
.../7.2.1/operators/transfer/redshift_to_s3.html} | 255 +-
.../7.2.1/operators/transfer/s3_to_ftp.html} | 254 +-
.../7.2.1/operators/transfer/s3_to_redshift.html} | 271 +-
.../7.2.1/operators/transfer/s3_to_sftp.html} | 250 +-
.../7.2.1/operators/transfer/s3_to_sql.html} | 286 +-
.../operators/transfer/salesforce_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/sftp_to_s3.html} | 249 +-
.../7.2.1/operators/transfer/sql_to_s3.html} | 253 +-
.../7.2.1/py-modindex.html} | 1390 +-
.../7.2.1/search.html} | 255 +-
.../7.2.1/searchindex.js | 1 +
.../secrets-backends/aws-secrets-manager.html} | 201 +-
.../secrets-backends/aws-ssm-parameter-store.html} | 163 +-
.../7.2.1/secrets-backends/index.html} | 166 +-
.../apache-airflow-providers-amazon/stable.txt | 2 +-
.../4.3.0/.buildinfo | 4 +
.../providers/apache/beam/hooks/beam}/index.html | 375 +-
.../providers/apache/beam/hooks/index.html} | 205 +-
.../_api/airflow/providers/apache/beam/index.html} | 208 +-
.../apache/beam/operators/beam}/index.html | 617 +-
.../providers/apache/beam/operators/index.html} | 205 +-
.../providers/apache/beam/example_beam/index.html} | 228 +-
.../beam/example_beam_java_flink/index.html} | 228 +-
.../beam/example_beam_java_spark/index.html} | 228 +-
.../providers/apache/beam/example_go/index.html} | 228 +-
.../apache/beam/example_go_dataflow/index.html} | 228 +-
.../apache/beam/example_java_dataflow/index.html} | 228 +-
.../apache/beam/example_python/index.html} | 228 +-
.../beam/example_python_dataflow/index.html} | 228 +-
.../tests/system/providers/apache/beam/index.html} | 213 +-
.../system/providers/apache/beam/utils}/index.html | 351 +-
.../airflow/providers/apache/beam/hooks/beam.html} | 628 +-
.../providers/apache/beam/operators/beam.html | 1593 ++
.../4.3.0/_modules/index.html} | 192 +-
.../providers/apache/beam/example_beam.html} | 230 +-
.../apache/beam/example_beam_java_flink.html} | 229 +-
.../apache/beam/example_beam_java_spark.html} | 229 +-
.../system/providers/apache/beam/example_go.html} | 272 +-
.../apache/beam/example_go_dataflow.html} | 244 +-
.../apache/beam/example_java_dataflow.html} | 234 +-
.../providers/apache/beam/example_python.html} | 288 +-
.../apache/beam/example_python_dataflow.html} | 247 +-
.../tests/system/providers/apache/beam/utils.html} | 273 +-
.../providers/apache/beam/hooks/beam/index.rst.txt | 189 +
.../providers/apache/beam/hooks/index.rst.txt | 15 +
.../airflow/providers/apache/beam/index.rst.txt | 16 +
.../apache/beam/operators/beam/index.rst.txt | 286 +
.../providers/apache/beam/operators/index.rst.txt | 15 +
.../apache/beam/example_beam/index.rst.txt | 22 +
.../beam/example_beam_java_flink/index.rst.txt | 22 +
.../beam/example_beam_java_spark/index.rst.txt | 22 +
.../providers/apache/beam/example_go/index.rst.txt | 22 +
.../apache/beam/example_go_dataflow/index.rst.txt | 22 +
.../beam/example_java_dataflow/index.rst.txt | 22 +
.../apache/beam/example_python/index.rst.txt | 22 +
.../beam/example_python_dataflow/index.rst.txt | 22 +
.../system/providers/apache/beam/index.rst.txt | 23 +
.../providers/apache/beam/utils/index.rst.txt | 122 +
.../4.3.0/_sources/commits.rst.txt | 250 +
.../4.3.0/_sources/index.rst.txt | 119 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.3.0/_sources/operators.rst.txt | 164 +
.../4.3.0/_static/_gen/css/main-custom.min.css | 1 +
.../4.3.0/_static/_gen/css/main.min.css | 7 +
.../4.3.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.3.0/_static/basic.css | 899 +
.../4.3.0/_static/check-solid.svg | 4 +
.../4.3.0/_static/clipboard.min.js | 7 +
.../4.3.0/_static/copy-button.svg | 5 +
.../4.3.0/_static/copybutton.css | 94 +
.../4.3.0/_static/copybutton.js | 248 +
.../4.3.0/_static/copybutton_funcs.js | 73 +
.../4.3.0/_static/doctools.js | 156 +
.../4.3.0/_static/documentation_options.js | 14 +
.../4.3.0/_static/file.png | Bin 0 -> 286 bytes
.../4.3.0/_static/graphviz.css | 19 +
.../4.3.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.3.0/_static/jquery.js | 2 +
.../4.3.0/_static/js/globaltoc.js | 24 +
.../4.3.0/_static/language_data.js | 199 +
.../4.3.0/_static/minus.png | Bin 0 -> 90 bytes
.../4.3.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.3.0/_static/plus.png | Bin 0 -> 90 bytes
.../4.3.0/_static/pygments.css | 74 +
.../4.3.0/_static/searchtools.js | 566 +
.../4.3.0/_static/sphinx_highlight.js | 144 +
.../4.3.0/_static/underscore-1.13.1.js | 2042 +++
.../4.3.0/_static/underscore.js | 6 +
.../4.3.0/commits.html} | 810 +-
.../4.3.0/genindex.html} | 677 +-
.../4.3.0/index.html} | 570 +-
.../4.3.0/installing-providers-from-sources.html} | 259 +-
.../4.3.0/objects.inv | Bin 0 -> 1580 bytes
.../4.3.0/operators.html} | 506 +-
.../4.3.0/py-modindex.html} | 332 +-
.../4.3.0/search.html} | 247 +-
.../4.3.0/searchindex.js | 1 +
.../stable.txt | 2 +-
.../flink/operators/flink_kubernetes/index.html | 2 +-
.../flink/sensors/flink_kubernetes/index.html | 2 +-
.../5.1.3/.buildinfo | 4 +
.../providers/apache/hive/hooks/hive}/index.html | 947 +-
.../providers/apache/hive/hooks/index.html} | 203 +-
.../_api/airflow/providers/apache/hive/index.html} | 235 +-
.../providers/apache/hive/macros/hive}/index.html | 157 +-
.../providers/apache/hive/macros/index.html} | 203 +-
.../apache/hive/operators/hive}/index.html | 193 +-
.../apache/hive/operators/hive_stats}/index.html | 133 +-
.../providers/apache/hive/operators/index.html} | 204 +-
.../providers/apache/hive/plugins/hive}/index.html | 108 +-
.../providers/apache/hive/plugins/index.html} | 203 +-
.../apache/hive/sensors/hive_partition}/index.html | 109 +-
.../providers/apache/hive/sensors/index.html} | 205 +-
.../hive/sensors/metastore_partition}/index.html | 111 +-
.../hive/sensors/named_hive_partition}/index.html | 125 +-
.../hive/transfers/hive_to_mysql}/index.html | 132 +-
.../hive/transfers/hive_to_samba}/index.html | 112 +-
.../providers/apache/hive/transfers/index.html} | 208 +-
.../hive/transfers/mssql_to_hive}/index.html | 158 +-
.../hive/transfers/mysql_to_hive}/index.html | 163 +-
.../apache/hive/transfers/s3_to_hive}/index.html | 179 +-
.../hive/transfers/vertica_to_hive}/index.html | 158 +-
.../apache/hive/example_twitter_dag}/index.html | 196 +-
.../tests/system/providers/apache/hive/index.html} | 203 +-
.../airflow/providers/apache/hive/hooks/hive.html | 1868 ++
.../providers/apache/hive/macros/hive.html} | 288 +-
.../providers/apache/hive/operators/hive.html} | 445 +-
.../apache/hive/operators/hive_stats.html} | 454 +-
.../providers/apache/hive/plugins/hive.html} | 255 +-
.../apache/hive/sensors/hive_partition.html} | 244 +-
.../apache/hive/sensors/metastore_partition.html} | 253 +-
.../apache/hive/sensors/named_hive_partition.html} | 286 +-
.../apache/hive/transfers/hive_to_mysql.html} | 306 +-
.../apache/hive/transfers/hive_to_samba.html} | 240 +-
.../apache/hive/transfers/mssql_to_hive.html} | 312 +-
.../apache/hive/transfers/mysql_to_hive.html} | 342 +-
.../apache/hive/transfers/s3_to_hive.html} | 514 +-
.../apache/hive/transfers/vertica_to_hive.html} | 315 +-
.../5.1.3/_modules/index.html} | 194 +-
.../apache/hive/example_twitter_dag.html} | 345 +-
.../providers/apache/hive/hooks/hive/index.rst.txt | 446 +
.../providers/apache/hive/hooks/index.rst.txt | 15 +
.../airflow/providers/apache/hive/index.rst.txt | 20 +
.../apache/hive/macros/hive/index.rst.txt | 58 +
.../providers/apache/hive/macros/index.rst.txt | 15 +
.../apache/hive/operators/hive/index.rst.txt | 108 +
.../apache/hive/operators/hive_stats/index.rst.txt | 73 +
.../providers/apache/hive/operators/index.rst.txt | 16 +
.../apache/hive/plugins/hive/index.rst.txt | 35 +
.../providers/apache/hive/plugins/index.rst.txt | 15 +
.../hive/sensors/hive_partition/index.rst.txt | 55 +
.../providers/apache/hive/sensors/index.rst.txt | 17 +
.../hive/sensors/metastore_partition/index.rst.txt | 54 +
.../sensors/named_hive_partition/index.rst.txt | 63 +
.../hive/transfers/hive_to_mysql/index.rst.txt | 81 +
.../hive/transfers/hive_to_samba/index.rst.txt | 62 +
.../providers/apache/hive/transfers/index.rst.txt | 20 +
.../hive/transfers/mssql_to_hive/index.rst.txt | 91 +
.../hive/transfers/mysql_to_hive/index.rst.txt | 96 +
.../apache/hive/transfers/s3_to_hive/index.rst.txt | 102 +
.../hive/transfers/vertica_to_hive/index.rst.txt | 91 +
.../apache/hive/example_twitter_dag/index.rst.txt | 80 +
.../system/providers/apache/hive/index.rst.txt | 15 +
.../5.1.3/_sources/commits.rst.txt | 464 +
.../5.1.3/_sources/connections/hive_cli.rst.txt | 91 +
.../_sources/connections/hive_metastore.rst.txt | 69 +
.../5.1.3/_sources/connections/hiveserver2.rst.txt | 78 +
.../5.1.3/_sources/connections/index.rst.txt | 25 +
.../5.1.3/_sources/index.rst.txt | 133 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.1.3/_sources/macros.rst.txt | 26 +
.../5.1.3/_sources/operators.rst.txt | 40 +
.../5.1.3/_static/_gen/css/main-custom.min.css | 1 +
.../5.1.3/_static/_gen/css/main.min.css | 7 +
.../5.1.3/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.1.3/_static/basic.css | 899 +
.../5.1.3/_static/check-solid.svg | 4 +
.../5.1.3/_static/clipboard.min.js | 7 +
.../5.1.3/_static/copy-button.svg | 5 +
.../5.1.3/_static/copybutton.css | 94 +
.../5.1.3/_static/copybutton.js | 248 +
.../5.1.3/_static/copybutton_funcs.js | 73 +
.../5.1.3/_static/doctools.js | 156 +
.../5.1.3/_static/documentation_options.js | 14 +
.../5.1.3/_static/file.png | Bin 0 -> 286 bytes
.../5.1.3/_static/graphviz.css | 19 +
.../5.1.3/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.1.3/_static/jquery.js | 2 +
.../5.1.3/_static/js/globaltoc.js | 24 +
.../5.1.3/_static/language_data.js | 199 +
.../5.1.3/_static/minus.png | Bin 0 -> 90 bytes
.../5.1.3/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.1.3/_static/plus.png | Bin 0 -> 90 bytes
.../5.1.3/_static/pygments.css | 74 +
.../5.1.3/_static/searchtools.js | 566 +
.../5.1.3/_static/sphinx_highlight.js | 144 +
.../5.1.3/_static/underscore-1.13.1.js | 2042 +++
.../5.1.3/_static/underscore.js | 6 +
.../5.1.3/commits.html | 2085 +++
.../5.1.3/connections/hive_cli.html} | 199 +-
.../5.1.3/connections/hive_metastore.html} | 182 +-
.../5.1.3/connections/hiveserver2.html} | 188 +-
.../5.1.3/connections/index.html} | 159 +-
.../5.1.3/genindex.html} | 944 +-
.../5.1.3/index.html} | 712 +-
.../5.1.3/installing-providers-from-sources.html} | 249 +-
.../5.1.3/macros.html} | 251 +-
.../5.1.3/objects.inv | Bin 0 -> 2081 bytes
.../5.1.3/operators.html} | 218 +-
.../5.1.3/py-modindex.html} | 370 +-
.../5.1.3/search.html} | 245 +-
.../5.1.3/searchindex.js | 1 +
.../stable.txt | 2 +-
.../providers/apache/livy/hooks/livy/index.html | 2 +-
.../3.1.1/.buildinfo | 4 +
.../providers/apache/sqoop/hooks/index.html} | 191 +-
.../providers/apache/sqoop/hooks/sqoop}/index.html | 268 +-
.../airflow/providers/apache/sqoop/index.html} | 194 +-
.../providers/apache/sqoop/operators/index.html} | 191 +-
.../apache/sqoop/operators/sqoop}/index.html | 185 +-
.../providers/apache/sqoop/hooks/sqoop.html} | 654 +-
.../providers/apache/sqoop/operators/sqoop.html} | 517 +-
.../3.1.1/_modules/index.html} | 169 +-
.../providers/apache/sqoop/hooks/index.rst.txt | 15 +
.../apache/sqoop/hooks/sqoop/index.rst.txt | 154 +
.../airflow/providers/apache/sqoop/index.rst.txt | 16 +
.../providers/apache/sqoop/operators/index.rst.txt | 15 +
.../apache/sqoop/operators/sqoop/index.rst.txt | 109 +
.../3.1.1/_sources/commits.rst.txt | 241 +
.../3.1.1/_sources/index.rst.txt | 78 +
.../installing-providers-from-sources.rst.txt | 18 +
.../3.1.1/_sources/operators.rst.txt | 38 +
.../3.1.1/_static/_gen/css/main-custom.min.css | 1 +
.../3.1.1/_static/_gen/css/main.min.css | 7 +
.../3.1.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../3.1.1/_static/basic.css | 899 +
.../3.1.1/_static/check-solid.svg | 4 +
.../3.1.1/_static/clipboard.min.js | 7 +
.../3.1.1/_static/copy-button.svg | 5 +
.../3.1.1/_static/copybutton.css | 94 +
.../3.1.1/_static/copybutton.js | 248 +
.../3.1.1/_static/copybutton_funcs.js | 73 +
.../3.1.1/_static/doctools.js | 156 +
.../3.1.1/_static/documentation_options.js | 14 +
.../3.1.1/_static/file.png | Bin 0 -> 286 bytes
.../3.1.1/_static/graphviz.css | 19 +
.../3.1.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../3.1.1/_static/jquery.js | 2 +
.../3.1.1/_static/js/globaltoc.js | 24 +
.../3.1.1/_static/language_data.js | 199 +
.../3.1.1/_static/minus.png | Bin 0 -> 90 bytes
.../3.1.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../3.1.1/_static/plus.png | Bin 0 -> 90 bytes
.../3.1.1/_static/pygments.css | 74 +
.../3.1.1/_static/searchtools.js | 566 +
.../3.1.1/_static/sphinx_highlight.js | 144 +
.../3.1.1/_static/underscore-1.13.1.js | 2042 +++
.../3.1.1/_static/underscore.js | 6 +
.../3.1.1/commits.html} | 774 +-
.../3.1.1/genindex.html} | 385 +-
.../3.1.1/index.html} | 401 +-
.../3.1.1/installing-providers-from-sources.html} | 249 +-
.../3.1.1/objects.inv | Bin 0 -> 680 bytes
.../3.1.1/operators.html} | 201 +-
.../3.1.1/py-modindex.html} | 258 +-
.../3.1.1/search.html} | 233 +-
.../3.1.1/searchindex.js | 1 +
.../stable.txt | 2 +-
.../5.2.1/.buildinfo | 4 +
.../cncf/kubernetes/decorators/index.html} | 201 +-
.../kubernetes/decorators/kubernetes/index.html} | 238 +-
.../providers/cncf/kubernetes/hooks/index.html} | 201 +-
.../cncf/kubernetes/hooks/kubernetes}/index.html | 564 +-
.../airflow/providers/cncf/kubernetes/index.html} | 234 +-
.../cncf/kubernetes/operators/index.html} | 202 +-
.../operators/kubernetes_pod}/index.html | 621 +-
.../operators/spark_kubernetes}/index.html | 109 +-
.../python_kubernetes_script}/index.html | 140 +-
.../providers/cncf/kubernetes/sensors/index.html} | 201 +-
.../sensors/spark_kubernetes}/index.html | 102 +-
.../providers/cncf/kubernetes/triggers/index.html} | 201 +-
.../kubernetes/triggers/kubernetes_pod}/index.html | 200 +-
.../providers/cncf/kubernetes/utils/index.html} | 202 +-
.../cncf/kubernetes/utils/pod_manager}/index.html | 518 +-
.../cncf/kubernetes/utils/xcom_sidecar}/index.html | 153 +-
.../cncf/kubernetes/example_kubernetes}/index.html | 254 +-
.../example_kubernetes_async}/index.html | 223 +-
.../example_kubernetes_decorator/index.html} | 251 +-
.../example_spark_kubernetes}/index.html | 142 +-
.../system/providers/cncf/kubernetes/index.html} | 204 +-
.../cncf/kubernetes/decorators/kubernetes.html} | 339 +-
.../cncf/kubernetes/hooks/kubernetes.html} | 804 +-
.../cncf/kubernetes/operators/kubernetes_pod.html | 1686 ++
.../kubernetes/operators/spark_kubernetes.html} | 242 +-
.../cncf/kubernetes/python_kubernetes_script.html} | 298 +-
.../cncf/kubernetes/sensors/spark_kubernetes.html} | 303 +-
.../cncf/kubernetes/triggers/kubernetes_pod.html} | 493 +-
.../cncf/kubernetes/utils/pod_manager.html} | 644 +-
.../cncf/kubernetes/utils/xcom_sidecar.html} | 225 +-
.../5.2.1/_modules/index.html} | 190 +-
.../cncf/kubernetes/example_kubernetes.html} | 355 +-
.../cncf/kubernetes/example_kubernetes_async.html} | 359 +-
.../kubernetes/example_kubernetes_decorator.html} | 234 +-
.../cncf/kubernetes/example_spark_kubernetes.html} | 248 +-
.../cncf/kubernetes/decorators/index.rst.txt | 15 +
.../kubernetes/decorators/kubernetes/index.rst.txt | 33 +
.../providers/cncf/kubernetes/hooks/index.rst.txt | 15 +
.../cncf/kubernetes/hooks/kubernetes/index.rst.txt | 232 +
.../providers/cncf/kubernetes/index.rst.txt | 29 +
.../cncf/kubernetes/operators/index.rst.txt | 16 +
.../operators/kubernetes_pod/index.rst.txt | 253 +
.../operators/spark_kubernetes/index.rst.txt | 63 +
.../python_kubernetes_script/index.rst.txt | 43 +
.../cncf/kubernetes/sensors/index.rst.txt | 15 +
.../sensors/spark_kubernetes/index.rst.txt | 60 +
.../cncf/kubernetes/triggers/index.rst.txt | 15 +
.../triggers/kubernetes_pod/index.rst.txt | 94 +
.../providers/cncf/kubernetes/utils/index.rst.txt | 16 +
.../kubernetes/utils/pod_manager/index.rst.txt | 196 +
.../kubernetes/utils/xcom_sidecar/index.rst.txt | 71 +
.../kubernetes/example_kubernetes/index.rst.txt | 79 +
.../example_kubernetes_async/index.rst.txt | 79 +
.../example_kubernetes_decorator/index.rst.txt | 34 +
.../example_spark_kubernetes/index.rst.txt | 37 +
.../system/providers/cncf/kubernetes/index.rst.txt | 18 +
.../5.2.1/_sources/commits.rst.txt | 622 +
.../5.2.1/_sources/connections/kubernetes.rst.txt | 84 +
.../5.2.1/_sources/index.rst.txt | 96 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.2.1/_sources/operators.rst.txt | 175 +
.../5.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../5.2.1/_static/_gen/css/main.min.css | 7 +
.../5.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.2.1/_static/basic.css | 899 +
.../5.2.1/_static/check-solid.svg | 4 +
.../5.2.1/_static/clipboard.min.js | 7 +
.../5.2.1/_static/copy-button.svg | 5 +
.../5.2.1/_static/copybutton.css | 94 +
.../5.2.1/_static/copybutton.js | 248 +
.../5.2.1/_static/copybutton_funcs.js | 73 +
.../5.2.1/_static/doctools.js | 156 +
.../5.2.1/_static/documentation_options.js | 14 +
.../5.2.1/_static/file.png | Bin 0 -> 286 bytes
.../5.2.1/_static/graphviz.css | 19 +
.../5.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.2.1/_static/jquery.js | 2 +
.../5.2.1/_static/js/globaltoc.js | 24 +
.../5.2.1/_static/language_data.js | 199 +
.../5.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pygments.css | 74 +
.../5.2.1/_static/searchtools.js | 566 +
.../5.2.1/_static/sphinx_highlight.js | 144 +
.../5.2.1/_static/underscore-1.13.1.js | 2042 +++
.../5.2.1/_static/underscore.js | 6 +
.../5.2.1/commits.html | 2635 +++
.../5.2.1/connections/index.html | 1 +
.../5.2.1/connections/kubernetes.html} | 195 +-
.../5.2.1/genindex.html} | 1046 +-
.../5.2.1/index.html | 1677 ++
.../5.2.1/installing-providers-from-sources.html} | 247 +-
.../5.2.1/objects.inv | Bin 0 -> 2514 bytes
.../5.2.1/operators.html} | 482 +-
.../5.2.1/py-modindex.html} | 358 +-
.../5.2.1/search.html} | 243 +-
.../5.2.1/searchindex.js | 1 +
.../stable.txt | 2 +-
.../providers/dbt/cloud/hooks/dbt/index.html | 2 +-
.../providers/dingding/hooks/dingding/index.html | 2 +-
.../discord/hooks/discord_webhook/index.html | 2 +-
.../discord/operators/discord_webhook/index.html | 2 +-
.../3.5.1/.buildinfo | 4 +
.../providers/docker/decorators/docker}/index.html | 108 +-
.../providers/docker/decorators/index.html} | 195 +-
.../providers/docker/hooks/docker}/index.html | 196 +-
.../airflow/providers/docker/hooks/index.html} | 195 +-
.../_api/airflow/providers/docker/index.html} | 203 +-
.../providers/docker/operators/docker}/index.html | 315 +-
.../docker/operators/docker_swarm}/index.html | 162 +-
.../airflow/providers/docker/operators/index.html} | 196 +-
.../providers/docker/example_docker}/index.html | 141 +-
.../docker/example_docker_copy_data}/index.html | 154 +-
.../docker/example_docker_swarm}/index.html | 137 +-
.../_api/tests/system/providers/docker/index.html} | 197 +-
.../providers/docker/decorators/docker.html} | 409 +-
.../airflow/providers/docker/hooks/docker.html} | 525 +-
.../providers/docker/operators/docker.html} | 775 +-
.../providers/docker/operators/docker_swarm.html} | 449 +-
.../3.5.1/_modules/index.html} | 178 +-
.../system/providers/docker/example_docker.html} | 284 +-
.../docker/example_docker_copy_data.html} | 319 +-
.../providers/docker/example_docker_swarm.html} | 273 +-
.../docker/decorators/docker/index.rst.txt | 29 +
.../providers/docker/decorators/index.rst.txt | 15 +
.../providers/docker/hooks/docker/index.rst.txt | 102 +
.../airflow/providers/docker/hooks/index.rst.txt | 15 +
.../_api/airflow/providers/docker/index.rst.txt | 17 +
.../docker/operators/docker/index.rst.txt | 212 +
.../docker/operators/docker_swarm/index.rst.txt | 105 +
.../providers/docker/operators/index.rst.txt | 16 +
.../providers/docker/example_docker/index.rst.txt | 26 +
.../docker/example_docker_copy_data/index.rst.txt | 53 +
.../docker/example_docker_swarm/index.rst.txt | 26 +
.../tests/system/providers/docker/index.rst.txt | 17 +
.../3.5.1/_sources/commits.rst.txt | 442 +
.../3.5.1/_sources/connections/docker.rst.txt | 70 +
.../3.5.1/_sources/decorators/docker.rst.txt | 130 +
.../3.5.1/_sources/index.rst.txt | 88 +
.../installing-providers-from-sources.rst.txt | 18 +
.../3.5.1/_static/_gen/css/main-custom.min.css | 1 +
.../3.5.1/_static/_gen/css/main.min.css | 7 +
.../3.5.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../3.5.1/_static/basic.css | 899 +
.../3.5.1/_static/check-solid.svg | 4 +
.../3.5.1/_static/clipboard.min.js | 7 +
.../3.5.1/_static/copy-button.svg | 5 +
.../3.5.1/_static/copybutton.css | 94 +
.../3.5.1/_static/copybutton.js | 248 +
.../3.5.1/_static/copybutton_funcs.js | 73 +
.../3.5.1/_static/doctools.js | 156 +
.../3.5.1/_static/documentation_options.js | 14 +
.../3.5.1/_static/file.png | Bin 0 -> 286 bytes
.../3.5.1/_static/graphviz.css | 19 +
.../3.5.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../3.5.1/_static/jquery.js | 2 +
.../3.5.1/_static/js/globaltoc.js | 24 +
.../3.5.1/_static/language_data.js | 199 +
.../3.5.1/_static/minus.png | Bin 0 -> 90 bytes
.../3.5.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../3.5.1/_static/plus.png | Bin 0 -> 90 bytes
.../3.5.1/_static/pygments.css | 74 +
.../3.5.1/_static/searchtools.js | 566 +
.../3.5.1/_static/sphinx_highlight.js | 144 +
.../3.5.1/_static/underscore-1.13.1.js | 2042 +++
.../3.5.1/_static/underscore.js | 6 +
.../3.5.1/commits.html | 2009 +++
.../3.5.1/connections/docker.html} | 176 +-
.../3.5.1/decorators/docker.html} | 274 +-
.../3.5.1/genindex.html} | 530 +-
.../3.5.1/index.html} | 681 +-
.../3.5.1/installing-providers-from-sources.html} | 253 +-
.../3.5.1/objects.inv | Bin 0 -> 1107 bytes
.../3.5.1/py-modindex.html} | 307 +-
.../3.5.1/search.html} | 237 +-
.../3.5.1/searchindex.js | 1 +
.../apache-airflow-providers-docker/stable.txt | 2 +-
.../8.10.0/.buildinfo | 4 +
.../providers/google/ads/hooks/ads}/index.html | 224 +-
.../airflow/providers/google/ads/hooks/index.html} | 213 +-
.../_api/airflow/providers/google/ads/index.html} | 218 +-
.../providers/google/ads/operators/ads}/index.html | 143 +-
.../providers/google/ads/operators/index.html} | 213 +-
.../google/ads/transfers/ads_to_gcs}/index.html | 145 +-
.../providers/google/ads/transfers/index.html} | 213 +-
.../google/cloud/hooks/automl}/index.html | 671 +-
.../google/cloud/hooks/bigquery/index.html | 2898 ++++
.../google/cloud/hooks/bigquery_dts}/index.html | 345 +-
.../google/cloud/hooks/bigtable}/index.html | 305 +-
.../google/cloud/hooks/cloud_build}/index.html | 619 +-
.../google/cloud/hooks/cloud_composer}/index.html | 555 +-
.../cloud/hooks/cloud_memorystore}/index.html | 960 +-
.../google/cloud/hooks/cloud_sql}/index.html | 1007 +-
.../cloud_storage_transfer_service/index.html | 1775 ++
.../google/cloud/hooks/compute}/index.html | 716 +-
.../google/cloud/hooks/compute_ssh}/index.html | 173 +-
.../google/cloud/hooks/datacatalog/index.html | 1558 ++
.../google/cloud/hooks/dataflow}/index.html | 906 +-
.../google/cloud/hooks/dataform}/index.html | 583 +-
.../google/cloud/hooks/datafusion}/index.html | 614 +-
.../google/cloud/hooks/dataplex}/index.html | 321 +-
.../google/cloud/hooks/dataprep}/index.html | 352 +-
.../google/cloud/hooks/dataproc/index.html | 2103 +++
.../cloud/hooks/dataproc_metastore}/index.html | 656 +-
.../google/cloud/hooks/datastore}/index.html | 409 +-
.../providers/google/cloud/hooks/dlp/index.html | 1780 ++
.../google/cloud/hooks/functions}/index.html | 291 +-
.../providers/google/cloud/hooks/gcs}/index.html | 982 +-
.../providers/google/cloud/hooks/gdm}/index.html | 147 +-
.../providers/google/cloud/hooks}/index.html | 218 +-
.../providers/google/cloud/hooks/kms}/index.html | 211 +-
.../cloud/hooks/kubernetes_engine}/index.html | 357 +-
.../google/cloud/hooks/life_sciences}/index.html | 180 +-
.../google/cloud/hooks/looker}/index.html | 382 +-
.../google/cloud/hooks/mlengine}/index.html | 511 +-
.../cloud/hooks/natural_language}/index.html | 281 +-
.../google/cloud/hooks/os_login}/index.html | 152 +-
.../google/cloud/hooks/pubsub}/index.html | 556 +-
.../google/cloud/hooks/secret_manager}/index.html | 155 +-
.../google/cloud/hooks/spanner}/index.html | 351 +-
.../google/cloud/hooks/speech_to_text}/index.html | 157 +-
.../google/cloud/hooks/stackdriver}/index.html | 545 +-
.../providers/google/cloud/hooks/tasks}/index.html | 637 +-
.../google/cloud/hooks/text_to_speech}/index.html | 168 +-
.../google/cloud/hooks/translate}/index.html | 175 +-
.../cloud/hooks/vertex_ai/auto_ml/index.html | 1670 ++
.../vertex_ai/batch_prediction_job}/index.html | 435 +-
.../cloud/hooks/vertex_ai/custom_job/index.html | 2205 +++
.../cloud/hooks/vertex_ai/dataset}/index.html | 573 +-
.../hooks/vertex_ai/endpoint_service}/index.html | 568 +-
.../hyperparameter_tuning_job}/index.html | 583 +-
.../google/cloud/hooks/vertex_ai/index.html} | 228 +-
.../hooks/vertex_ai/model_service}/index.html | 348 +-
.../cloud/hooks/video_intelligence}/index.html | 163 +-
.../google/cloud/hooks/vision}/index.html | 629 +-
.../google/cloud/hooks/workflows}/index.html | 514 +-
.../airflow/providers/google/cloud}/index.html | 701 +-
.../google/cloud/links/automl}/index.html | 394 +-
.../providers/google/cloud/links/base}/index.html | 166 +-
.../google/cloud/links/bigquery}/index.html | 234 +-
.../google/cloud/links/bigquery_dts}/index.html | 163 +-
.../google/cloud/links/bigtable}/index.html | 283 +-
.../google/cloud/links/cloud_build}/index.html | 337 +-
.../google/cloud/links/cloud_functions}/index.html | 234 +-
.../cloud/links/cloud_memorystore}/index.html | 338 +-
.../google/cloud/links/cloud_sql}/index.html | 234 +-
.../cloud/links/cloud_storage_transfer}/index.html | 306 +-
.../google/cloud/links/cloud_tasks}/index.html | 226 +-
.../google/cloud/links/compute}/index.html | 284 +-
.../cloud/links/data_loss_prevention/index.html | 1526 ++
.../google/cloud/links/datacatalog}/index.html | 284 +-
.../google/cloud/links/dataflow}/index.html | 163 +-
.../google/cloud/links/dataform}/index.html | 284 +-
.../google/cloud/links/datafusion}/index.html | 334 +-
.../google/cloud/links/dataplex}/index.html | 284 +-
.../google/cloud/links/dataprep}/index.html | 233 +-
.../google/cloud/links/dataproc}/index.html | 302 +-
.../google/cloud/links/datastore}/index.html | 243 +-
.../providers/google/cloud/links}/index.html | 170 +-
.../cloud/links/kubernetes_engine}/index.html | 233 +-
.../google/cloud/links/life_sciences}/index.html | 162 +-
.../google/cloud/links/mlengine}/index.html | 394 +-
.../google/cloud/links/pubsub}/index.html | 234 +-
.../google/cloud/links/spanner}/index.html | 234 +-
.../google/cloud/links/stackdriver}/index.html | 234 +-
.../google/cloud/links/vertex_ai/index.html | 1580 ++
.../google/cloud/links/workflows}/index.html | 284 +-
.../google/cloud/log/gcs_task_handler}/index.html | 230 +-
.../airflow/providers/google/cloud/log/index.html} | 214 +-
.../cloud/log/stackdriver_task_handler}/index.html | 316 +-
.../google/cloud/operators/automl/index.html | 1848 ++
.../google/cloud/operators/bigquery/index.html | 3052 ++++
.../cloud/operators/bigquery_dts}/index.html | 306 +-
.../google/cloud/operators/bigtable}/index.html | 706 +-
.../google/cloud/operators/cloud_build/index.html | 1753 ++
.../cloud/operators/cloud_composer}/index.html | 975 +-
.../cloud/operators/cloud_memorystore/index.html | 2227 +++
.../google/cloud/operators/cloud_sql/index.html | 1704 ++
.../cloud_storage_transfer_service/index.html | 1688 ++
.../google/cloud/operators/compute/index.html | 1887 +++
.../google/cloud/operators/datacatalog/index.html | 2481 +++
.../google/cloud/operators/dataflow/index.html | 1882 +++
.../google/cloud/operators/dataform/index.html | 1739 ++
.../google/cloud/operators/datafusion/index.html | 1632 ++
.../google/cloud/operators/dataplex}/index.html | 679 +-
.../google/cloud/operators/dataprep}/index.html | 555 +-
.../google/cloud/operators/dataproc/index.html | 2658 +++
.../cloud/operators/dataproc_metastore/index.html | 1836 ++
.../google/cloud/operators/datastore}/index.html | 1076 +-
.../google/cloud/operators/dlp/index.html | 3113 ++++
.../google/cloud/operators/functions}/index.html | 611 +-
.../google/cloud/operators/gcs/index.html | 1619 ++
.../providers/google/cloud/operators}/index.html | 214 +-
.../cloud/operators/kubernetes_engine}/index.html | 372 +-
.../cloud/operators/life_sciences}/index.html | 136 +-
.../google/cloud/operators/looker}/index.html | 146 +-
.../google/cloud/operators/mlengine/index.html | 1882 +++
.../cloud/operators/natural_language}/index.html | 345 +-
.../google/cloud/operators/pubsub/index.html | 1539 ++
.../google/cloud/operators/spanner}/index.html | 677 +-
.../cloud/operators/speech_to_text}/index.html | 143 +-
.../google/cloud/operators/stackdriver/index.html | 1746 ++
.../google/cloud/operators/tasks/index.html | 1856 ++
.../cloud/operators/text_to_speech}/index.html | 166 +-
.../google/cloud/operators/translate}/index.html | 154 +-
.../cloud/operators/translate_speech}/index.html | 187 +-
.../cloud/operators/vertex_ai/auto_ml}/index.html | 639 +-
.../vertex_ai/batch_prediction_job}/index.html | 698 +-
.../operators/vertex_ai/custom_job/index.html | 2009 +++
.../cloud/operators/vertex_ai/dataset}/index.html | 738 +-
.../vertex_ai/endpoint_service}/index.html | 1059 +-
.../hyperparameter_tuning_job}/index.html | 661 +-
.../google/cloud/operators/vertex_ai/index.html} | 221 +-
.../operators/vertex_ai/model_service}/index.html | 614 +-
.../cloud/operators/video_intelligence}/index.html | 290 +-
.../google/cloud/operators/vision/index.html | 2139 +++
.../google/cloud/operators/workflows/index.html | 1469 ++
.../providers/google/cloud/secrets/index.html} | 213 +-
.../cloud/secrets/secret_manager}/index.html | 264 +-
.../google/cloud/sensors/bigquery}/index.html | 276 +-
.../google/cloud/sensors/bigquery_dts}/index.html | 139 +-
.../google/cloud/sensors/bigtable}/index.html | 133 +-
.../cloud/sensors/cloud_composer}/index.html | 142 +-
.../cloud_storage_transfer_service}/index.html | 133 +-
.../google/cloud/sensors/dataflow}/index.html | 337 +-
.../google/cloud/sensors/dataform}/index.html | 138 +-
.../google/cloud/sensors/datafusion}/index.html | 138 +-
.../google/cloud/sensors/dataplex}/index.html | 185 +-
.../google/cloud/sensors/dataprep}/index.html | 119 +-
.../google/cloud/sensors/dataproc}/index.html | 210 +-
.../providers/google/cloud/sensors/gcs}/index.html | 643 +-
.../providers/google/cloud/sensors}/index.html | 157 +-
.../google/cloud/sensors/looker}/index.html | 131 +-
.../google/cloud/sensors/pubsub}/index.html | 186 +-
.../google/cloud/sensors/tasks}/index.html | 128 +-
.../google/cloud/sensors/workflows}/index.html | 128 +-
.../google/cloud/transfers/adls_to_gcs}/index.html | 206 +-
.../transfers/azure_fileshare_to_gcs}/index.html | 147 +-
.../transfers/bigquery_to_bigquery}/index.html | 182 +-
.../cloud/transfers/bigquery_to_gcs}/index.html | 195 +-
.../cloud/transfers/bigquery_to_mssql}/index.html | 180 +-
.../cloud/transfers/bigquery_to_mysql}/index.html | 179 +-
.../cloud/transfers/calendar_to_gcs}/index.html | 182 +-
.../cloud/transfers/cassandra_to_gcs}/index.html | 346 +-
.../transfers/facebook_ads_to_gcs}/index.html | 201 +-
.../cloud/transfers/gcs_to_bigquery}/index.html | 297 +-
.../google/cloud/transfers/gcs_to_gcs}/index.html | 290 +-
.../cloud/transfers/gcs_to_local}/index.html | 149 +-
.../google/cloud/transfers/gcs_to_sftp}/index.html | 219 +-
.../cloud/transfers/gdrive_to_gcs}/index.html | 139 +-
.../cloud/transfers/gdrive_to_local}/index.html | 136 +-
.../providers/google/cloud/transfers}/index.html | 168 +-
.../cloud/transfers/local_to_gcs}/index.html | 138 +-
.../cloud/transfers/mssql_to_gcs}/index.html | 169 +-
.../cloud/transfers/mysql_to_gcs}/index.html | 159 +-
.../cloud/transfers/oracle_to_gcs}/index.html | 157 +-
.../cloud/transfers/postgres_to_gcs}/index.html | 152 +-
.../cloud/transfers/presto_to_gcs}/index.html | 145 +-
.../google/cloud/transfers/s3_to_gcs}/index.html | 198 +-
.../cloud/transfers/salesforce_to_gcs}/index.html | 156 +-
.../google/cloud/transfers/sftp_to_gcs}/index.html | 194 +-
.../cloud/transfers/sheets_to_gcs}/index.html | 139 +-
.../google/cloud/transfers/sql_to_gcs}/index.html | 224 +-
.../cloud/transfers/trino_to_gcs}/index.html | 145 +-
.../google/cloud/triggers/bigquery}/index.html | 547 +-
.../google/cloud/triggers/bigquery_dts}/index.html | 148 +-
.../google/cloud/triggers/cloud_build}/index.html | 141 +-
.../cloud/triggers/cloud_composer}/index.html | 145 +-
.../google/cloud/triggers/dataflow}/index.html | 171 +-
.../google/cloud/triggers/datafusion}/index.html | 145 +-
.../google/cloud/triggers/dataproc}/index.html | 322 +-
.../google/cloud/triggers/gcs}/index.html | 185 +-
.../providers/google/cloud/triggers}/index.html | 151 +-
.../cloud/triggers/kubernetes_engine}/index.html | 185 +-
.../google/cloud/triggers/mlengine}/index.html | 130 +-
.../google/cloud/utils/bigquery/index.html} | 249 +-
.../cloud/utils/bigquery_get_data/index.html} | 247 +-
.../cloud/utils/credentials_provider}/index.html | 260 +-
.../google/cloud/utils/dataform}/index.html | 161 +-
.../google/cloud/utils/field_sanitizer}/index.html | 209 +-
.../google/cloud/utils/field_validator}/index.html | 328 +-
.../google/cloud/utils/helpers/index.html} | 249 +-
.../providers/google/cloud/utils}/index.html | 150 +-
.../utils/mlengine_operator_utils}/index.html | 287 +-
.../utils/mlengine_prediction_summary}/index.html | 216 +-
.../common/auth_backend/google_openid}/index.html | 184 +-
.../google/common/auth_backend/index.html} | 213 +-
.../providers/google/common/consts}/index.html | 141 +-
.../google/common/hooks/base_google}/index.html | 704 +-
.../google/common/hooks/discovery_api}/index.html | 170 +-
.../providers/google/common/hooks/index.html} | 214 +-
.../airflow/providers/google/common/index.html} | 235 +-
.../providers/google/common/links/index.html} | 213 +-
.../google/common/links/storage}/index.html | 234 +-
.../common/utils/id_token_credentials}/index.html | 218 +-
.../providers/google/common/utils/index.html} | 213 +-
.../providers/google/config_templates/index.html} | 210 +-
.../google/firebase/hooks/firestore}/index.html | 179 +-
.../providers/google/firebase/hooks/index.html} | 213 +-
.../airflow/providers/google/firebase/index.html} | 214 +-
.../firebase/operators/firestore}/index.html | 137 +-
.../google/firebase/operators/index.html} | 213 +-
.../providers/google/go_module_utils}/index.html | 210 +-
.../_api/airflow/providers/google}/index.html | 818 +-
.../providers/google/leveldb/hooks/index.html} | 213 +-
.../google/leveldb/hooks/leveldb}/index.html | 280 +-
.../airflow/providers/google/leveldb/index.html} | 214 +-
.../providers/google/leveldb/operators/index.html} | 213 +-
.../google/leveldb/operators/leveldb}/index.html | 155 +-
.../marketing_platform/hooks/analytics}/index.html | 233 +-
.../hooks/campaign_manager}/index.html | 312 +-
.../hooks/display_video}/index.html | 278 +-
.../google/marketing_platform/hooks/index.html} | 216 +-
.../hooks/search_ads}/index.html | 155 +-
.../google/marketing_platform/index.html} | 231 +-
.../operators/analytics}/index.html | 628 +-
.../operators/campaign_manager}/index.html | 685 +-
.../operators/display_video}/index.html | 760 +-
.../marketing_platform/operators/index.html} | 216 +-
.../operators/search_ads}/index.html | 215 +-
.../sensors/campaign_manager}/index.html | 136 +-
.../sensors/display_video}/index.html | 179 +-
.../google/marketing_platform/sensors/index.html} | 215 +-
.../sensors/search_ads}/index.html | 134 +-
.../google/suite/hooks/calendar}/index.html | 217 +-
.../providers/google/suite/hooks/drive}/index.html | 259 +-
.../providers/google/suite/hooks/index.html} | 215 +-
.../google/suite/hooks/sheets}/index.html | 411 +-
.../airflow/providers/google/suite/index.html} | 232 +-
.../providers/google/suite/operators/index.html} | 213 +-
.../google/suite/operators/sheets}/index.html | 134 +-
.../google/suite/sensors/drive}/index.html | 133 +-
.../providers/google/suite/sensors/index.html} | 213 +-
.../suite/transfers/gcs_to_gdrive}/index.html | 199 +-
.../suite/transfers/gcs_to_sheets}/index.html | 136 +-
.../providers/google/suite/transfers/index.html} | 216 +-
.../suite/transfers/local_to_drive}/index.html | 151 +-
.../suite/transfers/sql_to_sheets}/index.html | 169 +-
.../providers/google/ads/example_ads}/index.html | 222 +-
.../tests/system/providers/google/ads/index.html} | 211 +-
.../automl/example_automl_dataset}/index.html | 389 +-
.../cloud/automl/example_automl_model}/index.html | 423 +-
.../example_automl_nl_text_extraction}/index.html | 265 +-
.../index.html | 296 +-
.../providers/google/cloud/automl/index.html} | 226 +-
.../google/cloud/automl/resources/index.html} | 214 +-
.../example_azure_fileshare_to_gcs}/index.html | 236 +-
.../providers/google/cloud/azure/index.html} | 213 +-
.../bigquery/example_bigquery_dataset}/index.html | 225 +-
.../bigquery/example_bigquery_dts}/index.html | 272 +-
.../example_bigquery_operations}/index.html | 237 +-
.../index.html | 232 +-
.../bigquery/example_bigquery_queries}/index.html | 258 +-
.../example_bigquery_queries_async}/index.html | 287 +-
.../bigquery/example_bigquery_sensors}/index.html | 258 +-
.../bigquery/example_bigquery_tables}/index.html | 251 +-
.../example_bigquery_to_bigquery}/index.html | 237 +-
.../bigquery/example_bigquery_to_gcs}/index.html | 244 +-
.../example_bigquery_to_gcs_async}/index.html | 244 +-
.../bigquery/example_bigquery_to_mssql}/index.html | 244 +-
.../bigquery/example_bigquery_transfer}/index.html | 244 +-
.../providers/google/cloud/bigquery}/index.html | 225 +-
.../google/cloud/bigquery/resources/index.html} | 214 +-
.../cloud/bigtable/example_bigtable}/index.html | 416 +-
.../providers/google/cloud/bigtable/index.html} | 213 +-
.../cloud_build/example_cloud_build}/index.html | 289 +-
.../example_cloud_build_async}/index.html | 289 +-
.../example_cloud_build_trigger}/index.html | 253 +-
.../providers/google/cloud/cloud_build/index.html} | 218 +-
.../google/cloud/cloud_build/resources/index.html} | 214 +-
.../cloud_functions/example_functions}/index.html | 394 +-
.../google/cloud/cloud_functions/index.html} | 213 +-
.../index.html | 253 +-
.../example_cloud_memorystore_redis}/index.html | 279 +-
.../google/cloud/cloud_memorystore/index.html} | 214 +-
.../cloud/cloud_sql/example_cloud_sql}/index.html | 393 +-
.../providers/google/cloud/cloud_sql/index.html} | 213 +-
.../composer/example_cloud_composer}/index.html | 250 +-
.../example_cloud_composer_deferrable}/index.html | 266 +-
.../providers/google/cloud/composer/index.html} | 214 +-
.../cloud/compute/example_compute}/index.html | 289 +-
.../cloud/compute/example_compute_igm}/index.html | 382 +-
.../cloud/compute/example_compute_ssh}/index.html | 252 +-
.../providers/google/cloud/compute/index.html} | 215 +-
.../example_dlp_deidentify_content}/index.html | 265 +-
.../example_dlp_info_types}/index.html | 387 +-
.../example_dlp_inspect_template}/index.html | 244 +-
.../example_dlp_job}/index.html | 237 +-
.../example_dlp_job_trigger}/index.html | 239 +-
.../google/cloud/data_loss_prevention/index.html} | 227 +-
.../data_loss_prevention/resources/index.html} | 214 +-
.../example_dataflow_native_java}/index.html | 265 +-
.../example_dataflow_native_python}/index.html | 272 +-
.../index.html | 288 +-
.../dataflow/example_dataflow_template}/index.html | 273 +-
.../providers/google/cloud/dataflow/index.html} | 226 +-
.../google/cloud/dataflow/resources/index.html} | 214 +-
.../cloud/dataform/example_dataform}/index.html | 246 +-
.../providers/google/cloud/dataform/index.html} | 213 +-
.../datafusion/example_datafusion}/index.html | 272 +-
.../example_datafusion_async}/index.html | 272 +-
.../providers/google/cloud/datafusion/index.html} | 214 +-
.../cloud/dataplex/example_dataplex}/index.html | 316 +-
.../providers/google/cloud/dataplex/index.html} | 219 +-
.../google/cloud/dataplex/resources/index.html} | 215 +-
.../resources/spark_example_pi/index.html} | 232 +-
.../cloud/dataprep/example_dataprep}/index.html | 258 +-
.../providers/google/cloud/dataprep/index.html} | 213 +-
.../dataproc/example_dataproc_batch}/index.html | 258 +-
.../example_dataproc_batch_deferrable}/index.html | 238 +-
.../example_dataproc_batch_persistent}/index.html | 274 +-
.../index.html | 296 +-
.../example_dataproc_cluster_generator}/index.html | 273 +-
.../dataproc/example_dataproc_gke}/index.html | 251 +-
.../dataproc/example_dataproc_hadoop}/index.html | 309 +-
.../dataproc/example_dataproc_hive}/index.html | 274 +-
.../dataproc/example_dataproc_pig}/index.html | 258 +-
.../dataproc/example_dataproc_pyspark}/index.html | 279 +-
.../dataproc/example_dataproc_spark}/index.html | 258 +-
.../example_dataproc_spark_async}/index.html | 258 +-
.../example_dataproc_spark_deferrable}/index.html | 259 +-
.../example_dataproc_spark_sql}/index.html | 258 +-
.../dataproc/example_dataproc_sparkr}/index.html | 279 +-
.../dataproc/example_dataproc_update}/index.html | 281 +-
.../dataproc/example_dataproc_workflow}/index.html | 274 +-
.../providers/google/cloud/dataproc}/index.html | 232 +-
.../dataproc/resources/hello_world}/index.html | 212 +-
.../google/cloud/dataproc/resources/index.html} | 215 +-
.../example_dataproc_metastore}/index.html | 388 +-
.../example_dataproc_metastore_backup}/index.html | 259 +-
.../google/cloud/dataproc_metastore/index.html} | 214 +-
.../datastore/example_datastore_commit}/index.html | 239 +-
.../example_datastore_export_import}/index.html | 232 +-
.../datastore/example_datastore_query}/index.html | 239 +-
.../example_datastore_rollback}/index.html | 232 +-
.../providers/google/cloud/datastore/index.html} | 216 +-
.../cloud/gcs/example_calendar_to_gcs}/index.html | 254 +-
.../google/cloud/gcs/example_firestore}/index.html | 318 +-
.../google/cloud/gcs/example_gcs_acl}/index.html | 274 +-
.../cloud/gcs/example_gcs_copy_delete}/index.html | 245 +-
.../cloud/gcs/example_gcs_sensor}/index.html | 282 +-
.../cloud/gcs/example_gcs_to_bigquery}/index.html | 239 +-
.../gcs/example_gcs_to_bigquery_async}/index.html | 286 +-
.../cloud/gcs/example_gcs_to_gcs}/index.html | 240 +-
.../cloud/gcs/example_gcs_to_gdrive}/index.html | 260 +-
.../cloud/gcs/example_gcs_to_sheets}/index.html | 245 +-
.../cloud/gcs/example_gcs_transform}/index.html | 244 +-
.../gcs/example_gcs_transform_timespan}/index.html | 265 +-
.../gcs/example_gcs_upload_download}/index.html | 244 +-
.../cloud/gcs/example_gdrive_to_gcs}/index.html | 250 +-
.../cloud/gcs/example_mssql_to_gcs}/index.html | 254 +-
.../cloud/gcs/example_mysql_to_gcs}/index.html | 254 +-
.../cloud/gcs/example_oracle_to_gcs}/index.html | 236 +-
.../google/cloud/gcs/example_s3_to_gcs}/index.html | 304 +-
.../cloud/gcs/example_sftp_to_gcs}/index.html | 286 +-
.../google/cloud/gcs/example_sheets}/index.html | 243 +-
.../cloud/gcs/example_sheets_to_gcs}/index.html | 238 +-
.../cloud/gcs/example_trino_to_gcs}/index.html | 278 +-
.../system/providers/google/cloud/gcs}/index.html | 238 +-
.../google/cloud/gcs/resources/index.html} | 216 +-
.../gcs/resources/transform_script}/index.html | 212 +-
.../gcs/resources/transform_timespan}/index.html | 226 +-
.../system/providers/google/cloud}/index.html | 517 +-
.../example_kubernetes_engine}/index.html | 237 +-
.../example_kubernetes_engine_async}/index.html | 253 +-
.../google/cloud/kubernetes_engine/index.html} | 214 +-
.../example_life_sciences}/index.html | 264 +-
.../google/cloud/life_sciences/index.html} | 216 +-
.../cloud/life_sciences/resources/index.html} | 214 +-
.../cloud/ml_engine/example_mlengine}/index.html | 444 +-
.../ml_engine/example_mlengine_async}/index.html | 444 +-
.../providers/google/cloud/ml_engine/index.html} | 214 +-
.../example_natural_language}/index.html | 246 +-
.../google/cloud/natural_language/index.html} | 213 +-
.../google/cloud/pubsub/example_pubsub}/index.html | 251 +-
.../providers/google/cloud/pubsub/index.html} | 213 +-
.../cloud/spanner/example_spanner}/index.html | 258 +-
.../providers/google/cloud/spanner/index.html} | 213 +-
.../example_speech_to_text}/index.html | 264 +-
.../google/cloud/speech_to_text/index.html} | 213 +-
.../example_sql_to_sheets}/index.html | 231 +-
.../google/cloud/sql_to_sheets/index.html} | 213 +-
.../stackdriver/example_stackdriver}/index.html | 272 +-
.../providers/google/cloud/stackdriver/index.html} | 213 +-
.../index.html | 310 +-
.../google/cloud/storage_transfer/index.html} | 216 +-
.../cloud/storage_transfer/resources/index.html} | 214 +-
.../google/cloud/tasks/example_queue}/index.html | 243 +-
.../google/cloud/tasks/example_tasks}/index.html | 298 +-
.../providers/google/cloud/tasks/index.html} | 214 +-
.../example_text_to_speech}/index.html | 250 +-
.../google/cloud/text_to_speech/index.html} | 213 +-
.../transfers/example_gcs_to_sftp}/index.html | 295 +-
.../transfers/example_gdrive_to_local}/index.html | 246 +-
.../providers/google/cloud/transfers/index.html} | 217 +-
.../google/cloud/transfers/resources/index.html} | 214 +-
.../cloud/translate/example_translate}/index.html | 212 +-
.../providers/google/cloud/translate/index.html} | 213 +-
.../example_translate_speech}/index.html | 292 +-
.../google/cloud/translate_speech/index.html} | 213 +-
.../index.html | 380 +-
.../index.html | 359 +-
.../index.html | 232 +-
.../index.html | 359 +-
.../index.html | 302 +-
.../index.html | 286 +-
.../index.html | 401 +-
.../example_vertex_ai_custom_container}/index.html | 422 +-
.../example_vertex_ai_custom_job}/index.html | 373 +-
.../index.html | 443 +-
.../example_vertex_ai_dataset}/index.html | 387 +-
.../example_vertex_ai_endpoint}/index.html | 302 +-
.../index.html | 366 +-
.../example_vertex_ai_list_custom_jobs}/index.html | 232 +-
.../example_vertex_ai_model_service}/index.html | 394 +-
.../providers/google/cloud/vertex_ai}/index.html | 227 +-
.../google/cloud/vertex_ai/resources/index.html} | 214 +-
.../example_video_intelligence}/index.html | 249 +-
.../google/cloud/video_intelligence/index.html} | 213 +-
.../example_vision_annotate_image}/index.html | 271 +-
.../example_vision_autogenerated}/index.html | 386 +-
.../vision/example_vision_explicit}/index.html | 372 +-
.../providers/google/cloud/vision/index.html} | 215 +-
.../cloud/workflows/example_workflows}/index.html | 310 +-
.../providers/google/cloud/workflows/index.html} | 213 +-
.../system/providers/google/conftest}/index.html | 157 +-
.../example_datacatalog_entries}/index.html | 201 +-
.../example_datacatalog_search_catalog}/index.html | 253 +-
.../example_datacatalog_tag_templates}/index.html | 201 +-
.../example_datacatalog_tags}/index.html | 253 +-
.../providers/google/datacatalog/index.html} | 214 +-
.../system/providers/google/firebase/index.html} | 210 +-
.../_api/tests/system/providers/google}/index.html | 601 +-
.../google/leveldb/example_leveldb}/index.html | 216 +-
.../system/providers/google/leveldb/index.html} | 211 +-
.../example_analytics}/index.html | 195 +-
.../example_campaign_manager}/index.html | 230 +-
.../example_search_ads}/index.html | 181 +-
.../google/marketing_platform/index.html} | 213 +-
.../suite/example_local_to_drive}/index.html | 190 +-
.../system/providers/google/suite/index.html} | 214 +-
.../providers/google/suite/resources/index.html} | 212 +-
.../system/providers/google/workplace/index.html} | 210 +-
.../8.10.0/_modules/airflow/providers/google.html} | 275 +-
.../airflow/providers/google/ads/hooks/ads.html} | 497 +-
.../providers/google/ads/operators/ads.html} | 307 +-
.../google/ads/transfers/ads_to_gcs.html} | 322 +-
.../providers/google/cloud/hooks/automl.html} | 872 +-
.../providers/google/cloud/hooks/bigquery.html | 4074 +++++
.../google/cloud/hooks/bigquery_dts.html} | 576 +-
.../providers/google/cloud/hooks/bigtable.html} | 541 +-
.../providers/google/cloud/hooks/cloud_build.html} | 866 +-
.../google/cloud/hooks/cloud_composer.html} | 658 +-
.../google/cloud/hooks/cloud_memorystore.html | 1722 ++
.../providers/google/cloud/hooks/cloud_sql.html | 1783 ++
.../hooks/cloud_storage_transfer_service.html} | 725 +-
.../providers/google/cloud/hooks/compute.html | 1659 ++
.../providers/google/cloud/hooks/compute_ssh.html} | 562 +-
.../providers/google/cloud/hooks/datacatalog.html | 1991 +++
.../providers/google/cloud/hooks/dataflow.html | 2092 +++
.../providers/google/cloud/hooks/dataform.html} | 888 +-
.../providers/google/cloud/hooks/datafusion.html} | 824 +-
.../providers/google/cloud/hooks/dataplex.html} | 605 +-
.../providers/google/cloud/hooks/dataprep.html} | 443 +-
.../providers/google/cloud/hooks/dataproc.html | 2545 +++
.../google/cloud/hooks/dataproc_metastore.html} | 881 +-
.../providers/google/cloud/hooks/datastore.html} | 581 +-
.../airflow/providers/google/cloud/hooks/dlp.html | 2261 +++
.../providers/google/cloud/hooks/functions.html} | 517 +-
.../airflow/providers/google/cloud/hooks/gcs.html | 2028 +++
.../airflow/providers/google/cloud/hooks/gdm.html} | 293 +-
.../airflow/providers/google/cloud/hooks/kms.html} | 355 +-
.../google/cloud/hooks/kubernetes_engine.html} | 569 +-
.../google/cloud/hooks/life_sciences.html} | 345 +-
.../providers/google/cloud/hooks/looker.html} | 494 +-
.../providers/google/cloud/hooks/mlengine.html} | 821 +-
.../google/cloud/hooks/natural_language.html} | 531 +-
.../providers/google/cloud/hooks/os_login.html} | 278 +-
.../providers/google/cloud/hooks/pubsub.html} | 805 +-
.../google/cloud/hooks/secret_manager.html} | 263 +-
.../providers/google/cloud/hooks/spanner.html} | 601 +-
.../google/cloud/hooks/speech_to_text.html} | 275 +-
.../providers/google/cloud/hooks/stackdriver.html} | 822 +-
.../providers/google/cloud/hooks/tasks.html} | 836 +-
.../google/cloud/hooks/text_to_speech.html} | 309 +-
.../providers/google/cloud/hooks/translate.html} | 289 +-
.../google/cloud/hooks/vertex_ai/auto_ml.html | 2135 +++
.../hooks/vertex_ai/batch_prediction_job.html} | 670 +-
.../google/cloud/hooks/vertex_ai/custom_job.html | 2878 ++++
.../google/cloud/hooks/vertex_ai/dataset.html} | 781 +-
.../cloud/hooks/vertex_ai/endpoint_service.html} | 696 +-
.../vertex_ai/hyperparameter_tuning_job.html} | 738 +-
.../cloud/hooks/vertex_ai/model_service.html} | 401 +-
.../google/cloud/hooks/video_intelligence.html} | 317 +-
.../providers/google/cloud/hooks/vision.html | 1496 ++
.../providers/google/cloud/hooks/workflows.html} | 590 +-
.../providers/google/cloud/links/automl.html} | 354 +-
.../providers/google/cloud/links/base.html} | 224 +-
.../providers/google/cloud/links/bigquery.html} | 253 +-
.../google/cloud/links/bigquery_dts.html} | 226 +-
.../providers/google/cloud/links/bigtable.html} | 289 +-
.../providers/google/cloud/links/cloud_build.html} | 317 +-
.../google/cloud/links/cloud_functions.html} | 254 +-
.../google/cloud/links/cloud_memorystore.html} | 312 +-
.../providers/google/cloud/links/cloud_sql.html} | 250 +-
.../cloud/links/cloud_storage_transfer.html} | 318 +-
.../providers/google/cloud/links/cloud_tasks.html} | 257 +-
.../providers/google/cloud/links/compute.html} | 303 +-
.../google/cloud/links/data_loss_prevention.html} | 597 +-
.../providers/google/cloud/links/datacatalog.html} | 305 +-
.../providers/google/cloud/links/dataflow.html} | 226 +-
.../providers/google/cloud/links/dataform.html} | 318 +-
.../providers/google/cloud/links/datafusion.html} | 321 +-
.../providers/google/cloud/links/dataplex.html} | 295 +-
.../providers/google/cloud/links/dataprep.html} | 237 +-
.../providers/google/cloud/links/dataproc.html} | 309 +-
.../providers/google/cloud/links/datastore.html} | 245 +-
.../google/cloud/links/kubernetes_engine.html} | 258 +-
.../google/cloud/links/life_sciences.html} | 223 +-
.../providers/google/cloud/links/mlengine.html} | 331 +-
.../providers/google/cloud/links/pubsub.html} | 247 +-
.../providers/google/cloud/links/spanner.html} | 250 +-
.../providers/google/cloud/links/stackdriver.html} | 245 +-
.../providers/google/cloud/links/vertex_ai.html} | 600 +-
.../providers/google/cloud/links/workflows.html} | 296 +-
.../google/cloud/log/gcs_task_handler.html} | 478 +-
.../cloud/log/stackdriver_task_handler.html} | 630 +-
.../providers/google/cloud/operators/automl.html | 2073 +++
.../providers/google/cloud/operators/bigquery.html | 3600 ++++
.../google/cloud/operators/bigquery_dts.html} | 652 +-
.../google/cloud/operators/bigtable.html} | 833 +-
.../google/cloud/operators/cloud_build.html | 1908 +++
.../google/cloud/operators/cloud_composer.html | 1540 ++
.../google/cloud/operators/cloud_memorystore.html | 2529 +++
.../google/cloud/operators/cloud_sql.html | 1933 +++
.../operators/cloud_storage_transfer_service.html | 1934 +++
.../providers/google/cloud/operators/compute.html | 2512 +++
.../google/cloud/operators/datacatalog.html | 3022 ++++
.../providers/google/cloud/operators/dataflow.html | 2201 +++
.../providers/google/cloud/operators/dataform.html | 2063 +++
.../google/cloud/operators/datafusion.html | 1870 ++
.../providers/google/cloud/operators/dataplex.html | 1493 ++
.../google/cloud/operators/dataprep.html} | 552 +-
.../providers/google/cloud/operators/dataproc.html | 3407 ++++
.../google/cloud/operators/dataproc_metastore.html | 1929 +++
.../google/cloud/operators/datastore.html | 1529 ++
.../providers/google/cloud/operators/dlp.html | 3717 ++++
.../google/cloud/operators/functions.html} | 730 +-
.../providers/google/cloud/operators/gcs.html | 1853 ++
.../google/cloud/operators/kubernetes_engine.html} | 768 +-
.../google/cloud/operators/life_sciences.html} | 277 +-
.../providers/google/cloud/operators/looker.html} | 300 +-
.../providers/google/cloud/operators/mlengine.html | 2332 +++
.../google/cloud/operators/natural_language.html} | 576 +-
.../providers/google/cloud/operators/pubsub.html | 1676 ++
.../providers/google/cloud/operators/spanner.html} | 833 +-
.../google/cloud/operators/speech_to_text.html} | 316 +-
.../google/cloud/operators/stackdriver.html | 1830 ++
.../providers/google/cloud/operators/tasks.html | 2020 +++
.../google/cloud/operators/text_to_speech.html} | 343 +-
.../google/cloud/operators/translate.html} | 325 +-
.../google/cloud/operators/translate_speech.html} | 380 +-
.../google/cloud/operators/vertex_ai/auto_ml.html | 1494 ++
.../operators/vertex_ai/batch_prediction_job.html} | 827 +-
.../cloud/operators/vertex_ai/custom_job.html | 2243 +++
.../google/cloud/operators/vertex_ai/dataset.html | 1435 ++
.../operators/vertex_ai/endpoint_service.html | 1505 ++
.../vertex_ai/hyperparameter_tuning_job.html} | 821 +-
.../cloud/operators/vertex_ai/model_service.html} | 698 +-
.../cloud/operators/video_intelligence.html} | 554 +-
.../providers/google/cloud/operators/vision.html | 2355 +++
.../google/cloud/operators/workflows.html | 1563 ++
.../google/cloud/secrets/secret_manager.html} | 469 +-
.../providers/google/cloud/sensors/bigquery.html} | 522 +-
.../google/cloud/sensors/bigquery_dts.html} | 334 +-
.../providers/google/cloud/sensors/bigtable.html} | 310 +-
.../google/cloud/sensors/cloud_composer.html} | 299 +-
.../sensors/cloud_storage_transfer_service.html} | 308 +-
.../providers/google/cloud/sensors/dataflow.html} | 640 +-
.../providers/google/cloud/sensors/dataform.html} | 306 +-
.../google/cloud/sensors/datafusion.html} | 327 +-
.../providers/google/cloud/sensors/dataplex.html} | 317 +-
.../providers/google/cloud/sensors/dataprep.html} | 227 +-
.../providers/google/cloud/sensors/dataproc.html} | 461 +-
.../providers/google/cloud/sensors/gcs.html} | 711 +-
.../providers/google/cloud/sensors/looker.html} | 261 +-
.../providers/google/cloud/sensors/pubsub.html} | 363 +-
.../providers/google/cloud/sensors/tasks.html} | 263 +-
.../providers/google/cloud/sensors/workflows.html} | 313 +-
.../google/cloud/transfers/adls_to_gcs.html} | 363 +-
.../cloud/transfers/azure_fileshare_to_gcs.html} | 367 +-
.../cloud/transfers/bigquery_to_bigquery.html} | 344 +-
.../google/cloud/transfers/bigquery_to_gcs.html} | 525 +-
.../google/cloud/transfers/bigquery_to_mssql.html} | 346 +-
.../google/cloud/transfers/bigquery_to_mysql.html} | 339 +-
.../google/cloud/transfers/calendar_to_gcs.html} | 476 +-
.../google/cloud/transfers/cassandra_to_gcs.html} | 641 +-
.../cloud/transfers/facebook_ads_to_gcs.html} | 477 +-
.../google/cloud/transfers/gcs_to_bigquery.html | 1562 ++
.../google/cloud/transfers/gcs_to_gcs.html} | 720 +-
.../google/cloud/transfers/gcs_to_local.html} | 327 +-
.../google/cloud/transfers/gcs_to_sftp.html} | 484 +-
.../google/cloud/transfers/gdrive_to_gcs.html} | 303 +-
.../google/cloud/transfers/gdrive_to_local.html} | 274 +-
.../google/cloud/transfers/local_to_gcs.html} | 317 +-
.../google/cloud/transfers/mssql_to_gcs.html} | 268 +-
.../google/cloud/transfers/mysql_to_gcs.html} | 323 +-
.../google/cloud/transfers/oracle_to_gcs.html} | 314 +-
.../google/cloud/transfers/postgres_to_gcs.html} | 351 +-
.../google/cloud/transfers/presto_to_gcs.html} | 483 +-
.../google/cloud/transfers/s3_to_gcs.html} | 493 +-
.../google/cloud/transfers/salesforce_to_gcs.html} | 310 +-
.../google/cloud/transfers/sftp_to_gcs.html} | 464 +-
.../google/cloud/transfers/sheets_to_gcs.html} | 336 +-
.../google/cloud/transfers/sql_to_gcs.html} | 722 +-
.../google/cloud/transfers/trino_to_gcs.html} | 483 +-
.../providers/google/cloud/triggers/bigquery.html} | 774 +-
.../google/cloud/triggers/bigquery_dts.html} | 353 +-
.../google/cloud/triggers/cloud_build.html} | 321 +-
.../google/cloud/triggers/cloud_composer.html} | 263 +-
.../providers/google/cloud/triggers/dataflow.html} | 341 +-
.../google/cloud/triggers/datafusion.html} | 327 +-
.../providers/google/cloud/triggers/dataproc.html} | 559 +-
.../providers/google/cloud/triggers/gcs.html} | 294 +-
.../google/cloud/triggers/kubernetes_engine.html} | 312 +-
.../providers/google/cloud/triggers/mlengine.html} | 315 +-
.../providers/google/cloud/utils/bigquery.html} | 273 +-
.../google/cloud/utils/bigquery_get_data.html} | 230 +-
.../google/cloud/utils/credentials_provider.html} | 620 +-
.../providers/google/cloud/utils/dataform.html} | 398 +-
.../google/cloud/utils/field_sanitizer.html} | 355 +-
.../google/cloud/utils/field_validator.html} | 708 +-
.../providers/google/cloud/utils/helpers.html} | 260 +-
.../cloud/utils/mlengine_operator_utils.html} | 537 +-
.../cloud/utils/mlengine_prediction_summary.html} | 406 +-
.../google/common/auth_backend/google_openid.html} | 324 +-
.../airflow/providers/google/common/consts.html} | 262 +-
.../providers/google/common/hooks/base_google.html | 1457 ++
.../google/common/hooks/discovery_api.html} | 351 +-
.../providers/google/common/links/storage.html} | 236 +-
.../google/common/utils/id_token_credentials.html} | 481 +-
.../google/firebase/hooks/firestore.html} | 338 +-
.../google/firebase/operators/firestore.html} | 267 +-
.../airflow/providers/google/go_module_utils.html} | 284 +-
.../providers/google/leveldb/hooks/leveldb.html} | 344 +-
.../google/leveldb/operators/leveldb.html} | 268 +-
.../marketing_platform/hooks/analytics.html} | 479 +-
.../hooks/campaign_manager.html} | 556 +-
.../marketing_platform/hooks/display_video.html} | 487 +-
.../marketing_platform/hooks/search_ads.html} | 264 +-
.../marketing_platform/operators/analytics.html} | 755 +-
.../operators/campaign_manager.html} | 844 +-
.../operators/display_video.html | 1517 ++
.../marketing_platform/operators/search_ads.html} | 510 +-
.../sensors/campaign_manager.html} | 275 +-
.../marketing_platform/sensors/display_video.html} | 346 +-
.../marketing_platform/sensors/search_ads.html} | 265 +-
.../providers/google/suite/hooks/calendar.html} | 483 +-
.../providers/google/suite/hooks/drive.html} | 499 +-
.../providers/google/suite/hooks/sheets.html} | 646 +-
.../providers/google/suite/operators/sheets.html} | 252 +-
.../providers/google/suite/sensors/drive.html} | 261 +-
.../google/suite/transfers/gcs_to_gdrive.html} | 359 +-
.../google/suite/transfers/gcs_to_sheets.html} | 283 +-
.../google/suite/transfers/local_to_drive.html} | 325 +-
.../google/suite/transfers/sql_to_sheets.html} | 323 +-
.../8.10.0/_modules/index.html} | 517 +-
.../system/providers/google/ads/example_ads.html} | 318 +-
.../cloud/automl/example_automl_dataset.html} | 374 +-
.../google/cloud/automl/example_automl_model.html} | 458 +-
.../automl/example_automl_nl_text_extraction.html} | 301 +-
.../example_automl_vision_classification.html} | 332 +-
.../azure/example_azure_fileshare_to_gcs.html} | 263 +-
.../cloud/bigquery/example_bigquery_dataset.html} | 270 +-
.../cloud/bigquery/example_bigquery_dts.html} | 364 +-
.../bigquery/example_bigquery_operations.html} | 282 +-
.../example_bigquery_operations_location.html} | 262 +-
.../cloud/bigquery/example_bigquery_queries.html} | 431 +-
.../bigquery/example_bigquery_queries_async.html} | 444 +-
.../cloud/bigquery/example_bigquery_sensors.html} | 315 +-
.../cloud/bigquery/example_bigquery_tables.html} | 407 +-
.../bigquery/example_bigquery_to_bigquery.html} | 285 +-
.../cloud/bigquery/example_bigquery_to_gcs.html} | 281 +-
.../bigquery/example_bigquery_to_gcs_async.html} | 280 +-
.../cloud/bigquery/example_bigquery_to_mssql.html} | 273 +-
.../cloud/bigquery/example_bigquery_transfer.html} | 299 +-
.../google/cloud/bigtable/example_bigtable.html} | 396 +-
.../cloud/cloud_build/example_cloud_build.html} | 418 +-
.../cloud_build/example_cloud_build_async.html} | 393 +-
.../cloud_build/example_cloud_build_trigger.html} | 335 +-
.../cloud/cloud_functions/example_functions.html} | 331 +-
.../example_cloud_memorystore_memcached.html} | 326 +-
.../example_cloud_memorystore_redis.html} | 476 +-
.../google/cloud/cloud_sql/example_cloud_sql.html} | 484 +-
.../cloud/composer/example_cloud_composer.html} | 309 +-
.../example_cloud_composer_deferrable.html} | 299 +-
.../google/cloud/compute/example_compute.html} | 459 +-
.../google/cloud/compute/example_compute_igm.html} | 456 +-
.../google/cloud/compute/example_compute_ssh.html} | 302 +-
.../example_dlp_deidentify_content.html} | 341 +-
.../example_dlp_info_types.html} | 335 +-
.../example_dlp_inspect_template.html} | 299 +-
.../data_loss_prevention/example_dlp_job.html} | 274 +-
.../example_dlp_job_trigger.html} | 279 +-
.../dataflow/example_dataflow_native_java.html} | 289 +-
.../dataflow/example_dataflow_native_python.html} | 296 +-
.../example_dataflow_native_python_async.html} | 401 +-
.../cloud/dataflow/example_dataflow_template.html} | 271 +-
.../google/cloud/dataform/example_dataform.html} | 480 +-
.../cloud/datafusion/example_datafusion.html} | 503 +-
.../datafusion/example_datafusion_async.html} | 483 +-
.../google/cloud/dataplex/example_dataplex.html} | 387 +-
.../dataplex/resources/spark_example_pi.html} | 278 +-
.../google/cloud/dataprep/example_dataprep.html} | 348 +-
.../cloud/dataproc/example_dataproc_batch.html} | 355 +-
.../example_dataproc_batch_deferrable.html} | 263 +-
.../example_dataproc_batch_persistent.html} | 296 +-
.../example_dataproc_cluster_deferrable.html} | 297 +-
.../example_dataproc_cluster_generator.html} | 296 +-
.../cloud/dataproc/example_dataproc_gke.html} | 297 +-
.../cloud/dataproc/example_dataproc_hadoop.html} | 315 +-
.../cloud/dataproc/example_dataproc_hive.html} | 288 +-
.../cloud/dataproc/example_dataproc_pig.html} | 282 +-
.../cloud/dataproc/example_dataproc_pyspark.html} | 312 +-
.../cloud/dataproc/example_dataproc_spark.html} | 284 +-
.../dataproc/example_dataproc_spark_async.html} | 292 +-
.../example_dataproc_spark_deferrable.html} | 285 +-
.../dataproc/example_dataproc_spark_sql.html} | 280 +-
.../cloud/dataproc/example_dataproc_sparkr.html} | 306 +-
.../cloud/dataproc/example_dataproc_update.html} | 290 +-
.../cloud/dataproc/example_dataproc_workflow.html} | 277 +-
.../cloud/dataproc/resources/hello_world.html} | 260 +-
.../example_dataproc_metastore.html} | 400 +-
.../example_dataproc_metastore_backup.html} | 309 +-
.../cloud/datastore/example_datastore_commit.html} | 272 +-
.../example_datastore_export_import.html} | 287 +-
.../cloud/datastore/example_datastore_query.html} | 312 +-
.../datastore/example_datastore_rollback.html} | 295 +-
.../google/cloud/gcs/example_calendar_to_gcs.html} | 306 +-
.../google/cloud/gcs/example_firestore.html} | 343 +-
.../google/cloud/gcs/example_gcs_acl.html} | 295 +-
.../google/cloud/gcs/example_gcs_copy_delete.html} | 304 +-
.../google/cloud/gcs/example_gcs_sensor.html} | 342 +-
.../google/cloud/gcs/example_gcs_to_bigquery.html} | 264 +-
.../cloud/gcs/example_gcs_to_bigquery_async.html} | 356 +-
.../google/cloud/gcs/example_gcs_to_gcs.html} | 419 +-
.../google/cloud/gcs/example_gcs_to_gdrive.html} | 302 +-
.../google/cloud/gcs/example_gcs_to_sheets.html} | 259 +-
.../google/cloud/gcs/example_gcs_transform.html} | 275 +-
.../cloud/gcs/example_gcs_transform_timespan.html} | 294 +-
.../cloud/gcs/example_gcs_upload_download.html} | 275 +-
.../google/cloud/gcs/example_gdrive_to_gcs.html} | 284 +-
.../google/cloud/gcs/example_mssql_to_gcs.html} | 262 +-
.../google/cloud/gcs/example_mysql_to_gcs.html} | 310 +-
.../google/cloud/gcs/example_oracle_to_gcs.html} | 302 +-
.../google/cloud/gcs/example_s3_to_gcs.html} | 275 +-
.../google/cloud/gcs/example_sftp_to_gcs.html} | 303 +-
.../google/cloud/gcs/example_sheets.html} | 284 +-
.../google/cloud/gcs/example_sheets_to_gcs.html} | 304 +-
.../google/cloud/gcs/example_trino_to_gcs.html} | 388 +-
.../cloud/gcs/resources/transform_script.html} | 263 +-
.../cloud/gcs/resources/transform_timespan.html} | 273 +-
.../example_kubernetes_engine.html} | 292 +-
.../example_kubernetes_engine_async.html} | 290 +-
.../life_sciences/example_life_sciences.html} | 315 +-
.../google/cloud/ml_engine/example_mlengine.html} | 657 +-
.../cloud/ml_engine/example_mlengine_async.html} | 658 +-
.../example_natural_language.html} | 297 +-
.../google/cloud/pubsub/example_pubsub.html} | 331 +-
.../google/cloud/spanner/example_spanner.html} | 344 +-
.../speech_to_text/example_speech_to_text.html} | 271 +-
.../sql_to_sheets/example_sql_to_sheets.html} | 287 +-
.../cloud/stackdriver/example_stackdriver.html} | 439 +-
...xample_cloud_storage_transfer_service_gcp.html} | 383 +-
.../google/cloud/tasks/example_queue.html} | 372 +-
.../google/cloud/tasks/example_tasks.html} | 367 +-
.../text_to_speech/example_text_to_speech.html} | 262 +-
.../cloud/transfers/example_gcs_to_sftp.html} | 354 +-
.../cloud/transfers/example_gdrive_to_local.html} | 291 +-
.../google/cloud/translate/example_translate.html} | 303 +-
.../example_translate_speech.html} | 294 +-
...le_vertex_ai_auto_ml_forecasting_training.html} | 368 +-
.../example_vertex_ai_auto_ml_image_training.html} | 358 +-
.../example_vertex_ai_auto_ml_list_training.html} | 294 +-
...xample_vertex_ai_auto_ml_tabular_training.html} | 362 +-
.../example_vertex_ai_auto_ml_text_training.html} | 356 +-
.../example_vertex_ai_auto_ml_video_training.html} | 352 +-
.../example_vertex_ai_batch_prediction_job.html} | 407 +-
.../example_vertex_ai_custom_container.html} | 356 +-
.../vertex_ai/example_vertex_ai_custom_job.html} | 377 +-
...ample_vertex_ai_custom_job_python_package.html} | 393 +-
.../vertex_ai/example_vertex_ai_dataset.html} | 640 +-
.../vertex_ai/example_vertex_ai_endpoint.html} | 458 +-
...ample_vertex_ai_hyperparameter_tuning_job.html} | 331 +-
.../example_vertex_ai_list_custom_jobs.html} | 292 +-
.../example_vertex_ai_model_service.html} | 419 +-
.../example_video_intelligence.html} | 341 +-
.../vision/example_vision_annotate_image.html} | 374 +-
.../vision/example_vision_autogenerated.html} | 451 +-
.../cloud/vision/example_vision_explicit.html} | 460 +-
.../google/cloud/workflows/example_workflows.html} | 445 +-
.../tests/system/providers/google/conftest.html} | 261 +-
.../datacatalog/example_datacatalog_entries.html} | 487 +-
.../example_datacatalog_search_catalog.html} | 508 +-
.../example_datacatalog_tag_templates.html} | 470 +-
.../datacatalog/example_datacatalog_tags.html} | 520 +-
.../providers/google/leveldb/example_leveldb.html} | 246 +-
.../marketing_platform/example_analytics.html} | 291 +-
.../example_campaign_manager.html} | 478 +-
.../marketing_platform/example_search_ads.html} | 263 +-
.../google/suite/example_local_to_drive.html} | 259 +-
.../providers/google/ads/hooks/ads/index.rst.txt | 113 +
.../providers/google/ads/hooks/index.rst.txt | 15 +
.../airflow/providers/google/ads/index.rst.txt | 17 +
.../google/ads/operators/ads/index.rst.txt | 73 +
.../providers/google/ads/operators/index.rst.txt | 15 +
.../google/ads/transfers/ads_to_gcs/index.rst.txt | 69 +
.../providers/google/ads/transfers/index.rst.txt | 15 +
.../google/cloud/hooks/automl/index.rst.txt | 329 +
.../google/cloud/hooks/bigquery/index.rst.txt | 1294 ++
.../google/cloud/hooks/bigquery_dts/index.rst.txt | 166 +
.../google/cloud/hooks/bigtable/index.rst.txt | 157 +
.../google/cloud/hooks/cloud_build/index.rst.txt | 277 +
.../cloud/hooks/cloud_composer/index.rst.txt | 214 +
.../cloud/hooks/cloud_memorystore/index.rst.txt | 406 +
.../google/cloud/hooks/cloud_sql/index.rst.txt | 446 +
.../cloud_storage_transfer_service/index.rst.txt | 530 +
.../google/cloud/hooks/compute/index.rst.txt | 383 +
.../google/cloud/hooks/compute_ssh/index.rst.txt | 74 +
.../google/cloud/hooks/datacatalog/index.rst.txt | 513 +
.../google/cloud/hooks/dataflow/index.rst.txt | 438 +
.../google/cloud/hooks/dataform/index.rst.txt | 232 +
.../google/cloud/hooks/datafusion/index.rst.txt | 275 +
.../google/cloud/hooks/dataplex/index.rst.txt | 169 +
.../google/cloud/hooks/dataprep/index.rst.txt | 153 +
.../google/cloud/hooks/dataproc/index.rst.txt | 845 +
.../cloud/hooks/dataproc_metastore/index.rst.txt | 331 +
.../google/cloud/hooks/datastore/index.rst.txt | 185 +
.../providers/google/cloud/hooks/dlp/index.rst.txt | 658 +
.../google/cloud/hooks/functions/index.rst.txt | 115 +
.../providers/google/cloud/hooks/gcs/index.rst.txt | 468 +
.../providers/google/cloud/hooks/gdm/index.rst.txt | 50 +
.../providers/google/cloud/hooks/index.rst.txt | 65 +
.../providers/google/cloud/hooks/kms/index.rst.txt | 86 +
.../cloud/hooks/kubernetes_engine/index.rst.txt | 164 +
.../google/cloud/hooks/life_sciences/index.rst.txt | 78 +
.../google/cloud/hooks/looker/index.rst.txt | 133 +
.../google/cloud/hooks/mlengine/index.rst.txt | 243 +
.../cloud/hooks/natural_language/index.rst.txt | 140 +
.../google/cloud/hooks/os_login/index.rst.txt | 59 +
.../google/cloud/hooks/pubsub/index.rst.txt | 246 +
.../cloud/hooks/secret_manager/index.rst.txt | 65 +
.../google/cloud/hooks/spanner/index.rst.txt | 159 +
.../cloud/hooks/speech_to_text/index.rst.txt | 65 +
.../google/cloud/hooks/stackdriver/index.rst.txt | 227 +
.../google/cloud/hooks/tasks/index.rst.txt | 296 +
.../cloud/hooks/text_to_speech/index.rst.txt | 72 +
.../google/cloud/hooks/translate/index.rst.txt | 77 +
.../cloud/hooks/vertex_ai/auto_ml/index.rst.txt | 716 +
.../vertex_ai/batch_prediction_job/index.rst.txt | 202 +
.../cloud/hooks/vertex_ai/custom_job/index.rst.txt | 1119 ++
.../cloud/hooks/vertex_ai/dataset/index.rst.txt | 193 +
.../hooks/vertex_ai/endpoint_service/index.rst.txt | 195 +
.../hyperparameter_tuning_job/index.rst.txt | 205 +
.../google/cloud/hooks/vertex_ai/index.rst.txt | 21 +
.../hooks/vertex_ai/model_service/index.rst.txt | 118 +
.../cloud/hooks/video_intelligence/index.rst.txt | 76 +
.../google/cloud/hooks/vision/index.rst.txt | 244 +
.../google/cloud/hooks/workflows/index.rst.txt | 189 +
.../airflow/providers/google/cloud/index.rst.txt | 23 +
.../google/cloud/links/automl/index.rst.txt | 191 +
.../google/cloud/links/base/index.rst.txt | 66 +
.../google/cloud/links/bigquery/index.rst.txt | 98 +
.../google/cloud/links/bigquery_dts/index.rst.txt | 67 +
.../google/cloud/links/bigtable/index.rst.txt | 124 +
.../google/cloud/links/cloud_build/index.rst.txt | 155 +
.../cloud/links/cloud_functions/index.rst.txt | 98 +
.../cloud/links/cloud_memorystore/index.rst.txt | 160 +
.../google/cloud/links/cloud_sql/index.rst.txt | 98 +
.../links/cloud_storage_transfer/index.rst.txt | 139 +
.../google/cloud/links/cloud_tasks/index.rst.txt | 105 +
.../google/cloud/links/compute/index.rst.txt | 129 +
.../cloud/links/data_loss_prevention/index.rst.txt | 377 +
.../google/cloud/links/datacatalog/index.rst.txt | 129 +
.../google/cloud/links/dataflow/index.rst.txt | 67 +
.../google/cloud/links/dataform/index.rst.txt | 129 +
.../google/cloud/links/datafusion/index.rst.txt | 167 +
.../google/cloud/links/dataplex/index.rst.txt | 130 +
.../google/cloud/links/dataprep/index.rst.txt | 93 +
.../google/cloud/links/dataproc/index.rst.txt | 133 +
.../google/cloud/links/datastore/index.rst.txt | 99 +
.../providers/google/cloud/links/index.rst.txt | 43 +
.../cloud/links/kubernetes_engine/index.rst.txt | 93 +
.../google/cloud/links/life_sciences/index.rst.txt | 62 +
.../google/cloud/links/mlengine/index.rst.txt | 191 +
.../google/cloud/links/pubsub/index.rst.txt | 98 +
.../google/cloud/links/spanner/index.rst.txt | 98 +
.../google/cloud/links/stackdriver/index.rst.txt | 98 +
.../google/cloud/links/vertex_ai/index.rst.txt | 410 +
.../google/cloud/links/workflows/index.rst.txt | 129 +
.../cloud/log/gcs_task_handler/index.rst.txt | 105 +
.../providers/google/cloud/log/index.rst.txt | 16 +
.../log/stackdriver_task_handler/index.rst.txt | 176 +
.../google/cloud/operators/automl/index.rst.txt | 716 +
.../google/cloud/operators/bigquery/index.rst.txt | 1585 ++
.../cloud/operators/bigquery_dts/index.rst.txt | 193 +
.../google/cloud/operators/bigtable/index.rst.txt | 378 +
.../cloud/operators/cloud_build/index.rst.txt | 634 +
.../cloud/operators/cloud_composer/index.rst.txt | 377 +
.../operators/cloud_memorystore/index.rst.txt | 995 ++
.../google/cloud/operators/cloud_sql/index.rst.txt | 597 +
.../cloud_storage_transfer_service/index.rst.txt | 594 +
.../google/cloud/operators/compute/index.rst.txt | 733 +
.../cloud/operators/datacatalog/index.rst.txt | 1205 ++
.../google/cloud/operators/dataflow/index.rst.txt | 845 +
.../google/cloud/operators/dataform/index.rst.txt | 605 +
.../cloud/operators/datafusion/index.rst.txt | 554 +
.../google/cloud/operators/dataplex/index.rst.txt | 331 +
.../google/cloud/operators/dataprep/index.rst.txt | 216 +
.../google/cloud/operators/dataproc/index.rst.txt | 1289 ++
.../operators/dataproc_metastore/index.rst.txt | 679 +
.../google/cloud/operators/datastore/index.rst.txt | 457 +
.../google/cloud/operators/dlp/index.rst.txt | 1659 ++
.../google/cloud/operators/functions/index.rst.txt | 259 +
.../google/cloud/operators/gcs/index.rst.txt | 574 +
.../providers/google/cloud/operators/index.rst.txt | 61 +
.../operators/kubernetes_engine/index.rst.txt | 240 +
.../cloud/operators/life_sciences/index.rst.txt | 69 +
.../google/cloud/operators/looker/index.rst.txt | 62 +
.../google/cloud/operators/mlengine/index.rst.txt | 768 +
.../cloud/operators/natural_language/index.rst.txt | 214 +
.../google/cloud/operators/pubsub/index.rst.txt | 571 +
.../google/cloud/operators/spanner/index.rst.txt | 336 +
.../cloud/operators/speech_to_text/index.rst.txt | 76 +
.../cloud/operators/stackdriver/index.rst.txt | 658 +
.../google/cloud/operators/tasks/index.rst.txt | 732 +
.../cloud/operators/text_to_speech/index.rst.txt | 80 +
.../google/cloud/operators/translate/index.rst.txt | 92 +
.../cloud/operators/translate_speech/index.rst.txt | 114 +
.../operators/vertex_ai/auto_ml/index.rst.txt | 215 +
.../vertex_ai/batch_prediction_job/index.rst.txt | 310 +
.../operators/vertex_ai/custom_job/index.rst.txt | 998 ++
.../operators/vertex_ai/dataset/index.rst.txt | 329 +
.../vertex_ai/endpoint_service/index.rst.txt | 388 +
.../hyperparameter_tuning_job/index.rst.txt | 275 +
.../google/cloud/operators/vertex_ai/index.rst.txt | 21 +
.../vertex_ai/model_service/index.rst.txt | 221 +
.../operators/video_intelligence/index.rst.txt | 182 +
.../google/cloud/operators/vision/index.rst.txt | 935 +
.../google/cloud/operators/workflows/index.rst.txt | 413 +
.../providers/google/cloud/secrets/index.rst.txt | 15 +
.../cloud/secrets/secret_manager/index.rst.txt | 123 +
.../google/cloud/sensors/bigquery/index.rst.txt | 152 +
.../cloud/sensors/bigquery_dts/index.rst.txt | 70 +
.../google/cloud/sensors/bigtable/index.rst.txt | 72 +
.../cloud/sensors/cloud_composer/index.rst.txt | 59 +
.../cloud_storage_transfer_service/index.rst.txt | 69 +
.../google/cloud/sensors/dataflow/index.rst.txt | 204 +
.../google/cloud/sensors/dataform/index.rst.txt | 65 +
.../google/cloud/sensors/datafusion/index.rst.txt | 66 +
.../google/cloud/sensors/dataplex/index.rst.txt | 92 +
.../google/cloud/sensors/dataprep/index.rst.txt | 44 +
.../google/cloud/sensors/dataproc/index.rst.txt | 101 +
.../google/cloud/sensors/gcs/index.rst.txt | 281 +
.../providers/google/cloud/sensors/index.rst.txt | 30 +
.../google/cloud/sensors/looker/index.rst.txt | 54 +
.../google/cloud/sensors/pubsub/index.rst.txt | 103 +
.../google/cloud/sensors/tasks/index.rst.txt | 55 +
.../google/cloud/sensors/workflows/index.rst.txt | 51 +
.../cloud/transfers/adls_to_gcs/index.rst.txt | 109 +
.../transfers/azure_fileshare_to_gcs/index.rst.txt | 68 +
.../transfers/bigquery_to_bigquery/index.rst.txt | 103 +
.../cloud/transfers/bigquery_to_gcs/index.rst.txt | 115 +
.../transfers/bigquery_to_mssql/index.rst.txt | 95 +
.../transfers/bigquery_to_mysql/index.rst.txt | 91 +
.../cloud/transfers/calendar_to_gcs/index.rst.txt | 85 +
.../cloud/transfers/cassandra_to_gcs/index.rst.txt | 191 +
.../transfers/facebook_ads_to_gcs/index.rst.txt | 101 +
.../cloud/transfers/gcs_to_bigquery/index.rst.txt | 202 +
.../cloud/transfers/gcs_to_gcs/index.rst.txt | 192 +
.../cloud/transfers/gcs_to_local/index.rst.txt | 79 +
.../cloud/transfers/gcs_to_sftp/index.rst.txt | 122 +
.../cloud/transfers/gdrive_to_gcs/index.rst.txt | 64 +
.../cloud/transfers/gdrive_to_local/index.rst.txt | 61 +
.../providers/google/cloud/transfers/index.rst.txt | 41 +
.../cloud/transfers/local_to_gcs/index.rst.txt | 66 +
.../cloud/transfers/mssql_to_gcs/index.rst.txt | 84 +
.../cloud/transfers/mysql_to_gcs/index.rst.txt | 79 +
.../cloud/transfers/oracle_to_gcs/index.rst.txt | 73 +
.../cloud/transfers/postgres_to_gcs/index.rst.txt | 68 +
.../cloud/transfers/presto_to_gcs/index.rst.txt | 55 +
.../google/cloud/transfers/s3_to_gcs/index.rst.txt | 102 +
.../transfers/salesforce_to_gcs/index.rst.txt | 70 +
.../cloud/transfers/sftp_to_gcs/index.rst.txt | 93 +
.../cloud/transfers/sheets_to_gcs/index.rst.txt | 64 +
.../cloud/transfers/sql_to_gcs/index.rst.txt | 130 +
.../cloud/transfers/trino_to_gcs/index.rst.txt | 55 +
.../google/cloud/triggers/bigquery/index.rst.txt | 171 +
.../cloud/triggers/bigquery_dts/index.rst.txt | 55 +
.../cloud/triggers/cloud_build/index.rst.txt | 53 +
.../cloud/triggers/cloud_composer/index.rst.txt | 51 +
.../google/cloud/triggers/dataflow/index.rst.txt | 73 +
.../google/cloud/triggers/datafusion/index.rst.txt | 57 +
.../google/cloud/triggers/dataproc/index.rst.txt | 171 +
.../google/cloud/triggers/gcs/index.rst.txt | 42 +
.../providers/google/cloud/triggers/index.rst.txt | 24 +
.../cloud/triggers/kubernetes_engine/index.rst.txt | 37 +
.../google/cloud/triggers/mlengine/index.rst.txt | 42 +
.../google/cloud/utils/bigquery/index.rst.txt | 25 +
.../cloud/utils/bigquery_get_data/index.rst.txt | 22 +
.../cloud/utils/credentials_provider/index.rst.txt | 103 +
.../google/cloud/utils/dataform/index.rst.txt | 59 +
.../cloud/utils/field_sanitizer/index.rst.txt | 126 +
.../cloud/utils/field_validator/index.rst.txt | 197 +
.../google/cloud/utils/helpers/index.rst.txt | 29 +
.../providers/google/cloud/utils/index.rst.txt | 23 +
.../utils/mlengine_operator_utils/index.rst.txt | 169 +
.../mlengine_prediction_summary/index.rst.txt | 150 +
.../auth_backend/google_openid/index.rst.txt | 63 +
.../google/common/auth_backend/index.rst.txt | 15 +
.../providers/google/common/consts/index.rst.txt | 18 +
.../google/common/hooks/base_google/index.rst.txt | 335 +
.../common/hooks/discovery_api/index.rst.txt | 70 +
.../providers/google/common/hooks/index.rst.txt | 16 +
.../airflow/providers/google/common/index.rst.txt | 27 +
.../providers/google/common/links/index.rst.txt | 15 +
.../google/common/links/storage/index.rst.txt | 98 +
.../utils/id_token_credentials/index.rst.txt | 102 +
.../providers/google/common/utils/index.rst.txt | 15 +
.../google/config_templates/index.rst.txt | 6 +
.../google/firebase/hooks/firestore/index.rst.txt | 80 +
.../providers/google/firebase/hooks/index.rst.txt | 15 +
.../providers/google/firebase/index.rst.txt | 16 +
.../firebase/operators/firestore/index.rst.txt | 62 +
.../google/firebase/operators/index.rst.txt | 15 +
.../providers/google/go_module_utils/index.rst.txt | 43 +
.../_api/airflow/providers/google/index.rst.txt | 47 +
.../providers/google/leveldb/hooks/index.rst.txt | 15 +
.../google/leveldb/hooks/leveldb/index.rst.txt | 131 +
.../airflow/providers/google/leveldb/index.rst.txt | 16 +
.../google/leveldb/operators/index.rst.txt | 15 +
.../google/leveldb/operators/leveldb/index.rst.txt | 49 +
.../hooks/analytics/index.rst.txt | 88 +
.../hooks/campaign_manager/index.rst.txt | 141 +
.../hooks/display_video/index.rst.txt | 134 +
.../google/marketing_platform/hooks/index.rst.txt | 18 +
.../hooks/search_ads/index.rst.txt | 58 +
.../google/marketing_platform/index.rst.txt | 17 +
.../operators/analytics/index.rst.txt | 278 +
.../operators/campaign_manager/index.rst.txt | 336 +
.../operators/display_video/index.rst.txt | 393 +
.../marketing_platform/operators/index.rst.txt | 18 +
.../operators/search_ads/index.rst.txt | 131 +
.../sensors/campaign_manager/index.rst.txt | 67 +
.../sensors/display_video/index.rst.txt | 100 +
.../marketing_platform/sensors/index.rst.txt | 17 +
.../sensors/search_ads/index.rst.txt | 65 +
.../google/suite/hooks/calendar/index.rst.txt | 102 +
.../google/suite/hooks/drive/index.rst.txt | 110 +
.../providers/google/suite/hooks/index.rst.txt | 17 +
.../google/suite/hooks/sheets/index.rst.txt | 198 +
.../airflow/providers/google/suite/index.rst.txt | 18 +
.../providers/google/suite/operators/index.rst.txt | 15 +
.../google/suite/operators/sheets/index.rst.txt | 59 +
.../google/suite/sensors/drive/index.rst.txt | 64 +
.../providers/google/suite/sensors/index.rst.txt | 15 +
.../suite/transfers/gcs_to_gdrive/index.rst.txt | 104 +
.../suite/transfers/gcs_to_sheets/index.rst.txt | 61 +
.../providers/google/suite/transfers/index.rst.txt | 18 +
.../suite/transfers/local_to_drive/index.rst.txt | 77 +
.../suite/transfers/sql_to_sheets/index.rst.txt | 74 +
.../providers/google/ads/example_ads/index.rst.txt | 93 +
.../system/providers/google/ads/index.rst.txt | 15 +
.../automl/example_automl_dataset/index.rst.txt | 104 +
.../automl/example_automl_model/index.rst.txt | 124 +
.../index.rst.txt | 64 +
.../index.rst.txt | 64 +
.../providers/google/cloud/automl/index.rst.txt | 27 +
.../google/cloud/automl/resources/index.rst.txt | 6 +
.../example_azure_fileshare_to_gcs/index.rst.txt | 43 +
.../providers/google/cloud/azure/index.rst.txt | 15 +
.../example_bigquery_dataset/index.rst.txt | 35 +
.../bigquery/example_bigquery_dts/index.rst.txt | 69 +
.../example_bigquery_operations/index.rst.txt | 48 +
.../index.rst.txt | 40 +
.../example_bigquery_queries/index.rst.txt | 63 +
.../example_bigquery_queries_async/index.rst.txt | 79 +
.../example_bigquery_sensors/index.rst.txt | 61 +
.../bigquery/example_bigquery_tables/index.rst.txt | 56 +
.../example_bigquery_to_bigquery/index.rst.txt | 50 +
.../bigquery/example_bigquery_to_gcs/index.rst.txt | 53 +
.../example_bigquery_to_gcs_async/index.rst.txt | 53 +
.../example_bigquery_to_mssql/index.rst.txt | 53 +
.../example_bigquery_transfer/index.rst.txt | 53 +
.../providers/google/cloud/bigquery/index.rst.txt | 36 +
.../google/cloud/bigquery/resources/index.rst.txt | 6 +
.../cloud/bigtable/example_bigtable/index.rst.txt | 123 +
.../providers/google/cloud/bigtable/index.rst.txt | 15 +
.../cloud_build/example_cloud_build/index.rst.txt | 80 +
.../example_cloud_build_async/index.rst.txt | 80 +
.../example_cloud_build_trigger/index.rst.txt | 59 +
.../google/cloud/cloud_build/index.rst.txt | 26 +
.../cloud/cloud_build/resources/index.rst.txt | 6 +
.../example_functions/index.rst.txt | 112 +
.../google/cloud/cloud_functions/index.rst.txt | 15 +
.../index.rst.txt | 48 +
.../example_cloud_memorystore_redis/index.rst.txt | 72 +
.../google/cloud/cloud_memorystore/index.rst.txt | 16 +
.../cloud_sql/example_cloud_sql/index.rst.txt | 98 +
.../providers/google/cloud/cloud_sql/index.rst.txt | 15 +
.../composer/example_cloud_composer/index.rst.txt | 51 +
.../index.rst.txt | 51 +
.../providers/google/cloud/composer/index.rst.txt | 16 +
.../cloud/compute/example_compute/index.rst.txt | 73 +
.../compute/example_compute_igm/index.rst.txt | 96 +
.../compute/example_compute_ssh/index.rst.txt | 60 +
.../providers/google/cloud/compute/index.rst.txt | 17 +
.../example_dlp_deidentify_content/index.rst.txt | 63 +
.../example_dlp_info_types/index.rst.txt | 94 +
.../example_dlp_inspect_template/index.rst.txt | 51 +
.../example_dlp_job/index.rst.txt | 47 +
.../example_dlp_job_trigger/index.rst.txt | 43 +
.../cloud/data_loss_prevention/index.rst.txt | 28 +
.../data_loss_prevention/resources/index.rst.txt | 6 +
.../example_dataflow_native_java/index.rst.txt | 68 +
.../example_dataflow_native_python/index.rst.txt | 69 +
.../index.rst.txt | 69 +
.../example_dataflow_template/index.rst.txt | 70 +
.../providers/google/cloud/dataflow/index.rst.txt | 27 +
.../google/cloud/dataflow/resources/index.rst.txt | 6 +
.../cloud/dataform/example_dataform/index.rst.txt | 48 +
.../providers/google/cloud/dataform/index.rst.txt | 15 +
.../datafusion/example_datafusion/index.rst.txt | 71 +
.../example_datafusion_async/index.rst.txt | 71 +
.../google/cloud/datafusion/index.rst.txt | 16 +
.../cloud/dataplex/example_dataplex/index.rst.txt | 86 +
.../providers/google/cloud/dataplex/index.rst.txt | 24 +
.../google/cloud/dataplex/resources/index.rst.txt | 15 +
.../resources/spark_example_pi/index.rst.txt | 13 +
.../cloud/dataprep/example_dataprep/index.rst.txt | 60 +
.../providers/google/cloud/dataprep/index.rst.txt | 15 +
.../dataproc/example_dataproc_batch/index.rst.txt | 60 +
.../index.rst.txt | 49 +
.../index.rst.txt | 60 +
.../index.rst.txt | 65 +
.../index.rst.txt | 71 +
.../dataproc/example_dataproc_gke/index.rst.txt | 56 +
.../dataproc/example_dataproc_hadoop/index.rst.txt | 82 +
.../dataproc/example_dataproc_hive/index.rst.txt | 61 +
.../dataproc/example_dataproc_pig/index.rst.txt | 61 +
.../example_dataproc_pyspark/index.rst.txt | 74 +
.../dataproc/example_dataproc_spark/index.rst.txt | 61 +
.../example_dataproc_spark_async/index.rst.txt | 61 +
.../index.rst.txt | 62 +
.../example_dataproc_spark_sql/index.rst.txt | 61 +
.../dataproc/example_dataproc_sparkr/index.rst.txt | 74 +
.../dataproc/example_dataproc_update/index.rst.txt | 65 +
.../example_dataproc_workflow/index.rst.txt | 61 +
.../providers/google/cloud/dataproc/index.rst.txt | 40 +
.../dataproc/resources/hello_world/index.rst.txt | 21 +
.../google/cloud/dataproc/resources/index.rst.txt | 15 +
.../example_dataproc_metastore/index.rst.txt | 96 +
.../index.rst.txt | 62 +
.../google/cloud/dataproc_metastore/index.rst.txt | 16 +
.../example_datastore_commit/index.rst.txt | 44 +
.../example_datastore_export_import/index.rst.txt | 39 +
.../example_datastore_query/index.rst.txt | 44 +
.../example_datastore_rollback/index.rst.txt | 40 +
.../providers/google/cloud/datastore/index.rst.txt | 18 +
.../gcs/example_calendar_to_gcs/index.rst.txt | 43 +
.../cloud/gcs/example_firestore/index.rst.txt | 86 +
.../google/cloud/gcs/example_gcs_acl/index.rst.txt | 63 +
.../gcs/example_gcs_copy_delete/index.rst.txt | 53 +
.../cloud/gcs/example_gcs_sensor/index.rst.txt | 84 +
.../gcs/example_gcs_to_bigquery/index.rst.txt | 44 +
.../example_gcs_to_bigquery_async/index.rst.txt | 81 +
.../cloud/gcs/example_gcs_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_gcs_to_gdrive/index.rst.txt | 64 +
.../cloud/gcs/example_gcs_to_sheets/index.rst.txt | 42 +
.../cloud/gcs/example_gcs_transform/index.rst.txt | 52 +
.../example_gcs_transform_timespan/index.rst.txt | 66 +
.../gcs/example_gcs_upload_download/index.rst.txt | 53 +
.../cloud/gcs/example_gdrive_to_gcs/index.rst.txt | 53 +
.../cloud/gcs/example_mssql_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_mysql_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_oracle_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_s3_to_gcs/index.rst.txt | 79 +
.../cloud/gcs/example_sftp_to_gcs/index.rst.txt | 81 +
.../google/cloud/gcs/example_sheets/index.rst.txt | 46 +
.../cloud/gcs/example_sheets_to_gcs/index.rst.txt | 38 +
.../cloud/gcs/example_trino_to_gcs/index.rst.txt | 84 +
.../providers/google/cloud/gcs/index.rst.txt | 45 +
.../google/cloud/gcs/resources/index.rst.txt | 16 +
.../gcs/resources/transform_script/index.rst.txt | 21 +
.../gcs/resources/transform_timespan/index.rst.txt | 29 +
.../system/providers/google/cloud/index.rst.txt | 53 +
.../example_kubernetes_engine/index.rst.txt | 48 +
.../example_kubernetes_engine_async/index.rst.txt | 48 +
.../google/cloud/kubernetes_engine/index.rst.txt | 16 +
.../example_life_sciences/index.rst.txt | 60 +
.../google/cloud/life_sciences/index.rst.txt | 24 +
.../cloud/life_sciences/resources/index.rst.txt | 6 +
.../cloud/ml_engine/example_mlengine/index.rst.txt | 133 +
.../ml_engine/example_mlengine_async/index.rst.txt | 133 +
.../providers/google/cloud/ml_engine/index.rst.txt | 16 +
.../example_natural_language/index.rst.txt | 67 +
.../google/cloud/natural_language/index.rst.txt | 15 +
.../cloud/pubsub/example_pubsub/index.rst.txt | 68 +
.../providers/google/cloud/pubsub/index.rst.txt | 15 +
.../cloud/spanner/example_spanner/index.rst.txt | 62 +
.../providers/google/cloud/spanner/index.rst.txt | 15 +
.../example_speech_to_text/index.rst.txt | 58 +
.../google/cloud/speech_to_text/index.rst.txt | 15 +
.../example_sql_to_sheets/index.rst.txt | 35 +
.../google/cloud/sql_to_sheets/index.rst.txt | 15 +
.../stackdriver/example_stackdriver/index.rst.txt | 67 +
.../google/cloud/stackdriver/index.rst.txt | 15 +
.../index.rst.txt | 76 +
.../google/cloud/storage_transfer/index.rst.txt | 24 +
.../cloud/storage_transfer/resources/index.rst.txt | 6 +
.../google/cloud/tasks/example_queue/index.rst.txt | 66 +
.../google/cloud/tasks/example_tasks/index.rst.txt | 82 +
.../providers/google/cloud/tasks/index.rst.txt | 16 +
.../example_text_to_speech/index.rst.txt | 51 +
.../google/cloud/text_to_speech/index.rst.txt | 15 +
.../transfers/example_gcs_to_sftp/index.rst.txt | 76 +
.../example_gdrive_to_local/index.rst.txt | 56 +
.../providers/google/cloud/transfers/index.rst.txt | 25 +
.../google/cloud/transfers/resources/index.rst.txt | 6 +
.../translate/example_translate/index.rst.txt | 28 +
.../providers/google/cloud/translate/index.rst.txt | 15 +
.../example_translate_speech/index.rst.txt | 77 +
.../google/cloud/translate_speech/index.rst.txt | 15 +
.../index.rst.txt | 93 +
.../index.rst.txt | 78 +
.../index.rst.txt | 40 +
.../index.rst.txt | 79 +
.../index.rst.txt | 78 +
.../index.rst.txt | 78 +
.../index.rst.txt | 105 +
.../index.rst.txt | 123 +
.../example_vertex_ai_custom_job/index.rst.txt | 90 +
.../index.rst.txt | 137 +
.../example_vertex_ai_dataset/index.rst.txt | 93 +
.../example_vertex_ai_endpoint/index.rst.txt | 78 +
.../index.rst.txt | 84 +
.../index.rst.txt | 40 +
.../example_vertex_ai_model_service/index.rst.txt | 101 +
.../providers/google/cloud/vertex_ai/index.rst.txt | 38 +
.../google/cloud/vertex_ai/resources/index.rst.txt | 6 +
.../example_video_intelligence/index.rst.txt | 59 +
.../google/cloud/video_intelligence/index.rst.txt | 15 +
.../example_vision_annotate_image/index.rst.txt | 66 +
.../example_vision_autogenerated/index.rst.txt | 92 +
.../vision/example_vision_explicit/index.rst.txt | 85 +
.../providers/google/cloud/vision/index.rst.txt | 17 +
.../workflows/example_workflows/index.rst.txt | 110 +
.../providers/google/cloud/workflows/index.rst.txt | 15 +
.../system/providers/google/conftest/index.rst.txt | 35 +
.../example_datacatalog_entries/index.rst.txt | 57 +
.../index.rst.txt | 70 +
.../index.rst.txt | 58 +
.../example_datacatalog_tags/index.rst.txt | 70 +
.../providers/google/datacatalog/index.rst.txt | 18 +
.../system/providers/google/firebase/index.rst.txt | 6 +
.../tests/system/providers/google/index.rst.txt | 31 +
.../google/leveldb/example_leveldb/index.rst.txt | 31 +
.../system/providers/google/leveldb/index.rst.txt | 15 +
.../example_analytics/index.rst.txt | 57 +
.../example_campaign_manager/index.rst.txt | 75 +
.../example_search_ads/index.rst.txt | 47 +
.../google/marketing_platform/index.rst.txt | 17 +
.../suite/example_local_to_drive/index.rst.txt | 57 +
.../system/providers/google/suite/index.rst.txt | 24 +
.../providers/google/suite/resources/index.rst.txt | 6 +
.../providers/google/workplace/index.rst.txt | 6 +
.../api-auth-backend/google-openid.rst.txt | 69 +
.../8.10.0/_sources/commits.rst.txt | 1361 ++
.../8.10.0/_sources/configurations-ref.rst.txt | 71 +
.../8.10.0/_sources/connections/gcp.rst.txt | 291 +
.../8.10.0/_sources/connections/gcp_looker.rst.txt | 75 +
.../8.10.0/_sources/connections/gcp_sql.rst.txt | 78 +
.../8.10.0/_sources/connections/gcp_ssh.rst.txt | 72 +
.../8.10.0/_sources/connections/index.rst.txt | 25 +
.../8.10.0/_sources/example-dags.rst.txt | 28 +
.../8.10.0/_sources/index.rst.txt | 199 +
.../installing-providers-from-sources.rst.txt | 18 +
.../8.10.0/_sources/logging/gcs.rst.txt | 78 +
.../8.10.0/_sources/logging/index.rst.txt | 25 +
.../8.10.0/_sources/logging/stackdriver.rst.txt | 79 +
.../8.10.0/_sources/operators/ads.rst.txt | 64 +
.../8.10.0/_sources/operators/cloud/automl.rst.txt | 192 +
.../_sources/operators/cloud/bigquery.rst.txt | 518 +
.../_sources/operators/cloud/bigquery_dts.rst.txt | 131 +
.../_sources/operators/cloud/bigtable.rst.txt | 197 +
.../_sources/operators/cloud/cloud_build.rst.txt | 426 +
.../operators/cloud/cloud_composer.rst.txt | 159 +
.../operators/cloud/cloud_memorystore.rst.txt | 275 +
.../cloud/cloud_memorystore_memcached.rst.txt | 154 +
.../_sources/operators/cloud/cloud_sql.rst.txt | 568 +
.../cloud/cloud_storage_transfer_service.rst.txt | 375 +
.../_sources/operators/cloud/compute.rst.txt | 580 +
.../_sources/operators/cloud/compute_ssh.rst.txt | 68 +
.../operators/cloud/data_loss_prevention.rst.txt | 338 +
.../_sources/operators/cloud/datacatalog.rst.txt | 580 +
.../_sources/operators/cloud/dataflow.rst.txt | 310 +
.../_sources/operators/cloud/dataform.rst.txt | 230 +
.../_sources/operators/cloud/datafusion.rst.txt | 264 +
.../_sources/operators/cloud/dataplex.rst.txt | 144 +
.../_sources/operators/cloud/dataprep.rst.txt | 174 +
.../_sources/operators/cloud/dataproc.rst.txt | 377 +
.../operators/cloud/dataproc_metastore.rst.txt | 196 +
.../_sources/operators/cloud/datastore.rst.txt | 196 +
.../_sources/operators/cloud/functions.rst.txt | 188 +
.../8.10.0/_sources/operators/cloud/gcs.rst.txt | 236 +
.../8.10.0/_sources/operators/cloud/index.rst.txt | 32 +
.../operators/cloud/kubernetes_engine.rst.txt | 159 +
.../_sources/operators/cloud/life_sciences.rst.txt | 74 +
.../8.10.0/_sources/operators/cloud/looker.rst.txt | 70 +
.../_sources/operators/cloud/mlengine.rst.txt | 237 +
.../operators/cloud/natural_language.rst.txt | 178 +
.../8.10.0/_sources/operators/cloud/pubsub.rst.txt | 141 +
.../_sources/operators/cloud/spanner.rst.txt | 276 +
.../operators/cloud/speech_to_text.rst.txt | 81 +
.../_sources/operators/cloud/stackdriver.rst.txt | 227 +
.../8.10.0/_sources/operators/cloud/tasks.rst.txt | 229 +
.../operators/cloud/text_to_speech.rst.txt | 81 +
.../_sources/operators/cloud/translate.rst.txt | 79 +
.../operators/cloud/translate_speech.rst.txt | 78 +
.../_sources/operators/cloud/vertex_ai.rst.txt | 423 +
.../operators/cloud/video_intelligence.rst.txt | 184 +
.../8.10.0/_sources/operators/cloud/vision.rst.txt | 1025 ++
.../_sources/operators/cloud/workflows.rst.txt | 181 +
.../_sources/operators/firebase/firestore.rst.txt | 61 +
.../8.10.0/_sources/operators/index.rst.txt | 32 +
.../_sources/operators/leveldb/leveldb.rst.txt | 52 +
.../operators/marketing_platform/analytics.rst.txt | 81 +
.../marketing_platform/campaign_manager.rst.txt | 161 +
.../marketing_platform/display_video.rst.txt | 222 +
.../operators/marketing_platform/index.rst.txt | 32 +
.../marketing_platform/search_ads.rst.txt | 90 +
.../8.10.0/_sources/operators/suite/sheets.rst.txt | 62 +
.../transfer/azure_fileshare_to_gcs.rst.txt | 54 +
.../transfer/bigquery_to_bigquery.rst.txt | 66 +
.../operators/transfer/bigquery_to_gcs.rst.txt | 69 +
.../operators/transfer/bigquery_to_mssql.rst.txt | 69 +
.../operators/transfer/bigquery_to_mysql.rst.txt | 67 +
.../operators/transfer/calendar_to_gcs.rst.txt | 47 +
.../operators/transfer/facebook_ads_to_gcs.rst.txt | 48 +
.../operators/transfer/gcs_to_bigquery.rst.txt | 77 +
.../_sources/operators/transfer/gcs_to_gcs.rst.txt | 252 +
.../operators/transfer/gcs_to_gdrive.rst.txt | 85 +
.../operators/transfer/gcs_to_local.rst.txt | 52 +
.../operators/transfer/gcs_to_sftp.rst.txt | 99 +
.../operators/transfer/gcs_to_sheets.rst.txt | 48 +
.../operators/transfer/gdrive_to_gcs.rst.txt | 66 +
.../operators/transfer/gdrive_to_local.rst.txt | 53 +
.../_sources/operators/transfer/index.rst.txt | 28 +
.../operators/transfer/local_to_drive.rst.txt | 45 +
.../operators/transfer/local_to_gcs.rst.txt | 53 +
.../operators/transfer/mssql_to_gcs.rst.txt | 50 +
.../operators/transfer/mysql_to_gcs.rst.txt | 53 +
.../operators/transfer/oracle_to_gcs.rst.txt | 53 +
.../operators/transfer/presto_to_gcs.rst.txt | 142 +
.../_sources/operators/transfer/s3_to_gcs.rst.txt | 48 +
.../operators/transfer/salesforce_to_gcs.rst.txt | 45 +
.../operators/transfer/sftp_to_gcs.rst.txt | 101 +
.../operators/transfer/sheets_to_gcs.rst.txt | 48 +
.../operators/transfer/sql_to_sheets.rst.txt | 45 +
.../operators/transfer/trino_to_gcs.rst.txt | 142 +
.../google-cloud-secret-manager-backend.rst.txt | 195 +
.../_sources/sensors/google-cloud-tasks.rst.txt | 39 +
.../8.10.0/_sources/sensors/index.rst.txt | 26 +
.../8.10.0/_static/_gen/css/main-custom.min.css | 1 +
.../8.10.0/_static/_gen/css/main.min.css | 7 +
.../8.10.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../8.10.0/_static/basic.css | 899 +
.../8.10.0/_static/check-solid.svg | 4 +
.../8.10.0/_static/clipboard.min.js | 7 +
.../8.10.0/_static/copy-button.svg | 5 +
.../8.10.0/_static/copybutton.css | 94 +
.../8.10.0/_static/copybutton.js | 248 +
.../8.10.0/_static/copybutton_funcs.js | 73 +
.../8.10.0/_static/doctools.js | 156 +
.../8.10.0/_static/documentation_options.js | 14 +
.../8.10.0/_static/file.png | Bin 0 -> 286 bytes
.../8.10.0/_static/graphviz.css | 19 +
.../8.10.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../8.10.0/_static/jquery.js | 2 +
.../8.10.0/_static/js/globaltoc.js | 24 +
.../8.10.0/_static/language_data.js | 199 +
.../8.10.0/_static/minus.png | Bin 0 -> 90 bytes
.../8.10.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../8.10.0/_static/plus.png | Bin 0 -> 90 bytes
.../8.10.0/_static/pygments.css | 74 +
.../8.10.0/_static/searchtools.js | 566 +
.../8.10.0/_static/sphinx_highlight.js | 144 +
.../8.10.0/_static/underscore-1.13.1.js | 2042 +++
.../8.10.0/_static/underscore.js | 6 +
.../8.10.0/api-auth-backend/google-openid.html} | 198 +-
.../8.10.0/api-auth-backend/index.html | 1 +
.../8.10.0/commits.html | 5583 ++++++
.../8.10.0/configurations-ref.html} | 212 +-
.../8.10.0/connections/gcp.html} | 318 +-
.../8.10.0/connections/gcp_looker.html} | 200 +-
.../8.10.0/connections/gcp_sql.html} | 204 +-
.../8.10.0/connections/gcp_ssh.html} | 206 +-
.../8.10.0/connections/index.html} | 168 +-
.../8.10.0/example-dags.html} | 214 +-
.../8.10.0/genindex.html | 16880 +++++++++++++++++++
.../8.10.0/index.html | 2493 +++
.../8.10.0/installing-providers-from-sources.html} | 257 +-
.../8.10.0/logging/gcs.html} | 206 +-
.../8.10.0/logging/index.html} | 166 +-
.../8.10.0/logging/stackdriver.html} | 203 +-
.../8.10.0/objects.inv | Bin 0 -> 57917 bytes
.../8.10.0/operators/ads.html} | 201 +-
.../8.10.0/operators/cloud/automl.html} | 530 +-
.../8.10.0/operators/cloud/bigquery.html | 1513 ++
.../8.10.0/operators/cloud/bigquery_dts.html} | 356 +-
.../8.10.0/operators/cloud/bigtable.html} | 533 +-
.../8.10.0/operators/cloud/cloud_build.html} | 748 +-
.../8.10.0/operators/cloud/cloud_composer.html} | 417 +-
.../8.10.0/operators/cloud/cloud_memorystore.html} | 579 +-
.../cloud/cloud_memorystore_memcached.html} | 402 +-
.../8.10.0/operators/cloud/cloud_sql.html | 1693 ++
.../cloud/cloud_storage_transfer_service.html} | 720 +-
.../8.10.0/operators/cloud/compute.html} | 1157 +-
.../8.10.0/operators/cloud/compute_ssh.html} | 266 +-
.../operators/cloud/data_loss_prevention.html} | 604 +-
.../8.10.0/operators/cloud/datacatalog.html | 1493 ++
.../8.10.0/operators/cloud/dataflow.html} | 688 +-
.../8.10.0/operators/cloud/dataform.html} | 637 +-
.../8.10.0/operators/cloud/datafusion.html} | 567 +-
.../8.10.0/operators/cloud/dataplex.html} | 394 +-
.../8.10.0/operators/cloud/dataprep.html} | 370 +-
.../8.10.0/operators/cloud/dataproc.html} | 1031 +-
.../operators/cloud/dataproc_metastore.html} | 554 +-
.../8.10.0/operators/cloud/datastore.html} | 498 +-
.../8.10.0/operators/cloud/functions.html} | 398 +-
.../8.10.0/operators/cloud/gcs.html} | 542 +-
.../8.10.0/operators/cloud/index.html} | 252 +-
.../8.10.0/operators/cloud/kubernetes_engine.html} | 382 +-
.../8.10.0/operators/cloud/life_sciences.html} | 251 +-
.../8.10.0/operators/cloud/looker.html} | 255 +-
.../8.10.0/operators/cloud/mlengine.html} | 657 +-
.../8.10.0/operators/cloud/natural_language.html} | 399 +-
.../8.10.0/operators/cloud/pubsub.html} | 370 +-
.../8.10.0/operators/cloud/spanner.html} | 620 +-
.../8.10.0/operators/cloud/speech_to_text.html} | 262 +-
.../8.10.0/operators/cloud/stackdriver.html} | 518 +-
.../8.10.0/operators/cloud/tasks.html} | 549 +-
.../8.10.0/operators/cloud/text_to_speech.html} | 268 +-
.../8.10.0/operators/cloud/translate.html} | 266 +-
.../8.10.0/operators/cloud/translate_speech.html} | 278 +-
.../8.10.0/operators/cloud/vertex_ai.html | 1527 ++
.../operators/cloud/video_intelligence.html} | 422 +-
.../8.10.0/operators/cloud/vision.html | 2064 +++
.../8.10.0/operators/cloud/workflows.html} | 435 +-
.../8.10.0/operators/firebase/firestore.html} | 232 +-
.../8.10.0/operators/index.html} | 171 +-
.../8.10.0/operators/leveldb/leveldb.html} | 228 +-
.../operators/marketing_platform/analytics.html} | 253 +-
.../marketing_platform/campaign_manager.html} | 462 +-
.../marketing_platform/display_video.html} | 400 +-
.../operators/marketing_platform/index.html} | 215 +-
.../operators/marketing_platform/search_ads.html} | 257 +-
.../8.10.0/operators/suite/sheets.html} | 241 +-
.../transfer/azure_fileshare_to_gcs.html} | 239 +-
.../operators/transfer/bigquery_to_bigquery.html} | 240 +-
.../operators/transfer/bigquery_to_gcs.html} | 243 +-
.../operators/transfer/bigquery_to_mssql.html} | 244 +-
.../operators/transfer/bigquery_to_mysql.html} | 243 +-
.../operators/transfer/calendar_to_gcs.html} | 234 +-
.../operators/transfer/facebook_ads_to_gcs.html} | 232 +-
.../operators/transfer/gcs_to_bigquery.html} | 307 +-
.../8.10.0/operators/transfer/gcs_to_gcs.html} | 571 +-
.../8.10.0/operators/transfer/gcs_to_gdrive.html} | 269 +-
.../8.10.0/operators/transfer/gcs_to_local.html} | 232 +-
.../8.10.0/operators/transfer/gcs_to_sftp.html} | 257 +-
.../8.10.0/operators/transfer/gcs_to_sheets.html} | 235 +-
.../8.10.0/operators/transfer/gdrive_to_gcs.html} | 244 +-
.../operators/transfer/gdrive_to_local.html} | 238 +-
.../8.10.0/operators/transfer/index.html} | 235 +-
.../8.10.0/operators/transfer/local_to_drive.html} | 226 +-
.../8.10.0/operators/transfer/local_to_gcs.html} | 238 +-
.../8.10.0/operators/transfer/mssql_to_gcs.html} | 243 +-
.../8.10.0/operators/transfer/mysql_to_gcs.html} | 239 +-
.../8.10.0/operators/transfer/oracle_to_gcs.html} | 239 +-
.../8.10.0/operators/transfer/presto_to_gcs.html} | 384 +-
.../8.10.0/operators/transfer/s3_to_gcs.html} | 220 +-
.../operators/transfer/salesforce_to_gcs.html} | 250 +-
.../8.10.0/operators/transfer/sftp_to_gcs.html} | 255 +-
.../8.10.0/operators/transfer/sheets_to_gcs.html} | 234 +-
.../8.10.0/operators/transfer/sql_to_sheets.html} | 226 +-
.../8.10.0/operators/transfer/trino_to_gcs.html} | 384 +-
.../8.10.0/py-modindex.html | 3174 ++++
.../8.10.0/search.html} | 253 +-
.../8.10.0/searchindex.js | 1 +
.../google-cloud-secret-manager-backend.html} | 318 +-
.../8.10.0/secrets-backends/index.html | 1 +
.../8.10.0/sensors/google-cloud-tasks.html} | 178 +-
.../8.10.0/sensors/index.html} | 165 +-
.../apache-airflow-providers-google/stable.txt | 2 +-
.../secrets-backends/hashicorp-vault.rst.txt | 2 +-
.../3.2.0/searchindex.js | 2 +-
.../3.2.0/secrets-backends/hashicorp-vault.html | 2 +-
.../apache-airflow-providers-http/4.2.0/.buildinfo | 4 +
.../airflow/providers/http/hooks/http}/index.html | 337 +-
.../_api/airflow/providers/http/hooks/index.html} | 201 +-
.../4.2.0/_api/airflow/providers/http/index.html} | 208 +-
.../providers/http/operators/http}/index.html | 156 +-
.../airflow/providers/http/operators/index.html} | 201 +-
.../providers/http/sensors/http}/index.html | 158 +-
.../airflow/providers/http/sensors/index.html} | 201 +-
.../system/providers/http/example_http}/index.html | 197 +-
.../_api/tests/system/providers/http/index.html} | 201 +-
.../airflow/providers/http/hooks/http.html} | 684 +-
.../airflow/providers/http/operators/http.html} | 352 +-
.../airflow/providers/http/sensors/http.html} | 374 +-
.../4.2.0/_modules/index.html} | 181 +-
.../tests/system/providers/http/example_http.html} | 336 +-
.../providers/http/hooks/http/index.rst.txt | 176 +
.../airflow/providers/http/hooks/index.rst.txt | 15 +
.../_api/airflow/providers/http/index.rst.txt | 17 +
.../providers/http/operators/http/index.rst.txt | 84 +
.../airflow/providers/http/operators/index.rst.txt | 15 +
.../providers/http/sensors/http/index.rst.txt | 81 +
.../airflow/providers/http/sensors/index.rst.txt | 15 +
.../providers/http/example_http/index.rst.txt | 59 +
.../_api/tests/system/providers/http/index.rst.txt | 15 +
.../4.2.0/_sources/commits.rst.txt | 306 +
.../4.2.0/_sources/connections/http.rst.txt | 68 +
.../4.2.0/_sources/index.rst.txt | 95 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.2.0/_sources/operators.rst.txt | 120 +
.../4.2.0/_static/_gen/css/main-custom.min.css | 1 +
.../4.2.0/_static/_gen/css/main.min.css | 7 +
.../4.2.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.2.0/_static/basic.css | 899 +
.../4.2.0/_static/check-solid.svg | 4 +
.../4.2.0/_static/clipboard.min.js | 7 +
.../4.2.0/_static/copy-button.svg | 5 +
.../4.2.0/_static/copybutton.css | 94 +
.../4.2.0/_static/copybutton.js | 248 +
.../4.2.0/_static/copybutton_funcs.js | 73 +
.../4.2.0/_static/doctools.js | 156 +
.../4.2.0/_static/documentation_options.js | 14 +
.../4.2.0/_static/file.png | Bin 0 -> 286 bytes
.../4.2.0/_static/graphviz.css | 19 +
.../4.2.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.2.0/_static/jquery.js | 2 +
.../4.2.0/_static/js/globaltoc.js | 24 +
.../4.2.0/_static/language_data.js | 199 +
.../4.2.0/_static/minus.png | Bin 0 -> 90 bytes
.../4.2.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.2.0/_static/plus.png | Bin 0 -> 90 bytes
.../4.2.0/_static/pygments.css | 74 +
.../4.2.0/_static/searchtools.js | 566 +
.../4.2.0/_static/sphinx_highlight.js | 144 +
.../4.2.0/_static/underscore-1.13.1.js | 2042 +++
.../4.2.0/_static/underscore.js | 6 +
.../4.2.0/commits.html} | 1018 +-
.../4.2.0/connections/http.html} | 181 +-
.../4.2.0/genindex.html} | 455 +-
.../4.2.0/index.html} | 488 +-
.../4.2.0/installing-providers-from-sources.html} | 247 +-
.../4.2.0/objects.inv | Bin 0 -> 985 bytes
.../4.2.0/operators.html} | 352 +-
.../4.2.0/py-modindex.html} | 298 +-
.../4.2.0/search.html} | 243 +-
.../4.2.0/searchindex.js | 1 +
.../apache-airflow-providers-http/stable.txt | 2 +-
.../5.2.1/.buildinfo | 4 +
.../microsoft/azure/hooks/adx}/index.html | 187 +-
.../microsoft/azure/hooks/asb}/index.html | 317 +-
.../microsoft/azure/hooks/base_azure}/index.html | 146 +-
.../microsoft/azure/hooks/batch}/index.html | 293 +-
.../azure/hooks/container_instance}/index.html | 262 +-
.../azure/hooks/container_registry}/index.html | 131 +-
.../azure/hooks/container_volume}/index.html | 151 +-
.../microsoft/azure/hooks/cosmos}/index.html | 318 +-
.../microsoft/azure/hooks/data_factory/index.html | 1917 +++
.../microsoft/azure/hooks/data_lake}/index.html | 619 +-
.../microsoft/azure/hooks/fileshare}/index.html | 515 +-
.../providers/microsoft/azure/hooks/index.html} | 224 +-
.../microsoft/azure/hooks/synapse}/index.html | 316 +-
.../microsoft/azure/hooks/wasb}/index.html | 536 +-
.../airflow/providers/microsoft/azure}/index.html | 252 +-
.../providers/microsoft/azure/log/index.html} | 205 +-
.../azure/log/wasb_task_handler}/index.html | 191 +-
.../microsoft/azure/operators/adls}/index.html | 191 +-
.../microsoft/azure/operators/adx}/index.html | 128 +-
.../microsoft/azure/operators/asb/index.html | 1499 ++
.../microsoft/azure/operators/batch}/index.html | 215 +-
.../operators/container_instances}/index.html | 271 +-
.../microsoft/azure/operators/cosmos}/index.html | 116 +-
.../azure/operators/data_factory}/index.html | 218 +-
.../microsoft/azure/operators/index.html} | 213 +-
.../microsoft/azure/operators/synapse}/index.html | 132 +-
.../azure/operators/wasb_delete_blob}/index.html | 117 +-
.../providers/microsoft/azure/secrets/index.html} | 205 +-
.../microsoft/azure/secrets/key_vault}/index.html | 222 +-
.../microsoft/azure/sensors/cosmos}/index.html | 116 +-
.../azure/sensors/data_factory}/index.html | 108 +-
.../providers/microsoft/azure/sensors/index.html} | 207 +-
.../microsoft/azure/sensors/wasb}/index.html | 144 +-
.../azure/transfers/azure_blob_to_gcs}/index.html | 128 +-
.../microsoft/azure/transfers/index.html} | 209 +-
.../azure/transfers/local_to_adls}/index.html | 159 +-
.../azure/transfers/local_to_wasb}/index.html | 170 +-
.../oracle_to_azure_data_lake}/index.html | 122 +-
.../azure/transfers/sftp_to_wasb}/index.html | 257 +-
.../providers/microsoft/azure/utils}/index.html | 126 +-
.../azure/example_adf_run_pipeline/index.html} | 234 +-
.../azure/example_adls_delete}/index.html | 223 +-
.../azure/example_azure_blob_to_gcs}/index.html | 181 +-
.../example_azure_container_instances}/index.html | 210 +-
.../azure/example_azure_cosmosdb}/index.html | 214 +-
.../azure/example_azure_service_bus}/index.html | 181 +-
.../azure/example_azure_synapse}/index.html | 223 +-
.../microsoft/azure/example_fileshare}/index.html | 186 +-
.../azure/example_local_to_adls}/index.html | 223 +-
.../azure/example_local_to_wasb}/index.html | 216 +-
.../azure/example_sftp_to_wasb}/index.html | 233 +-
.../system/providers/microsoft/azure/index.html} | 222 +-
.../providers/microsoft/azure/hooks/adx.html} | 476 +-
.../providers/microsoft/azure/hooks/asb.html} | 487 +-
.../microsoft/azure/hooks/base_azure.html} | 305 +-
.../providers/microsoft/azure/hooks/batch.html} | 616 +-
.../microsoft/azure/hooks/container_instance.html} | 332 +-
.../microsoft/azure/hooks/container_registry.html} | 234 +-
.../microsoft/azure/hooks/container_volume.html} | 293 +-
.../providers/microsoft/azure/hooks/cosmos.html} | 600 +-
.../microsoft/azure/hooks/data_factory.html | 1856 ++
.../microsoft/azure/hooks/data_lake.html} | 748 +-
.../microsoft/azure/hooks/fileshare.html} | 560 +-
.../providers/microsoft/azure/hooks/synapse.html} | 471 +-
.../providers/microsoft/azure/hooks/wasb.html} | 719 +-
.../microsoft/azure/log/wasb_task_handler.html} | 464 +-
.../providers/microsoft/azure/operators/adls.html} | 268 +-
.../providers/microsoft/azure/operators/adx.html} | 247 +-
.../providers/microsoft/azure/operators/asb.html | 1449 ++
.../microsoft/azure/operators/batch.html} | 565 +-
.../azure/operators/container_instances.html} | 616 +-
.../microsoft/azure/operators/cosmos.html} | 240 +-
.../microsoft/azure/operators/data_factory.html} | 477 +-
.../microsoft/azure/operators/synapse.html} | 292 +-
.../azure/operators/wasb_delete_blob.html} | 240 +-
.../microsoft/azure/secrets/key_vault.html} | 376 +-
.../providers/microsoft/azure/sensors/cosmos.html} | 239 +-
.../microsoft/azure/sensors/data_factory.html} | 248 +-
.../providers/microsoft/azure/sensors/wasb.html} | 266 +-
.../azure/transfers/azure_blob_to_gcs.html} | 318 +-
.../microsoft/azure/transfers/local_to_adls.html} | 301 +-
.../microsoft/azure/transfers/local_to_wasb.html} | 249 +-
.../transfers/oracle_to_azure_data_lake.html} | 299 +-
.../microsoft/azure/transfers/sftp_to_wasb.html} | 472 +-
.../airflow/providers/microsoft/azure/utils.html} | 296 +-
.../5.2.1/_modules/index.html} | 225 +-
.../microsoft/azure/example_adf_run_pipeline.html} | 260 +-
.../microsoft/azure/example_adls_delete.html} | 227 +-
.../azure/example_azure_blob_to_gcs.html} | 242 +-
.../azure/example_azure_container_instances.html} | 227 +-
.../microsoft/azure/example_azure_cosmosdb.html} | 243 +-
.../azure/example_azure_service_bus.html} | 369 +-
.../microsoft/azure/example_azure_synapse.html} | 241 +-
.../microsoft/azure/example_fileshare.html} | 235 +-
.../microsoft/azure/example_local_to_adls.html} | 227 +-
.../microsoft/azure/example_local_to_wasb.html} | 223 +-
.../microsoft/azure/example_sftp_to_wasb.html} | 255 +-
.../microsoft/azure/hooks/adx/index.rst.txt | 115 +
.../microsoft/azure/hooks/asb/index.rst.txt | 164 +
.../microsoft/azure/hooks/base_azure/index.rst.txt | 70 +
.../microsoft/azure/hooks/batch/index.rst.txt | 169 +
.../azure/hooks/container_instance/index.rst.txt | 123 +
.../azure/hooks/container_registry/index.rst.txt | 66 +
.../azure/hooks/container_volume/index.rst.txt | 72 +
.../microsoft/azure/hooks/cosmos/index.rst.txt | 166 +
.../azure/hooks/data_factory/index.rst.txt | 572 +
.../microsoft/azure/hooks/data_lake/index.rst.txt | 300 +
.../microsoft/azure/hooks/fileshare/index.rst.txt | 210 +
.../providers/microsoft/azure/hooks/index.rst.txt | 27 +
.../microsoft/azure/hooks/synapse/index.rst.txt | 171 +
.../microsoft/azure/hooks/wasb/index.rst.txt | 227 +
.../providers/microsoft/azure/index.rst.txt | 29 +
.../providers/microsoft/azure/log/index.rst.txt | 15 +
.../azure/log/wasb_task_handler/index.rst.txt | 85 +
.../microsoft/azure/operators/adls/index.rst.txt | 98 +
.../microsoft/azure/operators/adx/index.rst.txt | 67 +
.../microsoft/azure/operators/asb/index.rst.txt | 427 +
.../microsoft/azure/operators/batch/index.rst.txt | 125 +
.../operators/container_instances/index.rst.txt | 152 +
.../microsoft/azure/operators/cosmos/index.rst.txt | 52 +
.../azure/operators/data_factory/index.rst.txt | 118 +
.../microsoft/azure/operators/index.rst.txt | 23 +
.../azure/operators/synapse/index.rst.txt | 70 +
.../azure/operators/wasb_delete_blob/index.rst.txt | 49 +
.../microsoft/azure/secrets/index.rst.txt | 15 +
.../azure/secrets/key_vault/index.rst.txt | 108 +
.../microsoft/azure/sensors/cosmos/index.rst.txt | 54 +
.../azure/sensors/data_factory/index.rst.txt | 47 +
.../microsoft/azure/sensors/index.rst.txt | 17 +
.../microsoft/azure/sensors/wasb/index.rst.txt | 68 +
.../transfers/azure_blob_to_gcs/index.rst.txt | 65 +
.../microsoft/azure/transfers/index.rst.txt | 19 +
.../azure/transfers/local_to_adls/index.rst.txt | 77 +
.../azure/transfers/local_to_wasb/index.rst.txt | 46 +
.../oracle_to_azure_data_lake/index.rst.txt | 62 +
.../azure/transfers/sftp_to_wasb/index.rst.txt | 132 +
.../providers/microsoft/azure/utils/index.rst.txt | 24 +
.../azure/example_adf_run_pipeline/index.rst.txt | 26 +
.../azure/example_adls_delete/index.rst.txt | 34 +
.../azure/example_azure_blob_to_gcs/index.rst.txt | 46 +
.../index.rst.txt | 31 +
.../azure/example_azure_cosmosdb/index.rst.txt | 37 +
.../azure/example_azure_service_bus/index.rst.txt | 49 +
.../azure/example_azure_synapse/index.rst.txt | 33 +
.../azure/example_fileshare/index.rst.txt | 65 +
.../azure/example_local_to_adls/index.rst.txt | 34 +
.../azure/example_local_to_wasb/index.rst.txt | 30 +
.../azure/example_sftp_to_wasb/index.rst.txt | 87 +
.../system/providers/microsoft/azure/index.rst.txt | 25 +
.../5.2.1/_sources/commits.rst.txt | 572 +
.../5.2.1/_sources/connections/acr.rst.txt | 62 +
.../5.2.1/_sources/connections/adf.rst.txt | 93 +
.../5.2.1/_sources/connections/adl.rst.txt | 70 +
.../5.2.1/_sources/connections/adls_v2.rst.txt | 68 +
.../5.2.1/_sources/connections/adx.rst.txt | 91 +
.../5.2.1/_sources/connections/asb.rst.txt | 50 +
.../5.2.1/_sources/connections/azure.rst.txt | 83 +
.../5.2.1/_sources/connections/azure_batch.rst.txt | 61 +
.../connections/azure_container_volume.rst.txt | 75 +
.../_sources/connections/azure_cosmos.rst.txt | 66 +
.../_sources/connections/azure_fileshare.rst.txt | 80 +
.../_sources/connections/azure_synapse.rst.txt | 69 +
.../5.2.1/_sources/connections/index.rst.txt | 25 +
.../5.2.1/_sources/connections/wasb.rst.txt | 84 +
.../5.2.1/_sources/index.rst.txt | 141 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.2.1/_sources/logging/index.rst.txt | 55 +
.../_sources/operators/adf_run_pipeline.rst.txt | 53 +
.../5.2.1/_sources/operators/adls.rst.txt | 50 +
.../5.2.1/_sources/operators/asb.rst.txt | 214 +
.../_sources/operators/azure_blob_to_gcs.rst.txt | 60 +
.../5.2.1/_sources/operators/azure_synapse.rst.txt | 49 +
.../5.2.1/_sources/operators/index.rst.txt | 28 +
.../5.2.1/_sources/operators/local_to_adls.rst.txt | 53 +
.../5.2.1/_sources/operators/sftp_to_wasb.rst.txt | 61 +
.../secrets-backends/azure-key-vault.rst.txt | 73 +
.../5.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../5.2.1/_static/_gen/css/main.min.css | 7 +
.../5.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.2.1/_static/basic.css | 899 +
.../5.2.1/_static/check-solid.svg | 4 +
.../5.2.1/_static/clipboard.min.js | 7 +
.../5.2.1/_static/copy-button.svg | 5 +
.../5.2.1/_static/copybutton.css | 94 +
.../5.2.1/_static/copybutton.js | 248 +
.../5.2.1/_static/copybutton_funcs.js | 73 +
.../5.2.1/_static/doctools.js | 156 +
.../5.2.1/_static/documentation_options.js | 14 +
.../5.2.1/_static/file.png | Bin 0 -> 286 bytes
.../5.2.1/_static/graphviz.css | 19 +
.../5.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.2.1/_static/jquery.js | 2 +
.../5.2.1/_static/js/globaltoc.js | 24 +
.../5.2.1/_static/language_data.js | 199 +
.../5.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pygments.css | 74 +
.../5.2.1/_static/searchtools.js | 566 +
.../5.2.1/_static/sphinx_highlight.js | 144 +
.../5.2.1/_static/underscore-1.13.1.js | 2042 +++
.../5.2.1/_static/underscore.js | 6 +
.../5.2.1/commits.html | 2459 +++
.../5.2.1/connections/acr.html} | 184 +-
.../5.2.1/connections/adf.html} | 211 +-
.../5.2.1/connections/adl.html} | 189 +-
.../5.2.1/connections/adls_v2.html} | 188 +-
.../5.2.1/connections/adx.html} | 205 +-
.../5.2.1/connections/asb.html} | 179 +-
.../5.2.1/connections/azure.html} | 204 +-
.../5.2.1/connections/azure_batch.html} | 183 +-
.../5.2.1/connections/azure_container_volume.html} | 189 +-
.../5.2.1/connections/azure_cosmos.html} | 185 +-
.../5.2.1/connections/azure_fileshare.html} | 200 +-
.../5.2.1/connections/azure_synapse.html} | 194 +-
.../5.2.1/connections/index.html} | 171 +-
.../5.2.1/connections/wasb.html} | 196 +-
.../5.2.1/genindex.html | 2552 +++
.../5.2.1/index.html} | 970 +-
.../5.2.1/installing-providers-from-sources.html} | 251 +-
.../5.2.1/logging.html | 1 +
.../5.2.1/logging/index.html} | 187 +-
.../5.2.1/objects.inv | Bin 0 -> 6576 bytes
.../5.2.1/operators/adf_run_pipeline.html} | 196 +-
.../5.2.1/operators/adls.html} | 172 +-
.../5.2.1/operators/asb.html} | 363 +-
.../5.2.1/operators/azure_blob_to_gcs.html} | 204 +-
.../5.2.1/operators/azure_synapse.html} | 180 +-
.../5.2.1/operators/index.html} | 175 +-
.../5.2.1/operators/local_to_adls.html} | 180 +-
.../5.2.1/operators/sftp_to_wasb.html} | 192 +-
.../5.2.1/py-modindex.html} | 509 +-
.../5.2.1/search.html} | 247 +-
.../5.2.1/searchindex.js | 1 +
.../5.2.1/secrets-backends/azure-key-vault.html} | 192 +-
.../5.2.1/secrets-backends/index.html | 1 +
.../stable.txt | 2 +-
.../providers/microsoft/psrp/hooks/psrp.html | 3 +-
.../apache-airflow-providers-sftp/4.2.3/.buildinfo | 4 +
.../_api/airflow/providers/sftp/hooks/index.html} | 191 +-
.../airflow/providers/sftp/hooks/sftp}/index.html | 449 +-
.../4.2.3/_api/airflow/providers/sftp/index.html} | 198 +-
.../airflow/providers/sftp/operators/index.html} | 191 +-
.../providers/sftp/operators/sftp}/index.html | 156 +-
.../airflow/providers/sftp/sensors/index.html} | 191 +-
.../providers/sftp/sensors/sftp}/index.html | 91 +-
.../airflow/providers/sftp/hooks/sftp.html} | 676 +-
.../airflow/providers/sftp/operators/sftp.html} | 512 +-
.../airflow/providers/sftp/sensors/sftp.html} | 296 +-
.../4.2.3/_modules/index.html} | 170 +-
.../airflow/providers/sftp/hooks/index.rst.txt | 15 +
.../providers/sftp/hooks/sftp/index.rst.txt | 229 +
.../_api/airflow/providers/sftp/index.rst.txt | 17 +
.../airflow/providers/sftp/operators/index.rst.txt | 15 +
.../providers/sftp/operators/sftp/index.rst.txt | 96 +
.../airflow/providers/sftp/sensors/index.rst.txt | 15 +
.../providers/sftp/sensors/sftp/index.rst.txt | 47 +
.../4.2.3/_sources/commits.rst.txt | 379 +
.../4.2.3/_sources/connections/sftp.rst.txt | 109 +
.../4.2.3/_sources/index.rst.txt | 108 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.2.3/_static/_gen/css/main-custom.min.css | 1 +
.../4.2.3/_static/_gen/css/main.min.css | 7 +
.../4.2.3/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.2.3/_static/basic.css | 899 +
.../4.2.3/_static/check-solid.svg | 4 +
.../4.2.3/_static/clipboard.min.js | 7 +
.../4.2.3/_static/copy-button.svg | 5 +
.../4.2.3/_static/copybutton.css | 94 +
.../4.2.3/_static/copybutton.js | 248 +
.../4.2.3/_static/copybutton_funcs.js | 73 +
.../4.2.3/_static/doctools.js | 156 +
.../4.2.3/_static/documentation_options.js | 14 +
.../4.2.3/_static/file.png | Bin 0 -> 286 bytes
.../4.2.3/_static/graphviz.css | 19 +
.../4.2.3/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.2.3/_static/jquery.js | 2 +
.../4.2.3/_static/js/globaltoc.js | 24 +
.../4.2.3/_static/language_data.js | 199 +
.../4.2.3/_static/minus.png | Bin 0 -> 90 bytes
.../4.2.3/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.2.3/_static/plus.png | Bin 0 -> 90 bytes
.../4.2.3/_static/pygments.css | 74 +
.../4.2.3/_static/searchtools.js | 566 +
.../4.2.3/_static/sphinx_highlight.js | 144 +
.../4.2.3/_static/underscore-1.13.1.js | 2042 +++
.../4.2.3/_static/underscore.js | 6 +
.../4.2.3/commits.html | 1793 ++
.../4.2.3/connections/sftp.html} | 121 +-
.../4.2.3/genindex.html} | 433 +-
.../4.2.3/index.html} | 606 +-
.../4.2.3/installing-providers-from-sources.html} | 249 +-
.../4.2.3/objects.inv | Bin 0 -> 845 bytes
.../4.2.3/py-modindex.html} | 268 +-
.../4.2.3/search.html} | 233 +-
.../4.2.3/searchindex.js | 1 +
.../apache-airflow-providers-sftp/stable.txt | 2 +-
.../4.0.4/.buildinfo | 4 +
.../airflow/providers/snowflake/hooks/index.html} | 201 +-
.../snowflake/hooks/snowflake}/index.html | 302 +-
.../_api/airflow/providers/snowflake/index.html} | 214 +-
.../providers/snowflake/operators/index.html} | 201 +-
.../snowflake/operators/snowflake}/index.html | 383 +-
.../transfers/copy_into_snowflake}/index.html | 146 +-
.../providers/snowflake/transfers/index.html} | 203 +-
.../transfers/s3_to_snowflake}/index.html | 147 +-
.../transfers/snowflake_to_slack}/index.html | 149 +-
.../providers/snowflake/utils/common}/index.html | 131 +-
.../airflow/providers/snowflake/utils/index.html} | 201 +-
.../snowflake/example_s3_to_snowflake}/index.html | 180 +-
.../snowflake/example_snowflake}/index.html | 194 +-
.../example_snowflake_to_slack}/index.html | 187 +-
.../tests/system/providers/snowflake/index.html} | 203 +-
.../providers/snowflake/hooks/snowflake.html} | 701 +-
.../providers/snowflake/operators/snowflake.html} | 661 +-
.../snowflake/transfers/copy_into_snowflake.html} | 378 +-
.../snowflake/transfers/s3_to_snowflake.html} | 394 +-
.../snowflake/transfers/snowflake_to_slack.html} | 350 +-
.../airflow/providers/snowflake/utils/common.html} | 263 +-
.../4.0.4/_modules/index.html} | 186 +-
.../snowflake/example_s3_to_snowflake.html} | 291 +-
.../providers/snowflake/example_snowflake.html} | 307 +-
.../snowflake/example_snowflake_to_slack.html} | 291 +-
.../providers/snowflake/hooks/index.rst.txt | 15 +
.../snowflake/hooks/snowflake/index.rst.txt | 152 +
.../_api/airflow/providers/snowflake/index.rst.txt | 18 +
.../providers/snowflake/operators/index.rst.txt | 15 +
.../snowflake/operators/snowflake/index.rst.txt | 232 +
.../transfers/copy_into_snowflake/index.rst.txt | 84 +
.../providers/snowflake/transfers/index.rst.txt | 17 +
.../transfers/s3_to_snowflake/index.rst.txt | 82 +
.../transfers/snowflake_to_slack/index.rst.txt | 72 +
.../providers/snowflake/utils/common/index.rst.txt | 38 +
.../providers/snowflake/utils/index.rst.txt | 15 +
.../example_s3_to_snowflake/index.rst.txt | 51 +
.../snowflake/example_snowflake/index.rst.txt | 57 +
.../example_snowflake_to_slack/index.rst.txt | 68 +
.../tests/system/providers/snowflake/index.rst.txt | 17 +
.../4.0.4/_sources/commits.rst.txt | 460 +
.../4.0.4/_sources/connections/snowflake.rst.txt | 96 +
.../4.0.4/_sources/index.rst.txt | 124 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.0.4/_sources/operators/index.rst.txt | 25 +
.../_sources/operators/s3_to_snowflake.rst.txt | 45 +
.../4.0.4/_sources/operators/snowflake.rst.txt | 60 +
.../_sources/operators/snowflake_to_slack.rst.txt | 59 +
.../4.0.4/_static/_gen/css/main-custom.min.css | 1 +
.../4.0.4/_static/_gen/css/main.min.css | 7 +
.../4.0.4/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.0.4/_static/basic.css | 899 +
.../4.0.4/_static/check-solid.svg | 4 +
.../4.0.4/_static/clipboard.min.js | 7 +
.../4.0.4/_static/copy-button.svg | 5 +
.../4.0.4/_static/copybutton.css | 94 +
.../4.0.4/_static/copybutton.js | 248 +
.../4.0.4/_static/copybutton_funcs.js | 73 +
.../4.0.4/_static/doctools.js | 156 +
.../4.0.4/_static/documentation_options.js | 14 +
.../4.0.4/_static/file.png | Bin 0 -> 286 bytes
.../4.0.4/_static/graphviz.css | 19 +
.../4.0.4/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.0.4/_static/jquery.js | 2 +
.../4.0.4/_static/js/globaltoc.js | 24 +
.../4.0.4/_static/language_data.js | 199 +
.../4.0.4/_static/minus.png | Bin 0 -> 90 bytes
.../4.0.4/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.0.4/_static/plus.png | Bin 0 -> 90 bytes
.../4.0.4/_static/pygments.css | 74 +
.../4.0.4/_static/searchtools.js | 566 +
.../4.0.4/_static/sphinx_highlight.js | 144 +
.../4.0.4/_static/underscore-1.13.1.js | 2042 +++
.../4.0.4/_static/underscore.js | 6 +
.../4.0.4/commits.html | 2047 +++
.../4.0.4/connections/snowflake.html} | 211 +-
.../4.0.4/genindex.html} | 599 +-
.../4.0.4/index.html} | 738 +-
.../4.0.4/installing-providers-from-sources.html} | 247 +-
.../4.0.4/objects.inv | Bin 0 -> 1490 bytes
.../4.0.4/operators/index.html} | 157 +-
.../4.0.4/operators/s3_to_snowflake.html} | 177 +-
.../4.0.4/operators/snowflake.html} | 210 +-
.../4.0.4/operators/snowflake_to_slack.html} | 194 +-
.../4.0.4/py-modindex.html} | 328 +-
.../4.0.4/search.html} | 243 +-
.../4.0.4/searchindex.js | 1 +
.../apache-airflow-providers-snowflake/stable.txt | 2 +-
.../3.4.0/connections/ssh.html | 2 +-
.../core-extensions/connections.html | 68 +-
.../core-extensions/extra-links.html | 212 +-
.../core-extensions/logging.html | 16 +-
.../core-extensions/secrets-backends.html | 8 +-
.../operators-and-hooks-ref/apache.html | 36 +-
.../operators-and-hooks-ref/aws.html | 234 +-
.../operators-and-hooks-ref/azure.html | 76 +-
.../operators-and-hooks-ref/google.html | 455 +-
.../operators-and-hooks-ref/protocol.html | 44 +-
.../operators-and-hooks-ref/services.html | 44 +-
.../operators-and-hooks-ref/software.html | 88 +-
.../apache-airflow-providers/packages-ref.html | 48 +-
.../apache-airflow-providers/searchindex.js | 2 +-
3094 files changed, 838234 insertions(+), 220688 deletions(-)
diff --git a/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html b/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
index 37510689aa..04ce39008d 100644
--- a/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
+++ b/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
@@ -610,7 +610,7 @@
<dl class="py class">
<dt class="sig sig-object py" id="airflow.providers.airbyte.hooks.airbyte.AirbyteHook">
<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.airbyte.hooks.airbyte.</span></span><span class="sig-name descname"><span class="pre">AirbyteHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">airbyte_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'airbyte_defa [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a></p>
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.2.0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a></p>
<p>Hook for Airbyte API</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
diff --git a/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo b/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo
new file mode 100644
index 0000000000..0591087a38
--- /dev/null
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo
@@ -0,0 +1,4 @@
+# Sphinx build info version 1
+# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
+config: 753554d42b9a989529104dfe4b922cb1
+tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
similarity index 88%
copy from docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
index 356f682a14..440bf5a78d 100644
--- a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.discord.operators.discord_webhook — apache-airflow-providers-discord Documentation</title>
+ <title>airflow.providers.amazon.aws.exceptions — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.discord.operators" href="../index.html" />
+ <link rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.waiters.base_waiter" href="../waiters/base_waiter/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -325,10 +325,25 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -417,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -458,10 +473,25 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -557,11 +587,11 @@
<li class="breadcrumb-item"><a href="../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a></li>
</ul>
</div>
@@ -572,75 +602,56 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.discord.operators.discord_webhook">
-<span id="airflow-providers-discord-operators-discord-webhook"></span><h1><a class="reference internal" href="#module-airflow.providers.discord.operators.discord_webhook" title="airflow.providers.discord.operators.discord_webhook"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><a class="headerlink" href="#module-airflow.providers.discord.operators.discord_webhook" title="Permalink to this he [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.exceptions">
+<span id="airflow-providers-amazon-aws-exceptions"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.exceptions" title="airflow.providers.amazon.aws.exceptions"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.exceptions" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
-<div class="section" id="classes">
-<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
-<table class="autosummary longtable docutils align-default">
-<colgroup>
-<col style="width: 10%" />
-<col style="width: 90%" />
-</colgroup>
-<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator" title="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a></p></td>
-<td><p>This operator allows you to post messages to Discord using incoming webhooks.</p></td>
-</tr>
-</tbody>
-</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.discord.operators.discord_webhook.</span></span><span class="sig-name descname"><span class="pre">DiscordWebhookOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">http_conn_id</span></span><span clas [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/operators/http/index.html#airflow.providers.http.operators.http.SimpleHttpOperator" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.operators.http.SimpleHttpOperator</span></code></a></p>
-<p>This operator allows you to post messages to Discord using incoming webhooks.
-Takes a Discord connection ID with a default relative webhook endpoint. The
-default endpoint can be overridden using the webhook_endpoint parameter
-(<a class="reference external" href="https://discordapp.com/developers/docs/resources/webhook">https://discordapp.com/developers/docs/resources/webhook</a>).</p>
-<p>Each Discord webhook can be pre-configured to use a specific username and
-avatar_url. You can override these defaults in this operator.</p>
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsTaskFailToStart</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airfl [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS tasks fail to start AFTER processing the request.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>http_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Http connection ID with host as “<a class="reference external" href="https://discord.com/api/">https://discord.com/api/</a>” and
-default webhook endpoint in the extra field in the form of
-{“webhook_endpoint”: “webhooks/{webhook.id}/{webhook.token}”}</p></li>
-<li><p><strong>webhook_endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Discord webhook endpoint in the form of
-“webhooks/{webhook.id}/{webhook.token}” (templated)</p></li>
-<li><p><strong>message</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The message you want to send to your Discord channel
-(max 2000 characters). (templated)</p></li>
-<li><p><strong>username</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default username of the webhook. (templated)</p></li>
-<li><p><strong>avatar_url</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default avatar of the webhook</p></li>
-<li><p><strong>tts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Is a text-to-speech message</p></li>
-<li><p><strong>proxy</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Proxy to use to make the Discord webhook call</p></li>
-</ul>
-</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/discord/operators/discord_webhook.html#DiscordWebhookOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.disc [...]
-<dd><p>Call the DiscordWebhookHook to post message</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsTaskFailToStart.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsOperatorError</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">failures</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig- [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS cannot handle the request.</p>
<dl class="field-list simple">
</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsOperatorError.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
</dd></dl>
</dd></dl>
-</div>
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">S3HookUriParseFailure</span></span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#S3HookUriParseFailure"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class [...]
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/exceptions/index.html#airflow.exceptions.AirflowException" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.exceptions.AirflowException</span></code></a></p>
+<p>When parse_s3_url fails to parse URL, this error is thrown.</p>
+</dd></dl>
+
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.discord.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.waiters.base_waiter" href="../waiters/base_waiter/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -710,21 +721,26 @@ default webhook endpoint in the extra field in the form of
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart"><code class="docutils literal notranslate"><span class="pre">EcsTaskFailToStart</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__"><code class="docutils literal notranslate"><span class="pre">EcsTaskFailToStart.__reduce__()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError"><code class="docutils literal notranslate"><span class="pre">EcsOperatorError</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__"><code class="docutils literal notranslate"><span class="pre">EcsOperatorError.__reduce__()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">DiscordWebhookOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure"><code class="docutils literal notranslate"><span class="pre">S3HookUriParseFailure</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">EcsTaskFailToStart</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">__reduce__</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError">EcsOperatorError</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">__reduce__</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure">S3HookUriParseFailure</a></li>
</ul>
</li>
</ul>
@@ -751,7 +767,7 @@ default webhook endpoint in the extra field in the form of
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-discord/_api/airflow/providers/discord/operators/discord_webhook/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/exceptions/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
similarity index 85%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
index 1ea82ab6c2..a71f632384 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.appflow — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.appflow">
+<span id="airflow-providers-amazon-aws-hooks-appflow"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="airflow.providers.amazon.aws.hooks.appflow"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +616,83 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook" title="airflow.providers.amazon.aws.hooks.appflow.AppflowHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AppflowHook</span></code></a></p></td>
+<td><p>Interact with Amazon Appflow.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.appflow.</span></span><span class="sig-name descname"><span class="pre">AppflowHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Appflow.
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/appflow.html#Appflow.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("appflow")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
-</div>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/appflow/1.0/APIReference/Welcome.html">Amazon Appflow API Reference</a></p></li>
</ul>
-</dd>
-</dl>
+</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_OFFSET</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><span class="pre">int</span></a></em><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">15</span></em><a c [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_POLLING</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><span class="pre">int</span></a></em><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a [...]
<dd></dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/appflow.html#AppflowHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 Appflow client (cached)</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">
+<span class="sig-name descname"><span class="pre">run_flow</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">poll_interval</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">20</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airfl [...]
+<dd><p>Execute an AppFlow run.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The flow name</p></li>
+<li><p><strong>poll_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time (seconds) to wait between two consecutive calls to check the run status</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>The run execution ID</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">
+<span class="sig-name descname"><span class="pre">update_flow_filter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filter_tasks</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">set_trigger_ondemand</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span [...]
+<dd><p>Update the flow task filter.
+All filters will be removed if an empty array is passed to filter_tasks.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The flow name</p></li>
+<li><p><strong>filter_tasks</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><em>mypy_boto3_appflow.type_defs.TaskTypeDef</em><em>]</em>) – List flow tasks to be added</p></li>
+<li><p><strong>set_trigger_ondemand</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – If True, set the trigger to on-demand; otherwise, keep the trigger as is</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +704,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +777,23 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook"><code class="docutils literal notranslate"><span class="pre">AppflowHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET"><code class="docutils literal notranslate"><span class="pre">AppflowHook.EVENTUAL_CONSISTENCY_OFFSET</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING"><code class="docutils literal notranslate"><span class="pre">AppflowHook.EVENTUAL_CONSISTENCY_POLLING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn"><code class="docutils literal notranslate"><span class="pre">AppflowHook.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow"><code class="docutils literal notranslate"><span class="pre">AppflowHook.run_flow()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter"><code class="docutils literal notranslate"><span class="pre">AppflowHook.update_flow_filter()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook">AppflowHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">EVENTUAL_CONSISTENCY_OFFSET</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">EVENTUAL_CONSISTENCY_POLLING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">run_flow</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">update_flow_filter</a></li>
</ul>
</li>
</ul>
@@ -778,7 +824,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/appflow/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
similarity index 73%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
index 1ea82ab6c2..833d8b8b0a 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.athena — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.athena">
+<span id="airflow-providers-amazon-aws-hooks-athena"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.athena" title="airflow.providers.amazon.aws.hooks.athena"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.athena" title="Permalink to this heading">¶</a></h1>
+<p>This module contains AWS Athena hook.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +617,205 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook" title="airflow.providers.amazon.aws.hooks.athena.AthenaHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AthenaHook</span></code></a></p></td>
+<td><p>Interact with Amazon Athena.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.athena.</span></span><span class="sig-name descname"><span class="pre">AthenaHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">sleep_ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Athena.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("athena")</span></code></a>.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<li><p><strong>sleep_time</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time (in seconds) to wait between two consecutive calls to check query status on Athena</p></li>
+<li><p><strong>log_query</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Whether to log athena query and other execution params when it’s executed.
+Defaults to <em>True</em>.</p></li>
</ul>
</dd>
</dl>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('QUEUED',</span> <span class="pre">'RUNNING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.INTERMEDIATE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></ [...]
+<dd></dd></dl>
+
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('FAILED',</span> <span class="pre">'CANCELLED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a cla [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCEEDED',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">
+<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCEEDED',</span> <span class="pre">'FAILED',</span> <span class="pre">'CANCELLED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.TERMINAL_STATES"><span class="viewcode-link"><span clas [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">
+<span class="sig-name descname"><span class="pre">run_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">query_context</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">result_configuration</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">client_request_token</span></span><span class="o"><span class= [...]
+<dd><p>Run Presto query on athena with provided config and return submitted query_execution_id</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.start_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.start_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Presto query to run</p></li>
+<li><p><strong>query_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – Context in which query [...]
+<li><p><strong>result_configuration</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>]</em>) – Dict with path to store results in and config related to encryption</p></li>
+<li><p><strong>client_request_token</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Unique token created by user to avoid multiple executions of same query</p></li>
+<li><p><strong>workgroup</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Athena workgroup name, when not specified, will be ‘primary’</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">
+<span class="sig-name descname"><span class="pre">check_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.check_query_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dd><p>Fetch the status of submitted athena query. Returns None or one of valid query states.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">
+<span class="sig-name descname"><span class="pre">get_state_change_reason</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_state_change_reason"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Fetch the reason for a state change (e.g. error message). Returns None or reason string.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">
+<span class="sig-name descname"><span class="pre">get_query_results</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">next_token_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_results</span></span> [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else dict of query output</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_results" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_results()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>next_token_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The token that specifies where to start pagination.</p></li>
+<li><p><strong>max_results</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – The maximum number of results (rows) to return in this request.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">
+<span class="sig-name descname"><span class="pre">get_query_results_paginator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_items</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">page_size</span></s [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else a paginator to iterate through pages of results. If you
+wish to get all results at once, call build_full_result() on the returned PageIterator</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Paginator.GetQueryResults" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Athena.Paginator.GetQueryResults</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>max_items</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – The total number of items to return.</p></li>
+<li><p><strong>page_size</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – The size of each page.</p></li>
+<li><p><strong>starting_token</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – A token to specify where to start paginating.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">
+<span class="sig-name descname"><span class="pre">poll_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_tries</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_polling_attempts</span></ [...]
+<dd><p>Poll the status of submitted athena query until query state reaches final state.
+Returns one of the final states</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>max_tries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Deprecated - Use max_polling_attempts instead</p></li>
+<li><p><strong>max_polling_attempts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of times to poll for query state before function exits</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">
+<span class="sig-name descname"><span class="pre">get_output_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_output_location"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Function to get the output location of the query results
+in s3 uri format.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">
+<span class="sig-name descname"><span class="pre">stop_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.stop_query"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd><p>Cancel the submitted athena query</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.stop_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.stop_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +827,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +900,37 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook"><code class="docutils literal notranslate"><span class="pre">AthenaHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.FAILURE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.SUCCESS_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.TERMINAL_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query"><code class="docutils literal notranslate"><span class="pre">AthenaHook.run_query()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status"><code class="docutils literal notranslate"><span class="pre">AthenaHook.check_query_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_state_change_reason()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_query_results()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_query_results_paginator()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status"><code class="docutils literal notranslate"><span class="pre">AthenaHook.poll_query_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_output_location()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query"><code class="docutils literal notranslate"><span class="pre">AthenaHook.stop_query()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook">AthenaHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">run_query</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">check_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">get_state_change_reason</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">get_query_results</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">get_query_results_paginator</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">poll_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">get_output_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">stop_query</a></li>
</ul>
</li>
</ul>
@@ -778,7 +961,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/athena/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
similarity index 59%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
index 311386562a..1147e12871 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.base_aws — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,14 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.base_aws">
+<span id="airflow-providers-amazon-aws-hooks-base-aws"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="airflow.providers.amazon.aws.hooks.base_aws"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="Permalink to this heading">¶</a></h1>
+<p>This module contains Base AWS Hook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p>For more information on how to use this hook, take a look at the guide:
+<a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-aws"><span class="std std-ref">Amazon Web Services Connection</span></a></p>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,311 +622,430 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseSessionFactory</span></code></a></p></td>
+<td><p>Base AWS Session Factory class to handle boto3 session creation.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a></p></td>
+<td><p>Generic class for interact with AWS.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p></td>
+<td><p>Base class for interact with AWS.</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
-<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory" title="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">resolve_session_factory</span></code></a>()</p></td>
+<td><p>Resolves custom SessionFactory class</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection" title="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseAwsConnection</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionFactory</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseAwsConnection</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseAwsConnection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnectio [...]
<dd></dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseSessionFactory</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">conn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><spa [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMixin</span></code></p>
+<p>Base AWS Session Factory class to handle boto3 session creation.
+It can handle most of the AWS supported authentication methods.</p>
+<p>User can also derive from this class to have full control of boto3 session
+creation or to support custom federation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-aws-session-factory"><span class="std std-ref">Session Factory</span></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+</dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">extra_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a><span class="p"><span class="pre">[</span></span><a class="reference external" href="https [...]
+<dd><p>AWS Connection extra_config.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </s [...]
+<dd><p>AWS Region Name read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Config</span><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/constants.html#None" title="(in Python v3.11)"> [...]
+<dd><p>Configuration for botocore client read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">role_arn</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span [...]
+<dd><p>Assume Role ARN from AWS Connection</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Cached AWS Connection Wrapper.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">
+<span class="sig-name descname"><span class="pre">basic_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.basic_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session" title="Permalink to thi [...]
+<dd><p>Cached property with basic boto3.session.Session.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">
+<span class="sig-name descname"><span class="pre">create_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.create_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session" title="Permalink to [...]
+<dd><p>Create boto3 Session from connection config.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
</dd></dl>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsGenericHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_co [...]
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/hooks/base/index.html#airflow.hooks.base.BaseHook" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.hooks.base.BaseHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">Generic</span></code>[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsC [...]
+<p>Generic class for interact with AWS.
+This class provide a thin wrapper around the boto3 python library.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
+<li><p><strong>aws_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The Airflow connection used for AWS credentials.
+If this is None or empty then the default boto3 behaviour is used. If
+running Airflow in a distributed manner and aws_conn_id is None or
+empty, then default boto3 configuration would be used (and must be
+maintained on each worker node).</p></li>
+<li><p><strong>verify</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Whether or not to verify SSL certificates. See:
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html</a></p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – AWS region_name. If not specified then the default boto3 behaviour is used.</p></li>
+<li><p><strong>client_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.client</span> <s [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">resource_type</span></code>.</p></li>
+<li><p><strong>resource_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.resource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.resource</sp [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">client_type</span></code>.</p></li>
+<li><p><strong>config</strong> (<em>Config</em><em> | </em><em>None</em>) – Configuration for botocore client. See:
+<a class="reference external" href="https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html">https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html</a></p></li>
</ul>
</dd>
</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">service_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </s [...]
+<dd><p>AWS Region Name read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">botocore.config.Config</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.config"><span class="viewcode-link"><span class="pre">[source]< [...]
+<dd><p>Configuration for botocore client read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">verify</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><span class="pre">bool</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </spa [...]
+<dd><p>Verify or not SSL certificates boto3 client/resource read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><p>Get actual AWS Region Name from Hook connection (cached).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_partition</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/a [...]
+<dd><p>Get associated AWS Region Partition from Hook connection (cached).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">
+<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">
+<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">
+<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">
+<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Amazon</span> <span class="pre">Web</span> <span class="pre">Services'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</spa [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">
+<span class="sig-name descname"><span class="pre">conn_config</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config" title="Permalink to this definition"> [...]
+<dd><p>Get the Airflow Connection object and wrap it in helper (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">
+<span class="sig-name descname"><span class="pre">get_session</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_session"><span class [...]
+<dd><p>Get the underlying boto3.session.Session(region_name=region_name).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">
+<span class="sig-name descname"><span class="pre">get_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get the underlying boto3 client using boto3 session</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">
+<span class="sig-name descname"><span class="pre">get_resource_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</s [...]
+<dd><p>Get the underlying boto3 resource using boto3 session</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
<dl class="field-list simple">
<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
+<dd class="field-even"><p>BaseAwsConnection</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">
+<span class="sig-name descname"><span class="pre">conn_client_meta</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_client_meta"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta" title="Permalink to th [...]
+<dd><p>Get botocore client metadata from Hook connection (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">
+<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
+<p>Implemented so that caching works as intended. It exists for compatibility
+with subclasses that rely on a super().get_conn() method.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>BaseAwsConnection</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">
+<span class="sig-name descname"><span class="pre">get_credentials</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_credentials"><sp [...]
+<dd><p>Get the underlying <cite>botocore.Credentials</cite> object.</p>
+<p>This contains the following authentication attributes: access_key, secret_key and token.
+By use this method also secret_key and token will mask in tasks logs.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">
+<span class="sig-name descname"><span class="pre">expand_role</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">role</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow [...]
+<dd><p>If the IAM role is a role name, get the Amazon Resource Name (ARN) for the role.
+If IAM role is already an IAM role ARN, no change is made.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>role</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – IAM role name or ARN</p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Optional region name to get credentials for</p></li>
</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
+<dd class="field-even"><p>IAM role ARN</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">should_retry</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.retry"><span class="viewcode-link"><span class="pre">[source] [...]
+<dd><p>A decorator that provides a mechanism to repeat requests in response to exceeding a temporary quote
+limit.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">get_ui_field_behaviour</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_ui_field_behaviour"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Returns custom UI field behaviour for AWS Connection.</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">
+<span class="sig-name descname"><span class="pre">test_connection</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.test_connection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection" title="Permalink to this [...]
+<dd><p>Tests the AWS connection by call AWS STS (Security Token Service) GetCallerIdentity API.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference external" href="https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html">https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html</a></p>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path">
+<span class="sig-name descname"><span class="pre">waiter_path</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.waiter_path"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path" title="Permalink to this definition"> [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiter_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon. [...]
+<dd><p>First checks if there is a custom waiter with the provided waiter_name and
+uses that if it exists, otherwise it will check the service client for a
+waiter that matches the name and pass that through.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
+<dd class="field-odd"><p><strong>waiter_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should exactly match the
+name of the key in the waiter model file (typically this is CamelCase).</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters">
+<span class="sig-name descname"><span class="pre">list_waiters</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.list_waiters"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters" title="Permalink to this definitio [...]
+<dd><p>Returns a list containing the names of all waiters for the service, official and custom.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsBaseHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_ [...]
+<dd><p>Bases: <a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a>[<code class="xref py py-obj docutils literal notranslate"><span class="pre">Union</span></code>[<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/bo [...]
+<p>Base class for interact with AWS.
+This class provide a thin wrapper around the boto3 python library.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
+<li><p><strong>aws_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The Airflow connection used for AWS credentials.
+If this is None or empty then the default boto3 behaviour is used. If
+running Airflow in a distributed manner and aws_conn_id is None or
+empty, then default boto3 configuration would be used (and must be
+maintained on each worker node).</p></li>
+<li><p><strong>verify</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Whether or not to verify SSL certificates. See:
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html</a></p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – AWS region_name. If not specified then the default boto3 behaviour is used.</p></li>
+<li><p><strong>client_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.client</span> <s [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">resource_type</span></code>.</p></li>
+<li><p><strong>resource_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.resource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.resource</sp [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">client_type</span></code>.</p></li>
+<li><p><strong>config</strong> (<em>Config</em><em> | </em><em>None</em>) – Configuration for botocore client. See:
+<a class="reference external" href="https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html">https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html</a></p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">resolve_session_factory</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#resolve_session_factory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="hea [...]
+<dd><p>Resolves custom SessionFactory class</p>
+<dl class="field-list simple">
+</dl>
</dd></dl>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">SessionFactory</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#SessionFactory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title= [...]
+<dd></dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,69 +1115,95 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection"><code class="docutils literal notranslate"><span class="pre">BaseAwsConnection</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.extra_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.role_arn</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.basic_session()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.create_session()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.service_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.verify</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_partition</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_name_attr</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.default_conn_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_type</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.hook_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_config()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_session()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_client_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_resource_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_client_meta()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_credentials()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.expand_role()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.retry()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_ui_field_behaviour()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.test_connection()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.waiter_path()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.list_waiters()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory"><code class="docutils literal notranslate"><span class="pre">resolve_session_factory()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory"><code class="docutils literal notranslate"><span class="pre">SessionFactory</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">BaseAwsConnection</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">BaseSessionFactory</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">extra_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">role_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">basic_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">create_session</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">AwsGenericHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config">service_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">verify</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">conn_region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">conn_partition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">conn_name_attr</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">default_conn_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">conn_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">hook_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">conn_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">get_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">get_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">get_resource_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">conn_client_meta</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">get_conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">get_credentials</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">expand_role</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">get_ui_field_behaviour</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">test_connection</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path">waiter_path</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters">list_waiters</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">AwsBaseHook</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">resolve_session_factory</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">SessionFactory</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1232,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/base_aws/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
similarity index 59%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
index 311386562a..eeb35c4c13 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.batch_client — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,17 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_client">
+<span id="airflow-providers-amazon-aws-hooks-batch-client"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="airflow.providers.amazon.aws.hooks.batch_client"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="Permalink to this heading">¶</a></h1>
+<p>A client for AWS Batch services</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html">https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html</a></p></li>
+</ul>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,236 +625,395 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchClientHook</span></code></a></p></td>
+<td><p>Interact with AWS Batch.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
-<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
-<dd></dd></dl>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class= [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.
+This is used for type hints on <code class="xref py py-meth docutils literal notranslate"><span class="pre">BatchClient.client()</span></code>; it covers
+only the subset of client methods required.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html</a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">
+<span class="sig-name descname"><span class="pre">describe_jobs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.describe_jobs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get job descriptions from AWS Batch</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>jobs</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – a list of JobId to describe</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe jobs</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiterName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get an AWS Batch service waiter</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing).</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>AWS Batch might not have any waiters (until botocore PR-1307 is released).</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">boto3</span>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd></dd></dl>
+<span class="n">boto3</span><span class="o">.</span><span class="n">client</span><span class="p">(</span><span class="s2">"batch"</span><span class="p">)</span><span class="o">.</span><span class="n">waiter_names</span> <span class="o">==</span> <span class="p">[]</span>
+</pre></div>
+</div>
+</div>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/pull/1307">https://github.com/boto/botocore/pull/1307</a></p></li>
+</ul>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">
+<span class="sig-name descname"><span class="pre">submit_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobQueue</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobDefinition</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">arrayProperties</span></span></em>, <em class="sig-param"><span class=" [...]
+<dd><p>Submit a Batch job</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the name for the AWS Batch job</p></li>
+<li><p><strong>jobQueue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the queue name on AWS Batch</p></li>
+<li><p><strong>jobDefinition</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the job definition name on AWS Batch</p></li>
+<li><p><strong>arrayProperties</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>containerOverrides</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>tags</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobId</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.terminate_job"><span class="viewcode-link"><span class= [...]
+<dd><p>Terminate a Batch job</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobId</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a reason to terminate job ID</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchClientHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class=" [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Batch.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html#Batch.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("batch")</span></code></a>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>max_retries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – exponential back-off retries, 4200 = 48 hours;
+polling is only used when waiters is None</p></li>
+<li><p><strong>status_retries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – number of HTTP retries to get job status, 10;
+polling is only used when waiters is None</p></li>
+</ul>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>Several methods use a default random delay to check or poll for job status, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>
+Using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
+<p>To modify the global defaults for the range of jitter allowed when a
+random delay is used to check Batch job status, modify these defaults, e.g.:
+.. code-block:</p>
+<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MIN</span> <span class="o">=</span> <span class="mi">0</span>
+<span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MAX</span> <span class="o">=</span> <span class="mi">5</span>
+</pre></div>
+</div>
+<p>When explicit delay values are used, a 1 second random jitter is applied to the
+delay (e.g. a delay of 0 sec will be a <code class="docutils literal notranslate"><span class="pre">random.uniform(0,</span> <span class="pre">1)</span></code> delay. It is
+generally recommended that random jitter is added to API requests. A
+convenience method is provided for this, e.g. to get a random delay of
+10 sec +/- 5 sec: <code class="docutils literal notranslate"><span class="pre">delay</span> <span class="pre">=</span> <span class="pre">BatchClient.add_jitter(10,</span> <span class="pre">width=5,</span> <span class="pre">minima=0)</span></code></p>
+</div>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
+</div>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">client</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><span class="pre">BatchProtocol</span></a><span class="w"> </span><span cla [...]
+<dd><p>An AWS API client for Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a boto3 ‘batch’ client for the <code class="docutils literal notranslate"><span class="pre">.region_name</span></code></p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a> | botocore.client.BaseClient</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">
+<span class="sig-name descname"><span class="pre">MAX_RETRIES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">4200</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.MAX_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provider [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">
+<span class="sig-name descname"><span class="pre">STATUS_RETRIES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.STATUS_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MIN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">1</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MIN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MAX</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MAX"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">
+<span class="sig-name descname"><span class="pre">FAILURE_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'FAILED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.FAILURE_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'SUCCEEDED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.SUCCESS_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airfl [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">
+<span class="sig-name descname"><span class="pre">RUNNING_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'RUNNING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.RUNNING_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
<dd></dd></dl>
-</dd></dl>
-
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
-</ul>
-</dd>
-</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUBMITTED',</span> <span class="pre">'PENDING',</span> <span class="pre">'RUNNABLE',</span> <span class="pre">'STARTING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.INT [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('VALID',</span> <span class="pre">'DELETED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS"><span class="viewcode-link"> [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_ [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('VALID',</span> <span class="pre">'DELETED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_TERMINAL_STATUS"><span class="viewcode-link"><span class="pre">[s [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS" [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.terminate_job"><span class="viewcode-link"><span cla [...]
+<dd><p>Terminate a Batch job</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a reason to terminate job ID</p></li>
+</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
+<dd class="field-even"><p>an API response</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">
+<span class="sig-name descname"><span class="pre">check_job_success</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.check_job_success"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
+<dd><p>Check the final status of the Batch job; return True if the job
+‘SUCCEEDED’, else raise an AirflowException</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">
+<span class="sig-name descname"><span class="pre">poll_for_job_running</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/ai [...]
+<dd><p>Poll for job running. The status that indicates a job is running or
+already complete are: ‘RUNNING’|’SUCCEEDED’|’FAILED’.</p>
+<p>So the status options that this will wait for are the transitions from:
+‘SUBMITTED’>’PENDING’>’RUNNABLE’>’STARTING’>’RUNNING’|’SUCCEEDED’|’FAILED’</p>
+<p>The completed status options are included for cases where the status
+changes too quickly for polling to detect a RUNNING status that moves
+quickly from STARTING to RUNNING to completed (often a failure).</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">
+<span class="sig-name descname"><span class="pre">poll_for_job_complete</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/a [...]
+<dd><p>Poll for job completion. The status that indicates job completion
+are: ‘SUCCEEDED’|’FAILED’.</p>
+<p>So the status options that this will wait for are the transitions from:
+‘SUBMITTED’>’PENDING’>’RUNNABLE’>’STARTING’>’RUNNING’>’SUCCEEDED’|’FAILED’</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">
+<span class="sig-name descname"><span class="pre">poll_job_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">match_status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.poll_job_status"><span class="viewcode-link" [...]
+<dd><p>Poll for job status using an exponential back-off strategy (with max_retries).</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>match_status</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – a list of job status to match; the Batch job status are:
+‘SUBMITTED’|’PENDING’|’RUNNABLE’|’STARTING’|’RUNNING’|’SUCCEEDED’|’FAILED’</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">
+<span class="sig-name descname"><span class="pre">get_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
+<dd><p>Get job description (using status_retries).</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+<dd class="field-even"><p>an API response for describe jobs</p>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">parse_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">response</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/h [...]
+<dd><p>Parse job description to extract description for job_id</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>response</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – an API response for describe jobs</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe job_id</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
</dd>
<dt class="field-even">Return type</dt>
<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
@@ -839,59 +1022,104 @@ See Tenacity documentation at <a class="reference external" href="https://github
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">
+<span class="sig-name descname"><span class="pre">get_job_awslogs_info</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_awslogs_info"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airfl [...]
+<dd><p>Parse job description to extract AWS CloudWatch information.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – AWS Batch Job ID</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">add_jitter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">width</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">1</span></span></em>, <em class="sig-param"><span cla [...]
+<dd><p>Use delay +/- width for random jitter</p>
+<p>Adding jitter to status polling can help to avoid
+AWS Batch API limits for monitoring Batch jobs with
+a high concurrency in Airflow tasks.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – number of seconds to pause;
+delay is assumed to be a positive number</p></li>
+<li><p><strong>width</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – delay +/- width for random jitter;
+width is assumed to be a positive number</p></li>
+<li><p><strong>minima</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – minimum delay allowed;
+minima is assumed to be a non-negative number</p></li>
</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
+<dd class="field-even"><p>uniform(delay - width, delay + width) jitter
+and it is a non-negative number</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)">float</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/a [...]
+<dd><p>Pause execution for <code class="docutils literal notranslate"><span class="pre">delay</span></code> seconds.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay to pause execution using <code class="docutils literal notranslate"><span class="pre">time.sleep(delay)</span></code>;
+a small 1 second jitter is applied to the delay.</p>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method uses a default random delay, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>;
+using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">exponential_delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">tries</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.exponential_delay"><span class="viewcode-link"><spa [...]
+<dd><p>An exponential back-off delay, with random jitter. There is a maximum
+interval of 10 minutes (with random jitter between 3 and 10 minutes).
+This is used in the <code class="xref py py-meth docutils literal notranslate"><span class="pre">poll_for_job_status()</span></code> method.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>tries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Number of tries</p>
</dd>
</dl>
+<p>Examples of behavior:</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="k">def</span> <span class="nf">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">):</span>
+ <span class="n">max_interval</span> <span class="o">=</span> <span class="mf">600.0</span> <span class="c1"># 10 minutes in seconds</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="mi">1</span> <span class="o">+</span> <span class="nb">pow</span><span class="p">(</span><span class="n">tries</span> <span class="o">*</span> <span class="mf">0.6</span><span class="p">,</span> <span class="mi">2</span><span class="p">)</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="nb">min</span><span class="p">(</span><span class="n">max_interval</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+ <span class="nb">print</span><span class="p">(</span><span class="n">delay</span> <span class="o">/</span> <span class="mi">3</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+
+
+<span class="k">for</span> <span class="n">tries</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">10</span><span class="p">):</span>
+ <span class="n">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">)</span>
+
+<span class="c1"># 0.33 1.0</span>
+<span class="c1"># 0.45 1.35</span>
+<span class="c1"># 0.81 2.44</span>
+<span class="c1"># 1.41 4.23</span>
+<span class="c1"># 2.25 6.76</span>
+<span class="c1"># 3.33 10.00</span>
+<span class="c1"># 4.65 13.95</span>
+<span class="c1"># 6.21 18.64</span>
+<span class="c1"># 8.01 24.04</span>
+<span class="c1"># 10.05 30.15</span>
+</pre></div>
+</div>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
+</div>
</dd></dl>
</dd></dl>
@@ -902,10 +1130,10 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,67 +1203,77 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><code class="docutils literal notranslate"><span class="pre">BatchProtocol</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.describe_jobs()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.submit_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.terminate_job()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="docutils literal notranslate"><span class="pre">BatchClientHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.client</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.MAX_RETRIES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.STATUS_RETRIES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.DEFAULT_DELAY_MIN</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.DEFAULT_DELAY_MAX</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.FAILURE_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.SUCCESS_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.RUNNING_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.JOB_QUEUE_TERMINAL_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.terminate_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.check_job_success()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.wait_for_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_for_job_running()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_for_job_complete()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_job_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.get_job_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.parse_job_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.get_job_awslogs_info()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.add_jitter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.delay()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.exponential_delay()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">describe_jobs</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">submit_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">terminate_job</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">BatchClientHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">client</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">MAX_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">STATUS_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">DEFAULT_DELAY_MIN</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">DEFAULT_DELAY_MAX</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">FAILURE_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">SUCCESS_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">RUNNING_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">JOB_QUEUE_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">JOB_QUEUE_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">terminate_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">check_job_success</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">wait_for_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">poll_for_job_running</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">poll_for_job_complete</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">poll_job_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">get_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">parse_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">get_job_awslogs_info</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">add_jitter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">delay</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">exponential_delay</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1304,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_client/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
similarity index 75%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
index bbb82cc117..8ec91033f0 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.batch_waiters — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,16 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_waiters">
+<span id="airflow-providers-amazon-aws-hooks-batch-waiters"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="airflow.providers.amazon.aws.hooks.batch_waiters"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="Permalink to this heading">¶</a></h1>
+<p>AWS Batch service waiters</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
+</ul>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,81 +624,194 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook" title="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchWaitersHook</span></code></a></p></td>
+<td><p>A utility to manage waiters for AWS Batch services.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters.</span></span><span class="sig-name descname"><span class="pre">BatchWaitersHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class [...]
+<dd><p>Bases: <a class="reference internal" href="../batch_client/index.html#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook</span></code></a></p>
+<p>A utility to manage waiters for AWS Batch services.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+<span class="kn">from</span> <span class="nn">airflow.providers.amazon.aws.operators.batch_waiters</span> <span class="kn">import</span> <span class="n">BatchWaiters</span>
+
+<span class="c1"># to inspect default waiters</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">()</span>
+<span class="n">config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># type: Dict</span>
+<span class="n">waiter_names</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># -> ["JobComplete", "JobExists", "JobRunning"]</span>
+
+<span class="c1"># The default_config is a useful stepping stone to creating custom waiters, e.g.</span>
+<span class="n">custom_config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># this is a deepcopy</span>
+<span class="c1"># modify custom_config['waiters'] as necessary and get a new instance:</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">(</span><span class="n">waiter_config</span><span class="o">=</span><span class="n">custom_config</span><span class="p">)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_config</span> <span class="c1"># check the custom configuration (this is a deepcopy)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># names of custom waiters</span>
+
+<span class="c1"># During the init for BatchWaiters, the waiter_config is used to build a waiter_model;</span>
+<span class="c1"># and note that this only occurs during the class init, to avoid any accidental mutations</span>
+<span class="c1"># of waiter_config leaking into the waiter_model.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_model</span> <span class="c1"># -> botocore.waiter.WaiterModel object</span>
+
+<span class="c1"># The waiter_model is combined with the waiters.client to get a specific waiter</span>
+<span class="c1"># and the details of the config on that waiter can be further modified without any</span>
+<span class="c1"># accidental impact on the generation of new waiters from the defined waiter_model, e.g.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+
+<span class="c1"># To use a specific waiter, update the config and call the `wait()` method for jobId, e.g.</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
</div>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://www.2ndwatch.com/blog/use-waiters-boto3-write/">https://www.2ndwatch.com/blog/use-waiters-boto3-write/</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15">https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/issues/1915">https://github.com/boto/botocore/issues/1915</a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>waiter_config</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em> | </em><em>None</em>) – a custom waiter configuration for AWS Batch services</p></li>
+<li><p><strong>aws_conn_id</strong> – connection id of AWS credentials / region name. If None,
+credential boto3 strategy will be used
+(<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html</a>).</p></li>
+<li><p><strong>region_name</strong> – region name to use in AWS client.
+Override the AWS region in connection (if provided)</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">default_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><p>An immutable default waiter configuration</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/ [...]
+<dd><p>An immutable waiter configuration for this instance; a <code class="docutils literal notranslate"><span class="pre">deepcopy</span></code> is returned by this
+property. During the init for BatchWaiters, the waiter_config is used to build a
+waiter_model and this only occurs during the class init, to avoid any accidental
+mutations of waiter_config leaking into the waiter_model.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_model</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">botocore.waiter.WaiterModel</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.waiter_model"><span class="viewcode-link"><sp [...]
+<dd><p>A configured waiter model used to generate waiters on AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter model for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>botocore.waiter.WaiterModel</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiter_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Get an AWS Batch service waiter, using the configured <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>.</p>
+<p>The <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is combined with the <code class="docutils literal notranslate"><span class="pre">.client</span></code> to get a specific waiter and
+the properties of that waiter can be modified without any accidental impact on the
+generation of new waiters from the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+</pre></div>
+</div>
+<p>To use a specific waiter, update the config and call the <cite>wait()</cite> method for jobId, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiter_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing); see <code class="docutils literal notranslate"><span class="pre">.list_waiters</span></code>.</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">
+<span class="sig-name descname"><span class="pre">list_waiters</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.list_waiters"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters" title="Permalink to [...]
+<dd><p>List the waiters in a waiter configuration for AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>waiter names for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a>]</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete. This assumes that the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is configured
+using some variation of the <code class="docutils literal notranslate"><span class="pre">.default_config</span></code> so that it can generate waiters with the
+following names: “JobExists”, “JobRunning” and “JobComplete”.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – A delay before polling for job status</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
+</dd>
</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method adds a small random jitter to the <code class="docutils literal notranslate"><span class="pre">delay</span></code> (+/- 2 sec, >= 1 sec).
+Using a random interval helps to avoid AWS API throttle limits when many
+concurrent tasks request job-descriptions.</p>
+<p>It also modifies the <code class="docutils literal notranslate"><span class="pre">max_attempts</span></code> to use the <code class="docutils literal notranslate"><span class="pre">sys.maxsize</span></code>,
+which allows Airflow to manage the timeout on waiting.</p>
+</div>
</dd></dl>
</dd></dl>
@@ -685,10 +822,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +895,25 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.default_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.waiter_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.waiter_model</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.list_waiters()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.wait_for_job()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">BatchWaitersHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">default_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">waiter_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">waiter_model</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">list_waiters</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">wait_for_job</a></li>
</ul>
</li>
</ul>
@@ -807,7 +944,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
similarity index 86%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
index 1ea82ab6c2..be2af3f69d 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.cloud_formation — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.cloud_formation">
+<span id="airflow-providers-amazon-aws-hooks-cloud-formation"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="airflow.providers.amazon.aws.hooks.cloud_formation"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="Permalink to this heading [...]
+<p>This module contains AWS CloudFormation Hook</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +617,77 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook" title="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">CloudFormationHook</span></code></a></p></td>
+<td><p>Interact with AWS CloudFormation.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation.</span></span><span class="sig-name descname"><span class="pre">CloudFormationHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span c [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS CloudFormation.
+Provide thin wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("cloudformation")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">
+<span class="sig-name descname"><span class="pre">get_stack_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.get_stack_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><p>Get stack status from CloudFormation.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.describe_stacks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.describe_stacks()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">
+<span class="sig-name descname"><span class="pre">create_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.create_stack"><span clas [...]
+<dd><p>Create stack in CloudFormation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.create_stack" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.create_stack()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – parameters to be passed to CloudFormation.</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
-<dd></dd></dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">
+<span class="sig-name descname"><span class="pre">delete_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../. [...]
+<dd><p>Delete stack in CloudFormation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.delete_stack" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.delete_stack()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em> | </em><em>None</em>) – parameters to be passed to CloudFormation (optional).</p></li>
+</ul>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +699,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +772,19 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.get_stack_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.create_stack()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.delete_stack()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">CloudFormationHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">get_stack_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">create_stack</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">delete_stack</a></li>
</ul>
</li>
</ul>
@@ -778,7 +815,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
similarity index 67%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
index bbb82cc117..b9741beda3 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.datasync — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.datasync">
+<span id="airflow-providers-amazon-aws-hooks-datasync"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="airflow.providers.amazon.aws.hooks.datasync"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="Permalink to this heading">¶</a></h1>
+<p>Interact with AWS DataSync, using the AWS <code class="docutils literal notranslate"><span class="pre">boto3</span></code> library.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +617,334 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook" title="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DataSyncHook</span></code></a></p></td>
+<td><p>Interact with AWS DataSync.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.datasync.</span></span><span class="sig-name descname"><span class="pre">DataSyncHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">wait_interval_seconds</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">30 [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS DataSync.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("datasync")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>wait_interval_seconds</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time to wait between two
+consecutive calls to check TaskExecution status. Defaults to 30 seconds.</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/exceptions.html#ValueError" title="(in Python v3.11)"><strong>ValueError</strong></a> – If wait_interval_seconds is not between 0 and 15*60 seconds.</p>
+</dd>
+</dl>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('INITIALIZING',</span> <span class="pre">'QUEUED',</span> <span class="pre">'LAUNCHING',</span> <span class="pre">'PREPARING',</span> <span class="pre">'TRANSFERRING',</span> <span class="pre">'VERIFYING')</span></em><a class="reference internal" href="../. [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('ERROR',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class=" [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCESS',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">
+<span class="sig-name descname"><span class="pre">create_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_location_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.htm [...]
+<dd><p>Creates a new location.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_s3" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_s3()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_smb" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_smb()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_nfs" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_nfs()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_efs" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_efs()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Location URI used to determine the location type (S3, SMB, NFS, EFS).</p></li>
+<li><p><strong>create_location_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">DataSync.Client.create_location_*</span></code> methods.</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>LocationArn of the created Location.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowException</strong> – If location type (prefix from <code class="docutils literal notranslate"><span class="pre">location_uri</span></code>) is invalid.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">
+<span class="sig-name descname"><span class="pre">get_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">case_sensitive</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ignore_trailing_slash</span>< [...]
+<dd><p>Return all LocationArns which match a LocationUri.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Location URI to search for, eg <code class="docutils literal notranslate"><span class="pre">s3://mybucket/mypath</span></code></p></li>
+<li><p><strong>case_sensitive</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Do a case sensitive search for location URI.</p></li>
+<li><p><strong>ignore_trailing_slash</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Ignore / at the end of URI when matching.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of LocationArns.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">location_uri</span></code> is empty</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">
+<span class="sig-name descname"><span class="pre">create_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="ref [...]
+<dd><p>Create a Task between the specified source and destination LocationArns.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Source LocationArn. Must exist already.</p></li>
+<li><p><strong>destination_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Destination LocationArn. Must exist already.</p></li>
+<li><p><strong>create_task_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">boto.create_task()</span></code>. See AWS boto3 datasync documentation.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskArn of the created Task</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">
+<span class="sig-name descname"><span class="pre">update_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">update_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHo [...]
+<dd><p>Update a Task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.update_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.update_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The TaskArn to update.</p></li>
+<li><p><strong>update_task_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">boto.update_task()</span></code>, See AWS boto3 datasync documentation.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">
+<span class="sig-name descname"><span class="pre">delete_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.delete_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Delete a Task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.delete_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.delete_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The TaskArn to delete.</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">
+<span class="sig-name descname"><span class="pre">get_task_arns_for_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arns</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arns</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task [...]
+<dd><p>Return list of TaskArns for which use any one of the specified
+source LocationArns and any one of the specified destination LocationArns.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of source LocationArns.</p></li>
+<li><p><strong>destination_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of destination LocationArns.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">source_location_arns</span></code> or <code class="docutils literal notranslate"><span class="pre">destination_location_arns</span></code> are empty.</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">
+<span class="sig-name descname"><span class="pre">start_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook. [...]
+<dd><p>Start a TaskExecution for the specified task_arn.
+Each task can have at most one TaskExecution.
+Additional keyword arguments send to <code class="docutils literal notranslate"><span class="pre">start_task_execution</span></code> boto3 method.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.start_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.start_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskExecutionArn</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>ClientError</strong> – If a TaskExecution is already busy running for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p></li>
+<li><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">
+<span class="sig-name descname"><span class="pre">cancel_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.cancel_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Cancel a TaskExecution for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.cancel_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.cancel_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn.</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">
+<span class="sig-name descname"><span class="pre">get_task_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pr [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.describe_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.describe_task()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">
+<span class="sig-name descname"><span class="pre">describe_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.describe_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" h [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.describe_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.describe_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task execution.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">
+<span class="sig-name descname"><span class="pre">get_current_task_execution_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_current_task_execution_arn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
+<dd><p>Get current TaskExecutionArn (if one exists) for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>CurrentTaskExecutionArn for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> or None.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">
+<span class="sig-name descname"><span class="pre">wait_for_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_iterations</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">60</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../. [...]
+<dd><p>Wait for Task Execution status to be complete (SUCCESS/ERROR).
+The <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> must exist, or a boto3 ClientError will be raised.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn</p></li>
+<li><p><strong>max_iterations</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Maximum number of iterations before timing out.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Result of task execution.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>AirflowTaskTimeout</strong> – If maximum iterations is exceeded.</p></li>
+<li><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)">bool</a></p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +956,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +1029,43 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook"><code class="docutils literal notranslate"><span class="pre">DataSyncHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_FAILURE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_SUCCESS_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.create_location()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_location_arns()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.create_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.update_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.delete_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_task_arns_for_location_arns()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.start_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.cancel_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_task_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.describe_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_current_task_execution_arn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.wait_for_task_execution()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">DataSyncHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">TASK_EXECUTION_INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">TASK_EXECUTION_FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">TASK_EXECUTION_SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">create_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">get_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">create_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">update_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">delete_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">get_task_arns_for_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">start_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">cancel_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">get_task_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">describe_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">get_current_task_execution_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">wait_for_task_execution</a></li>
</ul>
</li>
</ul>
@@ -807,7 +1096,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/datasync/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
similarity index 74%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
index bbb82cc117..4d4555d659 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.dms — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dms">
+<span id="airflow-providers-amazon-aws-hooks-dms"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dms" title="airflow.providers.amazon.aws.hooks.dms"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dms" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,213 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus</span></code></a></p></td>
+<td><p>Available AWS DMS Task Waiter statuses.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook" title="airflow.providers.amazon.aws.hooks.dms.DmsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsHook</span></code></a></p></td>
+<td><p>Interact with AWS Database Migration Service (DMS).</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsTaskWaiterStatus</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="heade [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">str</span></code></a>, <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Available AWS DMS Task Waiter statuses.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">
+<span class="sig-name descname"><span class="pre">DELETED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'deleted'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.DELETED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">
+<span class="sig-name descname"><span class="pre">READY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ready'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.READY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'stopped'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Database Migration Service (DMS).
+Provide thin wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("dms")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">
+<span class="sig-name descname"><span class="pre">describe_replication_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.describe_replication_tasks"><span class="viewcode-link"><span class="pre">[source]</span> [...]
+<dd><p>Describe replication tasks</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.describe_replication_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.describe_replication_tasks()</span></code></a></p></li>
+</ul>
</div>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>Marker and list of replication tasks</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#tuple" title="(in Python v3.11)">tuple</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None, <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">
+<span class="sig-name descname"><span class="pre">find_replication_tasks_by_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">without_settings</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" hre [...]
+<dd><p>Find and describe replication tasks by task ARN</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.describe_replication_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.describe_replication_tasks()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task arn</p></li>
+<li><p><strong>without_settings</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – Indicates whether to return task information with settings.</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>list of replication tasks that match the ARN</p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">
+<span class="sig-name descname"><span class="pre">get_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.get_task_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Retrieve task status.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Current task status</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None</p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">
+<span class="sig-name descname"><span class="pre">create_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">source_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">replication_instance_arn</spa [...]
+<dd><p>Create DMS replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.create_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.create_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task id</p></li>
+<li><p><strong>source_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Source endpoint ARN</p></li>
+<li><p><strong>target_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Target endpoint ARN</p></li>
+<li><p><strong>replication_instance_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication instance ARN</p></li>
+<li><p><strong>table_mappings</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – Table mappings</p></li>
+<li><p><strong>migration_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Migration type (‘full-load’|’cdc’|’full-load-and-cdc’), full-load by default.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Replication task ARN</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">
+<span class="sig-name descname"><span class="pre">start_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">start_replication_task_type</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class=" [...]
+<dd><p>Starts replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.start_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.start_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p></li>
+<li><p><strong>start_replication_task_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task start type (default=’start-replication’)
+(‘start-replication’|’resume-processing’|’reload-target’)</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">
+<span class="sig-name descname"><span class="pre">stop_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.stop_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Stops replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.stop_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.stop_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> – Replication task ARN</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">
+<span class="sig-name descname"><span class="pre">delete_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.delete_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Starts replication task deletion and waits for it to be deleted.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.delete_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.delete_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> – Replication task ARN</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">
+<span class="sig-name descname"><span class="pre">wait_for_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.wait_for_task_status"><span class="viewcode-link [...]
+<dd><p>Waits for replication task to reach status.
+Supported statuses: deleted, ready, running, stopped.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>status</strong> (<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><em>DmsTaskWaiterStatus</em></a>) – Status to wait for</p></li>
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p></li>
+</ul>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +834,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +907,43 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.DELETED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.READY</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.RUNNING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.STOPPED</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook"><code class="docutils literal notranslate"><span class="pre">DmsHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks"><code class="docutils literal notranslate"><span class="pre">DmsHook.describe_replication_tasks()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn"><code class="docutils literal notranslate"><span class="pre">DmsHook.find_replication_tasks_by_arn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status"><code class="docutils literal notranslate"><span class="pre">DmsHook.get_task_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.create_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.start_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.stop_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.delete_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status"><code class="docutils literal notranslate"><span class="pre">DmsHook.wait_for_task_status()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">DmsTaskWaiterStatus</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">DELETED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">READY</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">STOPPED</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook">DmsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">describe_replication_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">find_replication_tasks_by_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">get_task_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">create_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">start_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">stop_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">delete_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">wait_for_task_status</a></li>
</ul>
</li>
</ul>
@@ -807,7 +974,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dms/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
similarity index 87%
copy from docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
index 356f682a14..78dd6af447 100644
--- a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
@@ -9,18 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.discord.operators.discord_webhook — apache-airflow-providers-discord Documentation</title>
- <link rel="stylesheet" href="../../../../../../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main-custom.min.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/graphviz.css" />
- <link rel="shortcut icon" href="../../../../../../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../../../../../../genindex.html" />
- <link rel="search" title="Search" href="../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.discord.operators" href="../index.html" />
+ <title>airflow.providers.amazon.aws.hooks.dynamodb — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -295,7 +295,7 @@
</div>
<div class="searchb-box">
- <form class="search-form" action="../../../../../../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -325,15 +325,30 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -417,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -428,7 +443,7 @@
</div>
<div class="searchb-box">
- <form class="search-form" action="../../../../../../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -458,15 +473,30 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -555,13 +585,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../../../../../../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a></li>
</ul>
</div>
@@ -572,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.discord.operators.discord_webhook">
-<span id="airflow-providers-discord-operators-discord-webhook"></span><h1><a class="reference internal" href="#module-airflow.providers.discord.operators.discord_webhook" title="airflow.providers.discord.operators.discord_webhook"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><a class="headerlink" href="#module-airflow.providers.discord.operators.discord_webhook" title="Permalink to this he [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dynamodb">
+<span id="airflow-providers-amazon-aws-hooks-dynamodb"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="airflow.providers.amazon.aws.hooks.dynamodb"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="Permalink to this heading">¶</a></h1>
+<p>This module contains the Amazon DynamoDB Hook</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -584,48 +617,50 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator" title="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a></p></td>
-<td><p>This operator allows you to post messages to Discord using incoming webhooks.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook" title="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DynamoDBHook</span></code></a></p></td>
+<td><p>Interact with Amazon DynamoDB.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.discord.operators.discord_webhook.</span></span><span class="sig-name descname"><span class="pre">DiscordWebhookOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">http_conn_id</span></span><span clas [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/operators/http/index.html#airflow.providers.http.operators.http.SimpleHttpOperator" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.operators.http.SimpleHttpOperator</span></code></a></p>
-<p>This operator allows you to post messages to Discord using incoming webhooks.
-Takes a Discord connection ID with a default relative webhook endpoint. The
-default endpoint can be overridden using the webhook_endpoint parameter
-(<a class="reference external" href="https://discordapp.com/developers/docs/resources/webhook">https://discordapp.com/developers/docs/resources/webhook</a>).</p>
-<p>Each Discord webhook can be pre-configured to use a specific username and
-avatar_url. You can override these defaults in this operator.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb.</span></span><span class="sig-name descname"><span class="pre">DynamoDBHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ta [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon DynamoDB.
+Provide thick wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.ServiceResource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.resource("dynamodb")</span></code></a>.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>http_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Http connection ID with host as “<a class="reference external" href="https://discord.com/api/">https://discord.com/api/</a>” and
-default webhook endpoint in the extra field in the form of
-{“webhook_endpoint”: “webhooks/{webhook.id}/{webhook.token}”}</p></li>
-<li><p><strong>webhook_endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Discord webhook endpoint in the form of
-“webhooks/{webhook.id}/{webhook.token}” (templated)</p></li>
-<li><p><strong>message</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The message you want to send to your Discord channel
-(max 2000 characters). (templated)</p></li>
-<li><p><strong>username</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default username of the webhook. (templated)</p></li>
-<li><p><strong>avatar_url</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default avatar of the webhook</p></li>
-<li><p><strong>tts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Is a text-to-speech message</p></li>
-<li><p><strong>proxy</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Proxy to use to make the Discord webhook call</p></li>
+<li><p><strong>table_keys</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – partition key and sort key</p></li>
+<li><p><strong>table_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – target DynamoDB table</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/discord/operators/discord_webhook.html#DiscordWebhookOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.disc [...]
-<dd><p>Call the DiscordWebhookHook to post message</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">
+<span class="sig-name descname"><span class="pre">write_batch_data</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">items</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dynamodb.html#DynamoDBHook.write_batch_data"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Write batch items to DynamoDB table with provisioned throughout capacity.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.ServiceResource.Table" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.ServiceResource.Table()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.Table.batch_writer" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.Table.batch_writer()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.Table.put_item" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.Table.put_item()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>items</strong> (<em>Iterable</em>) – list of DynamoDB items.</p>
+</dd>
</dl>
</dd></dl>
@@ -637,10 +672,10 @@ default webhook endpoint in the extra field in the form of
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.discord.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -710,17 +745,15 @@ default webhook endpoint in the extra field in the form of
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook"><code class="docutils literal notranslate"><span class="pre">DynamoDBHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data"><code class="docutils literal notranslate"><span class="pre">DynamoDBHook.write_batch_data()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">DiscordWebhookOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">DynamoDBHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">write_batch_data</a></li>
</ul>
</li>
</ul>
@@ -751,7 +784,7 @@ default webhook endpoint in the extra field in the form of
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-discord/_api/airflow/providers/discord/operators/discord_webhook/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -885,19 +918,19 @@ default webhook endpoint in the extra field in the form of
</span>
</div>
</footer>
- <script type="text/javascript" src="../../../../../../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../" src="../../../../../../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../../../../../../" id="documentation_options" src="../../../../../../_static/documentation_options.js"></script>
- <script src="../../../../../../_static/jquery.js"></script>
- <script src="../../../../../../_static/underscore.js"></script>
- <script src="../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../../../../../../_static/doctools.js"></script>
- <script src="../../../../../../_static/sphinx_highlight.js"></script>
- <script src="../../../../../../_static/clipboard.min.js"></script>
- <script src="../../../../../../_static/copybutton.js"></script>
- <script src="../../../../../../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/sphinx_highlight.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
similarity index 76%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
index bbb82cc117..f7109f9395 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ec2 — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ec2">
+<span id="airflow-providers-amazon-aws-hooks-ec2"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="airflow.providers.amazon.aws.hooks.ec2"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,214 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook" title="airflow.providers.amazon.aws.hooks.ec2.EC2Hook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EC2Hook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Compute Cloud (EC2).</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type" title="airflow.providers.amazon.aws.hooks.ec2.only_client_type"><code class="xref py py-obj docutils literal notranslate"><span class="pre">only_client_type</span></code></a>(func)</p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.only_client_type">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">only_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">func</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#only_client_type"><span class="viewcode-link"><s [...]
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">EC2Hook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">api_type</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'resource_type'</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Elastic Compute Cloud (EC2).
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ec2")</span></code></a>
+or <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.ServiceResource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.resource("ec2")</span></code></a>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>api_type</strong> – If set to <code class="docutils literal notranslate"><span class="pre">client_type</span></code> then hook use <code class="docutils literal notranslate"><span class="pre">boto3.client("ec2")</span></code> capabilities,
+If set to <code class="docutils literal notranslate"><span class="pre">resource_type</span></code> then hook use <code class="docutils literal notranslate"><span class="pre">boto3.resource("ec2")</span></code> capabilities.</p>
+</dd>
+</dl>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">
+<span class="sig-name descname"><span class="pre">API_TYPES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.API_TYPES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">
+<span class="sig-name descname"><span class="pre">get_instance</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/air [...]
+<dd><p>Get EC2 instance by id and return it.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p></li>
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Instance object</p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">
+<span class="sig-name descname"><span class="pre">stop_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.stop_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Stop instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to stop</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StoppingInstances</cite> and value as list of instances being stopped</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">
+<span class="sig-name descname"><span class="pre">start_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.start_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.a [...]
+<dd><p>Start instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to start</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StartingInstances</cite> and value as list of instances being started</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">
+<span class="sig-name descname"><span class="pre">terminate_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.terminate_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Terminate instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to terminate</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>TerminatingInstances</cite> and value as list of instances being terminated</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">
+<span class="sig-name descname"><span class="pre">describe_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None [...]
+<dd><p>Describe EC2 instances, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to describe</p></li>
+<li><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of instance IDs to describe</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Response from EC2 describe_instances API</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">
+<span class="sig-name descname"><span class="pre">get_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get list of instance details, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of ids to get instances for</p></li>
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instances</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">
+<span class="sig-name descname"><span class="pre">get_instance_ids</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_ids"><span class="view [...]
+<dd><p>Get list of instance ids, optionally applying filters to fetch selective instances</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instance ids</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">
+<span class="sig-name descname"><span class="pre">get_instance_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Get EC2 instance state by id and return it.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>current state of the instance</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">
+<span class="sig-name descname"><span class="pre">wait_for_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_state</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">check_interval</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/ [...]
+<dd><p>Wait EC2 instance until its state is equal to the target_state.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p></li>
+<li><p><strong>target_state</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – target state of instance</p></li>
+<li><p><strong>check_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – time in seconds that the job should wait in
+between each instance state checks until operation is completed</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +835,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +908,36 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type"><code class="docutils literal notranslate"><span class="pre">only_client_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook"><code class="docutils literal notranslate"><span class="pre">EC2Hook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES"><code class="docutils literal notranslate"><span class="pre">EC2Hook.API_TYPES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.stop_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.start_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.terminate_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.describe_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance_ids()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state"><code class="docutils literal notranslate"><span class="pre">EC2Hook.wait_for_state()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type">only_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook">EC2Hook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">API_TYPES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">get_instance</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">stop_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">start_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">terminate_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">describe_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">get_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">get_instance_ids</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">get_instance_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">wait_for_state</a></li>
</ul>
</li>
</ul>
@@ -807,7 +968,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ec2/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
similarity index 82%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
index bbb82cc117..769312bd5d 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ecr — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ecr">
+<span id="airflow-providers-amazon-aws-hooks-ecr"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ecr" title="airflow.providers.amazon.aws.hooks.ecr"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ecr" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,109 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcrCredentials</span></code></a></p></td>
+<td><p>Helper (frozen dataclass) for storing temporary ECR credentials.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook" title="airflow.providers.amazon.aws.hooks.ecr.EcrHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcrHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Container Registry (ECR).</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
-</div>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
</div>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger" title="airflow.providers.amazon.aws.hooks.ecr.logger"><code class="xref py py-obj docutils literal notranslate"><span class="pre">logger</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.logger">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">logger</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#logger"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecr.logger" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">EcrCredentials</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" hre [...]
+<dd><p>Helper (frozen dataclass) for storing temporary ECR credentials.</p>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">registry</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/ [...]
+<dd><p>Return registry in appropriate <cite>docker login</cite> format.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
-</ul>
-</dd>
</dl>
+</dd></dl>
+
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username">
+<span class="sig-name descname"><span class="pre">username</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.username"><span class="viewcode-link"><span class [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password">
+<span class="sig-name descname"><span class="pre">password</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.password"><span class="viewcode-link"><span class [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint">
+<span class="sig-name descname"><span class="pre">proxy_endpoint</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.proxy_endpoint"><span class="viewcode-link" [...]
<dd></dd></dl>
-<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
-</dl>
-</dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at">
+<span class="sig-name descname"><span class="pre">expires_at</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/datetime.html#datetime.datetime" title="(in Python v3.11)"><span class="pre">datetime.datetime</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.expires_at"><span c [...]
+<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
-</dl>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__">
+<span class="sig-name descname"><span class="pre">__post_init__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.__post_init__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
</dd></dl>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">EcrHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href= [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Elastic Container Registry (ECR).
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecr.html#ECR.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ecr")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials">
+<span class="sig-name descname"><span class="pre">get_temporary_credentials</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">registry_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrHook.get_temporary_credent [...]
+<dd><p>Get temporary credentials for Amazon ECR.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecr.html#ECR.Client.get_authorization_token" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECR.Client.get_authorization_token()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>registry_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </ [...]
+with the registries from which credentials are obtained. If you do not specify a registry,
+the default registry is assumed.</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>list of <a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.EcrCredentials</span></code></a>,
+obtained credentials valid for 12 hours.</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">EcrCredentials</a>]</p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +730,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +803,36 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger"><code class="docutils literal notranslate"><span class="pre">logger</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="docutils literal notranslate"><span class="pre">EcrCredentials</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.registry</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.username</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.password</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.proxy_endpoint</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.expires_at</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.__post_init__()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook"><code class="docutils literal notranslate"><span class="pre">EcrHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials"><code class="docutils literal notranslate"><span class="pre">EcrHook.get_temporary_credentials()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger">logger</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">EcrCredentials</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry">registry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username">username</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password">password</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint">proxy_endpoint</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at">expires_at</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__">__post_init__</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook">EcrHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials">get_temporary_credentials</a></li>
</ul>
</li>
</ul>
@@ -807,7 +863,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ecr/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
similarity index 62%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
index 311386562a..5ed9a30ad2 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ecs — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ecs">
+<span id="airflow-providers-amazon-aws-hooks-ecs"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="airflow.providers.amazon.aws.hooks.ecs"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,296 +616,340 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Cluster.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task Definition.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook" title="airflow.providers.amazon.aws.hooks.ecs.EcsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Container Service (ECS).</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskLogFetcher</span></code></a></p></td>
+<td><p>Fetches Cloudwatch log events with specific interval as a thread</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol" title="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry" title="airflow.providers.amazon.aws.hooks.ecs.should_retry"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ECS resource quota (CPU, MEM).</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni" title="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry_eni</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ENI (Elastic Network Interfaces).</p></td>
</tr>
</tbody>
</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry"><span class="viewcode-link"><span [...]
+<dd><p>Check if exception is related to ECS resource quota (CPU, MEM).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry_eni</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry_eni"><span class="viewcode-lin [...]
+<dd><p>Check if exception is related to ENI (Elastic Network Interfaces).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsClusterStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
+<p>Contains the possible State values of an ECS Cluster.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEPROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">
+<span class="sig-name descname"><span class="pre">FAILED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'FAILED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'INACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskDefinitionStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a clas [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task Definition.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'INACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provide [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">
+<span class="sig-name descname"><span class="pre">PENDING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PENDING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PENDING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">
+<span class="sig-name descname"><span class="pre">ACTIVATING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVATING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.ACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
<dd></dd></dl>
-</dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'RUNNING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
+<dd></dd></dl>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
-</ul>
-</dd>
-</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">
+<span class="sig-name descname"><span class="pre">DEACTIVATING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEACTIVATING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provide [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">
+<span class="sig-name descname"><span class="pre">STOPPING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'STOPPING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aw [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEPROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.p [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'STOPPED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">
+<span class="sig-name descname"><span class="pre">NONE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'NONE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.NONE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs. [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook</span></code></a></p>
+<p>Interact with Amazon Elastic Container Service (ECS).
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ecs")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/AmazonECS/latest/APIReference/Welcome.html">Amazon Elastic Container Service</a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">
+<span class="sig-name descname"><span class="pre">get_cluster_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_cluster_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amaz [...]
+<dd><p>Get ECS Cluster state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_clusters" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_clusters()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
+<dd class="field-odd"><p><strong>cluster_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – ECS Cluster name or full cluster Amazon Resource Name (ARN) entry.</p>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">
+<span class="sig-name descname"><span class="pre">get_task_definition_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_definition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_definition_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><p>Get ECS Task Definition state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_task_definition()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_definition</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The family for the latest ACTIVE revision,
+family and revision ( family:revision ) for a specific revision in the family,
+or full Amazon Resource Name (ARN) of the task definition to describe.</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">
+<span class="sig-name descname"><span class="pre">get_task_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_state"><span class="viewcode-link"><span class="pre">[source [...]
+<dd><p>Get ECS Task state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_tasks()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>cluster</strong> – The short name or full Amazon Resource Name (ARN)
+of the cluster that hosts the task or tasks to describe.</p></li>
+<li><p><strong>task</strong> – Task ID or full ARN entry.</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskLogFetcher</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_group</span></span></em>, <em class="sig-param"><s [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/threading.html#threading.Thread" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">threading.Thread</span></code></a></p>
+<p>Fetches Cloudwatch log events with specific interval as a thread
+and sends the log events to the info channel of the provided logger.</p>
+<dl class="field-list simple">
+</dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">
+<span class="sig-name descname"><span class="pre">run</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.run"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run" title="Permalink to this definition">¶</a></dt>
+<dd><p>Method representing the thread’s activity.</p>
+<p>You may override this method in a subclass. The standard run() method
+invokes the callable object passed to the object’s constructor as the
+target argument, if any, with sequential and keyword arguments taken
+from the args and kwargs arguments, respectively.</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">
+<span class="sig-name descname"><span class="pre">get_last_log_messages</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">number_messages</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_messages"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#a [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">
+<span class="sig-name descname"><span class="pre">get_last_log_message</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_message"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message" title="Permali [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">
+<span class="sig-name descname"><span class="pre">is_stopped</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.is_stopped"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped" title="Permalink to this definition">¶</a></dt>
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">
+<span class="sig-name descname"><span class="pre">stop</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.stop"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on
+<code class="xref py py-meth docutils literal notranslate"><span class="pre">EcsOperator.client()</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html</a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">
+<span class="sig-name descname"><span class="pre">run_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.run_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsP [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">
+<span class="sig-name descname"><span class="pre">describe_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">tasks</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_tasks"><span class="viewcode-link"><span class="pre">[s [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">
+<span class="sig-name descname"><span class="pre">stop_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">
+<span class="sig-name descname"><span class="pre">describe_task_definition</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">taskDefinition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_task_definition"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">
+<span class="sig-name descname"><span class="pre">list_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">launchType</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">desiredStatus</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">family</span></span></em><span class="sig-paren">)</span><a class="re [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
@@ -902,10 +961,10 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,67 +1034,108 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry"><code class="docutils literal notranslate"><span class="pre">should_retry()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni"><code class="docutils literal notranslate"><span class="pre">should_retry_eni()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.ACTIVE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.PROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.DEPROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.FAILED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.INACTIVE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates.ACTIVE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates.INACTIVE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.PROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.PENDING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.ACTIVATING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.RUNNING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.DEACTIVATING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.STOPPING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.DEPROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.STOPPED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.NONE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook"><code class="docutils literal notranslate"><span class="pre">EcsHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_cluster_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_task_definition_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_task_state()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.run()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.get_last_log_messages()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.get_last_log_message()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.is_stopped()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.stop()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol"><code class="docutils literal notranslate"><span class="pre">EcsProtocol</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.run_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.describe_tasks()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.stop_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.describe_task_definition()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.list_tasks()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry">should_retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">should_retry_eni</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">EcsClusterStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">EcsTaskDefinitionStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">EcsTaskStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">PENDING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">ACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">DEACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">STOPPING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">STOPPED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">NONE</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook">EcsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">get_cluster_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">get_task_definition_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">get_task_state</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">EcsTaskLogFetcher</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">run</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">get_last_log_messages</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">get_last_log_message</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">is_stopped</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">stop</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">EcsProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">run_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">describe_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">stop_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">describe_task_definition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">list_tasks</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1166,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ecs/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
similarity index 55%
copy from docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
index 76f76aaa70..57ab80c562 100644
--- a/docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.dbt.cloud.hooks.dbt — apache-airflow-providers-dbt-cloud Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.eks — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.dbt.cloud.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.dbt.cloud.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.elasticache_replication_group" href="../elasticache_replication_group/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,17 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections.html">Connecting to dbt Cloud</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-dbt-cloud/3.0.0/tests/system/providers/dbt/cloud/example_dbt_cloud.py">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-dbt-cloud/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -426,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -469,17 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections.html">Connecting to dbt Cloud</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-dbt-cloud/3.0.0/tests/system/providers/dbt/cloud/example_dbt_cloud.py">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-dbt-cloud/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -575,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks.dbt</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a></li>
</ul>
</div>
@@ -590,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.dbt.cloud.hooks.dbt">
-<span id="airflow-providers-dbt-cloud-hooks-dbt"></span><h1><a class="reference internal" href="#module-airflow.providers.dbt.cloud.hooks.dbt" title="airflow.providers.dbt.cloud.hooks.dbt"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks.dbt</span></code></a><a class="headerlink" href="#module-airflow.providers.dbt.cloud.hooks.dbt" title="Permalink to this heading">¶</a></h1>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.eks">
+<span id="airflow-providers-amazon-aws-hooks-eks"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.eks" title="airflow.providers.amazon.aws.hooks.eks"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.eks" title="Permalink to this heading">¶</a></h1>
+<p>Interact with Amazon EKS, using the boto3 library.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -602,34 +617,17 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.TokenAuth" title="airflow.providers.dbt.cloud.hooks.dbt.TokenAuth"><code class="xref py py-obj docutils literal notranslate"><span class="pre">TokenAuth</span></code></a></p></td>
-<td><p>Helper class for Auth when executing requests.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates" title="airflow.providers.amazon.aws.hooks.eks.ClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">ClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Cluster.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.JobRunInfo" title="airflow.providers.dbt.cloud.hooks.dbt.JobRunInfo"><code class="xref py py-obj docutils literal notranslate"><span class="pre">JobRunInfo</span></code></a></p></td>
-<td><p>Type class for the <code class="docutils literal notranslate"><span class="pre">job_run_info</span></code> dictionary.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates" title="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FargateProfileStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an AWS Fargate profile.</p></td>
</tr>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.DbtCloudJobRunStatus" title="airflow.providers.dbt.cloud.hooks.dbt.DbtCloudJobRunStatus"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DbtCloudJobRunStatus</span></code></a></p></td>
-<td><p>dbt Cloud Job statuses.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates" title="airflow.providers.amazon.aws.hooks.eks.NodegroupStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">NodegroupStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Managed Nodegroup.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.DbtCloudHook" title="airflow.providers.dbt.cloud.hooks.dbt.DbtCloudHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DbtCloudHook</span></code></a></p></td>
-<td><p>Interact with dbt Cloud using the V2 API.</p></td>
-</tr>
-</tbody>
-</table>
-</div>
-<div class="section" id="functions">
-<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
-<table class="autosummary longtable docutils align-default">
-<colgroup>
-<col style="width: 10%" />
-<col style="width: 90%" />
-</colgroup>
-<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.fallback_to_default_account" title="airflow.providers.dbt.cloud.hooks.dbt.fallback_to_default_account"><code class="xref py py-obj docutils literal notranslate"><span class="pre">fallback_to_default_account</span></code></a>(func)</p></td>
-<td><p>Decorator which provides a fallback value for <code class="docutils literal notranslate"><span class="pre">account_id</span></code>. If the <code class="docutils literal notranslate"><span class="pre">account_id</span></code> is None or not passed</p></td>
-</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.provide_account_id" title="airflow.providers.dbt.cloud.hooks.dbt.provide_account_id"><code class="xref py py-obj docutils literal notranslate"><span class="pre">provide_account_id</span></code></a>(func)</p></td>
-<td><p>Decorator which provides a fallback value for <code class="docutils literal notranslate"><span class="pre">account_id</span></code>. If the <code class="docutils literal notranslate"><span class="pre">account_id</span></code> is None or not passed</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook" title="airflow.providers.amazon.aws.hooks.eks.EksHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EksHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Kubernetes Service (EKS).</p></td>
</tr>
</tbody>
</table>
@@ -642,546 +640,581 @@
<col style="width: 90%" />
... 1239113 lines suppressed ...