You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by as...@apache.org on 2022/09/05 15:44:32 UTC
[airflow-site] branch docs-oob-providers-2022-09-05 created (now efa587fa2d)
This is an automated email from the ASF dual-hosted git repository.
ash pushed a change to branch docs-oob-providers-2022-09-05
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
at efa587fa2d Add documentation for out-of-band provider packages 2022-09-05
This branch includes the following new commits:
new efa587fa2d Add documentation for out-of-band provider packages 2022-09-05
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[airflow-site] 01/01: Add documentation for out-of-band provider packages 2022-09-05
Posted by as...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
ash pushed a commit to branch docs-oob-providers-2022-09-05
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit efa587fa2dab966640d7afe49daec79c0201df7e
Author: Ash Berlin-Taylor <as...@firemirror.com>
AuthorDate: Mon Sep 5 16:44:12 2022 +0100
Add documentation for out-of-band provider packages 2022-09-05
---
.../5.1.0/.buildinfo | 4 +
.../providers/amazon/aws/exceptions/index.html} | 243 +-
.../providers/amazon/aws/hooks/appflow/index.html} | 303 +-
.../providers/amazon/aws/hooks/athena/index.html} | 429 +-
.../amazon/aws/hooks/base_aws/index.html} | 902 +-
.../amazon/aws/hooks/batch_client/index.html} | 1071 +-
.../amazon/aws/hooks/batch_waiters/index.html} | 410 +-
.../amazon/aws/hooks/cloud_formation/index.html} | 272 +-
.../amazon/aws/hooks/datasync/index.html} | 741 +-
.../providers/amazon/aws/hooks/dms/index.html} | 391 +-
.../amazon/aws/hooks/dynamodb/index.html} | 252 +-
.../providers/amazon/aws/hooks/ec2/index.html} | 432 +-
.../providers/amazon/aws/hooks/ecs/index.html} | 896 +-
.../providers/amazon/aws/hooks/eks/index.html} | 925 +-
.../elasticache_replication_group/index.html} | 415 +-
.../providers/amazon/aws/hooks/emr/index.html} | 814 +-
.../providers/amazon/aws/hooks/glacier/index.html} | 273 +-
.../providers/amazon/aws/hooks/glue/index.html} | 384 +-
.../amazon/aws/hooks/glue_catalog/index.html} | 385 +-
.../amazon/aws/hooks/glue_crawler/index.html} | 358 +-
.../airflow/providers/amazon/aws/hooks/index.html} | 237 +-
.../providers/amazon/aws/hooks/kinesis/index.html} | 251 +-
.../amazon/aws/hooks/lambda_function/index.html} | 263 +-
.../providers/amazon/aws/hooks/logs/index.html} | 269 +-
.../amazon/aws/hooks/quicksight/index.html} | 318 +-
.../providers/amazon/aws/hooks/rds/index.html} | 242 +-
.../amazon/aws/hooks/redshift_cluster/index.html} | 351 +-
.../amazon/aws/hooks/redshift_data/index.html} | 243 +-
.../amazon/aws/hooks/redshift_sql/index.html} | 324 +-
.../providers/amazon/aws/hooks/s3/index.html | 1638 +++
.../amazon/aws/hooks/sagemaker/index.html | 1651 +++
.../amazon/aws/hooks/secrets_manager/index.html} | 271 +-
.../providers/amazon/aws/hooks/ses/index.html} | 275 +-
.../providers/amazon/aws/hooks/sns/index.html} | 259 +-
.../providers/amazon/aws/hooks/sqs/index.html} | 283 +-
.../amazon/aws/hooks/step_function/index.html} | 276 +-
.../providers/amazon/aws/hooks/sts/index.html} | 245 +-
.../_api/airflow/providers/amazon/aws/index.html} | 405 +-
.../amazon/aws/links/base_aws/index.html} | 317 +-
.../providers/amazon/aws/links/batch/index.html} | 312 +-
.../providers/amazon/aws/links/emr/index.html} | 250 +-
.../airflow/providers/amazon/aws/links/index.html} | 207 +-
.../providers/amazon/aws/links/logs/index.html} | 261 +-
.../aws/log/cloudwatch_task_handler/index.html} | 285 +-
.../airflow/providers/amazon/aws/log/index.html} | 205 +-
.../amazon/aws/log/s3_task_handler/index.html} | 318 +-
.../amazon/aws/operators/appflow/index.html} | 804 +-
.../amazon/aws/operators/athena/index.html} | 300 +-
.../amazon/aws/operators/aws_lambda/index.html} | 206 +-
.../amazon/aws/operators/batch/index.html} | 490 +-
.../aws/operators/cloud_formation/index.html} | 336 +-
.../amazon/aws/operators/datasync/index.html} | 378 +-
.../providers/amazon/aws/operators/dms/index.html} | 843 +-
.../providers/amazon/aws/operators/ec2/index.html} | 327 +-
.../providers/amazon/aws/operators/ecs/index.html} | 1016 +-
.../providers/amazon/aws/operators/eks/index.html | 1451 +++
.../providers/amazon/aws/operators/emr/index.html | 1451 +++
.../amazon/aws/operators/glacier/index.html} | 264 +-
.../amazon/aws/operators/glue/index.html} | 291 +-
.../amazon/aws/operators/glue_crawler/index.html} | 278 +-
.../providers/amazon/aws/operators/index.html} | 228 +-
.../aws/operators/lambda_function/index.html} | 279 +-
.../amazon/aws/operators/quicksight/index.html} | 297 +-
.../providers/amazon/aws/operators/rds/index.html} | 995 +-
.../aws/operators/redshift_cluster/index.html} | 1013 +-
.../amazon/aws/operators/redshift_data/index.html} | 314 +-
.../amazon/aws/operators/redshift_sql/index.html} | 284 +-
.../providers/amazon/aws/operators/s3/index.html | 1630 +++
.../amazon/aws/operators/sagemaker/index.html | 1488 +++
.../providers/amazon/aws/operators/sns/index.html} | 275 +-
.../providers/amazon/aws/operators/sqs/index.html} | 285 +-
.../amazon/aws/operators/step_function/index.html} | 326 +-
.../providers/amazon/aws/secrets/index.html} | 205 +-
.../amazon/aws/secrets/secrets_manager/index.html} | 376 +-
.../amazon/aws/secrets/systems_manager/index.html} | 334 +-
.../amazon/aws/sensors/athena/index.html} | 307 +-
.../providers/amazon/aws/sensors/batch/index.html} | 406 +-
.../amazon/aws/sensors/cloud_formation/index.html} | 330 +-
.../providers/amazon/aws/sensors/dms/index.html} | 307 +-
.../providers/amazon/aws/sensors/ec2/index.html} | 277 +-
.../providers/amazon/aws/sensors/ecs/index.html} | 399 +-
.../providers/amazon/aws/sensors/eks/index.html} | 776 +-
.../providers/amazon/aws/sensors/emr/index.html} | 1092 +-
.../amazon/aws/sensors/glacier/index.html} | 297 +-
.../providers/amazon/aws/sensors/glue/index.html} | 259 +-
.../aws/sensors/glue_catalog_partition/index.html} | 281 +-
.../amazon/aws/sensors/glue_crawler/index.html} | 267 +-
.../providers/amazon/aws/sensors/index.html} | 222 +-
.../amazon/aws/sensors/quicksight/index.html} | 282 +-
.../providers/amazon/aws/sensors/rds/index.html} | 296 +-
.../aws/sensors/redshift_cluster/index.html} | 266 +-
.../providers/amazon/aws/sensors/s3/index.html} | 394 +-
.../amazon/aws/sensors/sagemaker/index.html} | 1023 +-
.../providers/amazon/aws/sensors/sqs/index.html} | 332 +-
.../amazon/aws/sensors/step_function/index.html} | 300 +-
.../aws/transfers/dynamodb_to_s3/index.html} | 280 +-
.../amazon/aws/transfers/exasol_to_s3/index.html} | 287 +-
.../amazon/aws/transfers/ftp_to_s3/index.html} | 280 +-
.../amazon/aws/transfers/gcs_to_s3/index.html} | 312 +-
.../aws/transfers/glacier_to_gcs/index.html} | 278 +-
.../aws/transfers/google_api_to_s3/index.html} | 315 +-
.../aws/transfers/hive_to_dynamodb/index.html} | 288 +-
.../transfers/imap_attachment_to_s3/index.html} | 268 +-
.../providers/amazon/aws/transfers/index.html} | 220 +-
.../amazon/aws/transfers/local_to_s3/index.html} | 288 +-
.../amazon/aws/transfers/mongo_to_s3/index.html} | 296 +-
.../aws/transfers/redshift_to_s3/index.html} | 317 +-
.../amazon/aws/transfers/s3_to_ftp/index.html} | 265 +-
.../aws/transfers/s3_to_redshift/index.html} | 318 +-
.../amazon/aws/transfers/s3_to_sftp/index.html} | 274 +-
.../aws/transfers/salesforce_to_s3/index.html} | 289 +-
.../amazon/aws/transfers/sftp_to_s3/index.html} | 284 +-
.../amazon/aws/transfers/sql_to_s3/index.html} | 354 +-
.../aws/utils/connection_wrapper/index.html} | 484 +-
.../amazon/aws/utils/eks_get_token/index.html} | 265 +-
.../providers/amazon/aws/utils/emailer/index.html} | 232 +-
.../airflow/providers/amazon/aws/utils/index.html} | 282 +-
.../providers/amazon/aws/utils/rds/index.html} | 244 +-
.../amazon/aws/utils/redshift/index.html} | 261 +-
.../_api/airflow/providers/amazon}/index.html | 373 +-
.../amazon/aws/example_athena/index.html} | 310 +-
.../providers/amazon/aws/example_batch/index.html} | 362 +-
.../amazon/aws/example_cloudformation/index.html} | 235 +-
.../amazon/aws/example_datasync/index.html} | 359 +-
.../amazon/aws/example_ecs_fargate/index.html} | 502 +-
.../amazon/aws/example_emr_serverless/index.html} | 235 +-
.../providers/amazon/aws/example_glue/index.html} | 346 +-
.../amazon/aws/example_lambda/index.html} | 346 +-
.../amazon/aws/example_local_to_s3/index.html} | 305 +-
.../amazon/aws/example_quicksight/index.html} | 359 +-
.../amazon/aws/example_rds_event/index.html} | 313 +-
.../amazon/aws/example_rds_export/index.html} | 314 +-
.../amazon/aws/example_rds_snapshot/index.html} | 291 +-
.../aws/example_redshift_cluster/index.html} | 241 +-
.../example_redshift_data_execute_sql/index.html} | 326 +-
.../amazon/aws/example_redshift_sql/index.html} | 229 +-
.../amazon/aws/example_redshift_to_s3/index.html} | 247 +-
.../amazon/aws/example_sagemaker/index.html} | 545 +-
.../aws/example_sagemaker_endpoint/index.html} | 350 +-
.../providers/amazon/aws/example_sns/index.html} | 291 +-
.../providers/amazon/aws/example_sqs/index.html} | 289 +-
.../amazon/aws/example_step_functions/index.html} | 299 +-
.../tests/system/providers/amazon/aws}/index.html | 288 +-
.../aws/rds/example_rds_instance/index.html} | 249 +-
.../system/providers/amazon/aws/rds/index.html} | 204 +-
.../system/providers/amazon/aws/utils/index.html} | 806 +-
.../_api/tests/system/providers/amazon}/index.html | 279 +-
.../5.1.0/_images/aws-secrets-manager.png | Bin 0 -> 28060 bytes
.../_images/aws-web-identity-federation-gcp.png | Bin 0 -> 40170 bytes
.../airflow/providers/amazon/aws/exceptions.html} | 269 +-
.../providers/amazon/aws/hooks/appflow.html} | 371 +-
.../providers/amazon/aws/hooks/athena.html} | 716 +-
.../providers/amazon/aws/hooks/base_aws.html | 1503 +++
.../providers/amazon/aws/hooks/batch_client.html} | 1134 +-
.../providers/amazon/aws/hooks/batch_waiters.html} | 623 +-
.../amazon/aws/hooks/cloud_formation.html} | 302 +-
.../providers/amazon/aws/hooks/datasync.html} | 780 +-
.../airflow/providers/amazon/aws/hooks/dms.html} | 425 +-
.../providers/amazon/aws/hooks/dynamodb.html} | 285 +-
.../airflow/providers/amazon/aws/hooks/ec2.html} | 475 +-
.../airflow/providers/amazon/aws/hooks/ecs.html} | 682 +-
.../airflow/providers/amazon/aws/hooks/eks.html | 1427 +++
.../aws/hooks/elasticache_replication_group.html} | 567 +-
.../airflow/providers/amazon/aws/hooks/emr.html} | 1014 +-
.../providers/amazon/aws/hooks/glacier.html} | 293 +-
.../airflow/providers/amazon/aws/hooks/glue.html} | 821 +-
.../providers/amazon/aws/hooks/glue_catalog.html} | 574 +-
.../providers/amazon/aws/hooks/glue_crawler.html} | 384 +-
.../providers/amazon/aws/hooks/kinesis.html} | 271 +-
.../amazon/aws/hooks/lambda_function.html} | 516 +-
.../airflow/providers/amazon/aws/hooks/logs.html} | 330 +-
.../providers/amazon/aws/hooks/quicksight.html} | 372 +-
.../airflow/providers/amazon/aws/hooks/rds.html} | 275 +-
.../amazon/aws/hooks/redshift_cluster.html} | 399 +-
.../providers/amazon/aws/hooks/redshift_data.html} | 273 +-
.../providers/amazon/aws/hooks/redshift_sql.html} | 354 +-
.../airflow/providers/amazon/aws/hooks/s3.html | 1812 +++
.../providers/amazon/aws/hooks/sagemaker.html | 1778 +++
.../amazon/aws/hooks/secrets_manager.html} | 293 +-
.../airflow/providers/amazon/aws/hooks/ses.html} | 379 +-
.../airflow/providers/amazon/aws/hooks/sns.html} | 317 +-
.../airflow/providers/amazon/aws/hooks/sqs.html} | 312 +-
.../providers/amazon/aws/hooks/step_function.html} | 304 +-
.../airflow/providers/amazon/aws/hooks/sts.html} | 266 +-
.../providers/amazon/aws/links/base_aws.html} | 333 +-
.../airflow/providers/amazon/aws/links/batch.html} | 270 +-
.../airflow/providers/amazon/aws/links/emr.html} | 254 +-
.../airflow/providers/amazon/aws/links/logs.html} | 267 +-
.../amazon/aws/log/cloudwatch_task_handler.html} | 352 +-
.../providers/amazon/aws/log/s3_task_handler.html} | 424 +-
.../providers/amazon/aws/operators/appflow.html} | 948 +-
.../providers/amazon/aws/operators/athena.html} | 527 +-
.../providers/amazon/aws/operators/batch.html} | 996 +-
.../amazon/aws/operators/cloud_formation.html} | 323 +-
.../providers/amazon/aws/operators/datasync.html} | 703 +-
.../providers/amazon/aws/operators/dms.html} | 589 +-
.../providers/amazon/aws/operators/ec2.html} | 344 +-
.../providers/amazon/aws/operators/ecs.html | 1472 +++
.../providers/amazon/aws/operators/eks.html | 1507 +++
.../providers/amazon/aws/operators/emr.html | 1542 +++
.../providers/amazon/aws/operators/glacier.html} | 280 +-
.../providers/amazon/aws/operators/glue.html} | 550 +-
.../amazon/aws/operators/glue_crawler.html} | 310 +-
.../amazon/aws/operators/lambda_function.html} | 328 +-
.../amazon/aws/operators/quicksight.html} | 324 +-
.../providers/amazon/aws/operators/rds.html | 1494 +++
.../amazon/aws/operators/redshift_cluster.html | 1314 +++
.../amazon/aws/operators/redshift_data.html} | 399 +-
.../amazon/aws/operators/redshift_sql.html} | 304 +-
.../airflow/providers/amazon/aws/operators/s3.html | 1573 +++
.../providers/amazon/aws/operators/sagemaker.html | 1553 +++
.../providers/amazon/aws/operators/sns.html} | 315 +-
.../providers/amazon/aws/operators/sqs.html} | 322 +-
.../amazon/aws/operators/step_function.html} | 342 +-
.../amazon/aws/secrets/secrets_manager.html} | 1135 +-
.../amazon/aws/secrets/systems_manager.html} | 577 +-
.../providers/amazon/aws/sensors/athena.html} | 315 +-
.../providers/amazon/aws/sensors/batch.html} | 598 +-
.../amazon/aws/sensors/cloud_formation.html} | 333 +-
.../airflow/providers/amazon/aws/sensors/dms.html} | 347 +-
.../airflow/providers/amazon/aws/sensors/ec2.html} | 295 +-
.../airflow/providers/amazon/aws/sensors/ecs.html} | 584 +-
.../airflow/providers/amazon/aws/sensors/eks.html} | 652 +-
.../airflow/providers/amazon/aws/sensors/emr.html} | 1088 +-
.../providers/amazon/aws/sensors/glacier.html} | 323 +-
.../providers/amazon/aws/sensors/glue.html} | 312 +-
.../aws/sensors/glue_catalog_partition.html} | 316 +-
.../amazon/aws/sensors/glue_crawler.html} | 298 +-
.../providers/amazon/aws/sensors/quicksight.html} | 319 +-
.../airflow/providers/amazon/aws/sensors/rds.html} | 381 +-
.../amazon/aws/sensors/redshift_cluster.html} | 290 +-
.../airflow/providers/amazon/aws/sensors/s3.html} | 740 +-
.../providers/amazon/aws/sensors/sagemaker.html} | 884 +-
.../airflow/providers/amazon/aws/sensors/sqs.html} | 621 +-
.../amazon/aws/sensors/step_function.html} | 325 +-
.../amazon/aws/transfers/dynamodb_to_s3.html} | 380 +-
.../amazon/aws/transfers/exasol_to_s3.html} | 335 +-
.../providers/amazon/aws/transfers/ftp_to_s3.html} | 376 +-
.../providers/amazon/aws/transfers/gcs_to_s3.html} | 426 +-
.../amazon/aws/transfers/glacier_to_gcs.html} | 509 +-
.../amazon/aws/transfers/google_api_to_s3.html} | 410 +-
.../amazon/aws/transfers/hive_to_dynamodb.html} | 336 +-
.../aws/transfers/imap_attachment_to_s3.html} | 339 +-
.../amazon/aws/transfers/local_to_s3.html} | 332 +-
.../amazon/aws/transfers/mongo_to_s3.html} | 381 +-
.../amazon/aws/transfers/redshift_to_s3.html} | 383 +-
.../providers/amazon/aws/transfers/s3_to_ftp.html} | 305 +-
.../amazon/aws/transfers/s3_to_redshift.html} | 439 +-
.../amazon/aws/transfers/s3_to_sftp.html} | 320 +-
.../amazon/aws/transfers/salesforce_to_s3.html} | 358 +-
.../amazon/aws/transfers/sftp_to_s3.html} | 320 +-
.../providers/amazon/aws/transfers/sql_to_s3.html} | 576 +-
.../airflow/providers/amazon/aws/utils.html} | 268 +-
.../amazon/aws/utils/connection_wrapper.html | 1251 +++
.../providers/amazon/aws/utils/eks_get_token.html} | 298 +-
.../providers/amazon/aws/utils/emailer.html} | 281 +-
.../airflow/providers/amazon/aws/utils/rds.html} | 253 +-
.../providers/amazon/aws/utils/redshift.html} | 277 +-
.../5.1.0/_modules}/index.html | 367 +-
.../providers/amazon/aws/example_athena.html} | 411 +-
.../providers/amazon/aws/example_batch.html} | 549 +-
.../amazon/aws/example_cloudformation.html} | 342 +-
.../providers/amazon/aws/example_datasync.html} | 702 +-
.../providers/amazon/aws/example_ecs_fargate.html} | 370 +-
.../amazon/aws/example_emr_serverless.html} | 366 +-
.../system/providers/amazon/aws/example_glue.html} | 610 +-
.../providers/amazon/aws/example_lambda.html} | 530 +-
.../providers/amazon/aws/example_local_to_s3.html} | 327 +-
.../providers/amazon/aws/example_quicksight.html} | 452 +-
.../providers/amazon/aws/example_rds_event.html} | 360 +-
.../providers/amazon/aws/example_rds_export.html} | 422 +-
.../amazon/aws/example_rds_snapshot.html} | 381 +-
.../amazon/aws/example_redshift_cluster.html} | 366 +-
.../aws/example_redshift_data_execute_sql.html} | 311 +-
.../amazon/aws/example_redshift_sql.html} | 323 +-
.../amazon/aws/example_redshift_to_s3.html} | 278 +-
.../providers/amazon/aws/example_sagemaker.html} | 1184 +-
.../amazon/aws/example_sagemaker_endpoint.html} | 753 +-
.../system/providers/amazon/aws/example_sns.html} | 311 +-
.../system/providers/amazon/aws/example_sqs.html} | 336 +-
.../amazon/aws/example_step_functions.html} | 347 +-
.../amazon/aws/rds/example_rds_instance.html} | 300 +-
.../tests/system/providers/amazon/aws/utils.html} | 602 +-
.../providers/amazon/aws/exceptions/index.rst.txt | 33 +
.../amazon/aws/hooks/appflow/index.rst.txt | 73 +
.../amazon/aws/hooks/athena/index.rst.txt | 142 +
.../amazon/aws/hooks/base_aws/index.rst.txt | 281 +
.../amazon/aws/hooks/batch_client/index.rst.txt | 418 +
.../amazon/aws/hooks/batch_waiters/index.rst.txt | 182 +
.../amazon/aws/hooks/cloud_formation/index.rst.txt | 58 +
.../amazon/aws/hooks/datasync/index.rst.txt | 182 +
.../providers/amazon/aws/hooks/dms/index.rst.txt | 124 +
.../amazon/aws/hooks/dynamodb/index.rst.txt | 45 +
.../providers/amazon/aws/hooks/ec2/index.rst.txt | 129 +
.../providers/amazon/aws/hooks/ecs/index.rst.txt | 247 +
.../providers/amazon/aws/hooks/eks/index.rst.txt | 374 +
.../elasticache_replication_group/index.rst.txt | 129 +
.../providers/amazon/aws/hooks/emr/index.rst.txt | 203 +
.../amazon/aws/hooks/glacier/index.rst.txt | 50 +
.../providers/amazon/aws/hooks/glue/index.rst.txt | 121 +
.../amazon/aws/hooks/glue_catalog/index.rst.txt | 129 +
.../amazon/aws/hooks/glue_crawler/index.rst.txt | 88 +
.../providers/amazon/aws/hooks/index.rst.txt | 48 +
.../amazon/aws/hooks/kinesis/index.rst.txt | 44 +
.../amazon/aws/hooks/lambda_function/index.rst.txt | 52 +
.../providers/amazon/aws/hooks/logs/index.rst.txt | 57 +
.../amazon/aws/hooks/quicksight/index.rst.txt | 83 +
.../providers/amazon/aws/hooks/rds/index.rst.txt | 45 +
.../aws/hooks/redshift_cluster/index.rst.txt | 101 +
.../amazon/aws/hooks/redshift_data/index.rst.txt | 39 +
.../amazon/aws/hooks/redshift_sql/index.rst.txt | 92 +
.../providers/amazon/aws/hooks/s3/index.rst.txt | 480 +
.../amazon/aws/hooks/sagemaker/index.rst.txt | 472 +
.../amazon/aws/hooks/secrets_manager/index.rst.txt | 51 +
.../providers/amazon/aws/hooks/ses/index.rst.txt | 59 +
.../providers/amazon/aws/hooks/sns/index.rst.txt | 55 +
.../providers/amazon/aws/hooks/sqs/index.rst.txt | 67 +
.../amazon/aws/hooks/step_function/index.rst.txt | 54 +
.../providers/amazon/aws/hooks/sts/index.rst.txt | 36 +
.../airflow/providers/amazon/aws/index.rst.txt | 31 +
.../amazon/aws/links/base_aws/index.rst.txt | 82 +
.../providers/amazon/aws/links/batch/index.rst.txt | 87 +
.../providers/amazon/aws/links/emr/index.rst.txt | 41 +
.../providers/amazon/aws/links/index.rst.txt | 18 +
.../providers/amazon/aws/links/logs/index.rst.txt | 49 +
.../aws/log/cloudwatch_task_handler/index.rst.txt | 58 +
.../airflow/providers/amazon/aws/log/index.rst.txt | 16 +
.../amazon/aws/log/s3_task_handler/index.rst.txt | 76 +
.../amazon/aws/operators/appflow/index.rst.txt | 217 +
.../amazon/aws/operators/athena/index.rst.txt | 76 +
.../amazon/aws/operators/aws_lambda/index.rst.txt | 11 +
.../amazon/aws/operators/batch/index.rst.txt | 201 +
.../aws/operators/cloud_formation/index.rst.txt | 108 +
.../amazon/aws/operators/datasync/index.rst.txt | 143 +
.../amazon/aws/operators/dms/index.rst.txt | 233 +
.../amazon/aws/operators/ec2/index.rst.txt | 100 +
.../amazon/aws/operators/ecs/index.rst.txt | 283 +
.../amazon/aws/operators/eks/index.rst.txt | 437 +
.../amazon/aws/operators/emr/index.rst.txt | 422 +
.../amazon/aws/operators/glacier/index.rst.txt | 46 +
.../amazon/aws/operators/glue/index.rst.txt | 74 +
.../aws/operators/glue_crawler/index.rst.txt | 59 +
.../providers/amazon/aws/operators/index.rst.txt | 39 +
.../aws/operators/lambda_function/index.rst.txt | 59 +
.../amazon/aws/operators/quicksight/index.rst.txt | 78 +
.../amazon/aws/operators/rds/index.rst.txt | 273 +
.../aws/operators/redshift_cluster/index.rst.txt | 290 +
.../aws/operators/redshift_data/index.rst.txt | 82 +
.../aws/operators/redshift_sql/index.rst.txt | 65 +
.../amazon/aws/operators/s3/index.rst.txt | 566 +
.../amazon/aws/operators/sagemaker/index.rst.txt | 446 +
.../amazon/aws/operators/sns/index.rst.txt | 65 +
.../amazon/aws/operators/sqs/index.rst.txt | 69 +
.../aws/operators/step_function/index.rst.txt | 101 +
.../providers/amazon/aws/secrets/index.rst.txt | 16 +
.../aws/secrets/secrets_manager/index.rst.txt | 149 +
.../aws/secrets/systems_manager/index.rst.txt | 102 +
.../amazon/aws/sensors/athena/index.rst.txt | 80 +
.../amazon/aws/sensors/batch/index.rst.txt | 154 +
.../aws/sensors/cloud_formation/index.rst.txt | 99 +
.../providers/amazon/aws/sensors/dms/index.rst.txt | 80 +
.../providers/amazon/aws/sensors/ec2/index.rst.txt | 61 +
.../providers/amazon/aws/sensors/ecs/index.rst.txt | 137 +
.../providers/amazon/aws/sensors/eks/index.rst.txt | 191 +
.../providers/amazon/aws/sensors/emr/index.rst.txt | 393 +
.../amazon/aws/sensors/glacier/index.rst.txt | 77 +
.../amazon/aws/sensors/glue/index.rst.txt | 46 +
.../sensors/glue_catalog_partition/index.rst.txt | 62 +
.../amazon/aws/sensors/glue_crawler/index.rst.txt | 50 +
.../providers/amazon/aws/sensors/index.rst.txt | 33 +
.../amazon/aws/sensors/quicksight/index.rst.txt | 58 +
.../providers/amazon/aws/sensors/rds/index.rst.txt | 71 +
.../aws/sensors/redshift_cluster/index.rst.txt | 49 +
.../providers/amazon/aws/sensors/s3/index.rst.txt | 140 +
.../amazon/aws/sensors/sagemaker/index.rst.txt | 280 +
.../providers/amazon/aws/sensors/sqs/index.rst.txt | 99 +
.../amazon/aws/sensors/step_function/index.rst.txt | 79 +
.../aws/transfers/dynamodb_to_s3/index.rst.txt | 72 +
.../aws/transfers/exasol_to_s3/index.rst.txt | 75 +
.../amazon/aws/transfers/ftp_to_s3/index.rst.txt | 68 +
.../amazon/aws/transfers/gcs_to_s3/index.rst.txt | 98 +
.../aws/transfers/glacier_to_gcs/index.rst.txt | 67 +
.../aws/transfers/google_api_to_s3/index.rst.txt | 102 +
.../aws/transfers/hive_to_dynamodb/index.rst.txt | 77 +
.../transfers/imap_attachment_to_s3/index.rst.txt | 58 +
.../providers/amazon/aws/transfers/index.rst.txt | 31 +
.../amazon/aws/transfers/local_to_s3/index.rst.txt | 72 +
.../amazon/aws/transfers/mongo_to_s3/index.rst.txt | 80 +
.../aws/transfers/redshift_to_s3/index.rst.txt | 94 +
.../amazon/aws/transfers/s3_to_ftp/index.rst.txt | 53 +
.../aws/transfers/s3_to_redshift/index.rst.txt | 90 +
.../amazon/aws/transfers/s3_to_sftp/index.rst.txt | 59 +
.../aws/transfers/salesforce_to_s3/index.rst.txt | 75 +
.../amazon/aws/transfers/sftp_to_s3/index.rst.txt | 63 +
.../amazon/aws/transfers/sql_to_s3/index.rst.txt | 115 +
.../aws/utils/connection_wrapper/index.rst.txt | 162 +
.../amazon/aws/utils/eks_get_token/index.rst.txt | 43 +
.../amazon/aws/utils/emailer/index.rst.txt | 29 +
.../providers/amazon/aws/utils/index.rst.txt | 57 +
.../providers/amazon/aws/utils/rds/index.rst.txt | 36 +
.../amazon/aws/utils/redshift/index.rst.txt | 42 +
.../_api/airflow/providers/amazon/index.rst.txt | 15 +
.../amazon/aws/example_athena/index.rst.txt | 85 +
.../amazon/aws/example_batch/index.rst.txt | 101 +
.../aws/example_cloudformation/index.rst.txt | 34 +
.../amazon/aws/example_datasync/index.rst.txt | 91 +
.../amazon/aws/example_ecs_fargate/index.rst.txt | 85 +
.../aws/example_emr_serverless/index.rst.txt | 34 +
.../amazon/aws/example_glue/index.rst.txt | 121 +
.../amazon/aws/example_lambda/index.rst.txt | 97 +
.../amazon/aws/example_local_to_s3/index.rst.txt | 69 +
.../amazon/aws/example_quicksight/index.rst.txt | 102 +
.../amazon/aws/example_rds_event/index.rst.txt | 65 +
.../amazon/aws/example_rds_export/index.rst.txt | 73 +
.../amazon/aws/example_rds_snapshot/index.rst.txt | 57 +
.../aws/example_redshift_cluster/index.rst.txt | 39 +
.../index.rst.txt | 104 +
.../amazon/aws/example_redshift_sql/index.rst.txt | 29 +
.../aws/example_redshift_to_s3/index.rst.txt | 44 +
.../amazon/aws/example_sagemaker/index.rst.txt | 157 +
.../aws/example_sagemaker_endpoint/index.rst.txt | 110 +
.../providers/amazon/aws/example_sns/index.rst.txt | 57 +
.../providers/amazon/aws/example_sqs/index.rst.txt | 57 +
.../aws/example_step_functions/index.rst.txt | 69 +
.../system/providers/amazon/aws/index.rst.txt | 46 +
.../aws/rds/example_rds_instance/index.rst.txt | 44 +
.../system/providers/amazon/aws/rds/index.rst.txt | 15 +
.../providers/amazon/aws/utils/index.rst.txt | 184 +
.../tests/system/providers/amazon/index.rst.txt | 15 +
.../5.1.0/_sources/commits.rst.txt | 905 ++
.../5.1.0/_sources/connections/aws.rst.txt | 653 ++
.../5.1.0/_sources/connections/index.rst.txt | 28 +
.../5.1.0/_sources/connections/redshift.rst.txt | 91 +
.../5.1.0/_sources/example-dags.rst.txt | 24 +
.../5.1.0/_sources/index.rst.txt | 140 +
.../installing-providers-from-sources.rst.txt | 18 +
.../logging/cloud-watch-task-handlers.rst.txt | 38 +
.../5.1.0/_sources/logging/index.rst.txt | 25 +
.../5.1.0/_sources/logging/s3-task-handler.rst.txt | 49 +
.../5.1.0/_sources/operators/appflow.rst.txt | 146 +
.../5.1.0/_sources/operators/athena.rst.txt | 75 +
.../5.1.0/_sources/operators/batch.rst.txt | 111 +
.../_sources/operators/cloudformation.rst.txt | 99 +
.../5.1.0/_sources/operators/datasync.rst.txt | 114 +
.../5.1.0/_sources/operators/dms.rst.txt | 133 +
.../5.1.0/_sources/operators/ec2.rst.txt | 81 +
.../5.1.0/_sources/operators/ecs.rst.txt | 262 +
.../5.1.0/_sources/operators/eks.rst.txt | 247 +
.../5.1.0/_sources/operators/emr.rst.txt | 163 +
.../5.1.0/_sources/operators/emr_eks.rst.txt | 123 +
.../_sources/operators/emr_serverless.rst.txt | 113 +
.../5.1.0/_sources/operators/glacier.rst.txt | 69 +
.../5.1.0/_sources/operators/glue.rst.txt | 107 +
.../5.1.0/_sources/operators/index.rst.txt | 29 +
.../5.1.0/_sources/operators/lambda.rst.txt | 54 +
.../5.1.0/_sources/operators/quicksight.rst.txt | 69 +
.../5.1.0/_sources/operators/rds.rst.txt | 206 +
.../_sources/operators/redshift_cluster.rst.txt | 139 +
.../5.1.0/_sources/operators/redshift_data.rst.txt | 55 +
.../5.1.0/_sources/operators/redshift_sql.rst.txt | 64 +
.../5.1.0/_sources/operators/s3.rst.txt | 271 +
.../5.1.0/_sources/operators/sagemaker.rst.txt | 212 +
.../5.1.0/_sources/operators/sns.rst.txt | 55 +
.../5.1.0/_sources/operators/sqs.rst.txt | 74 +
.../_sources/operators/step_functions.rst.txt | 82 +
.../operators/transfer/dynamodb_to_s3.rst.txt | 70 +
.../_sources/operators/transfer/ftp_to_s3.rst.txt | 53 +
.../_sources/operators/transfer/gcs_to_s3.rst.txt | 52 +
.../operators/transfer/glacier_to_gcs.rst.txt | 55 +
.../operators/transfer/google_api_to_s3.rst.txt | 81 +
.../operators/transfer/hive_to_dynamodb.rst.txt | 57 +
.../transfer/imap_attachment_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/index.rst.txt | 28 +
.../operators/transfer/local_to_s3.rst.txt | 54 +
.../operators/transfer/mongo_to_s3.rst.txt | 59 +
.../operators/transfer/redshift_to_s3.rst.txt | 59 +
.../_sources/operators/transfer/s3_to_ftp.rst.txt | 54 +
.../operators/transfer/s3_to_redshift.rst.txt | 59 +
.../_sources/operators/transfer/s3_to_sftp.rst.txt | 55 +
.../operators/transfer/salesforce_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/sftp_to_s3.rst.txt | 54 +
.../_sources/operators/transfer/sql_to_s3.rst.txt | 56 +
.../secrets-backends/aws-secrets-manager.rst.txt | 151 +
.../aws-ssm-parameter-store.rst.txt | 90 +
.../5.1.0/_sources/secrets-backends/index.rst.txt | 27 +
.../5.1.0/_static/_gen/css/main-custom.min.css | 1 +
.../5.1.0/_static/_gen/css/main.min.css | 7 +
.../5.1.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.1.0/_static/basic.css | 899 ++
.../5.1.0/_static/check-solid.svg | 4 +
.../5.1.0/_static/clipboard.min.js | 7 +
.../5.1.0/_static/copy-button.svg | 5 +
.../5.1.0/_static/copybutton.css | 93 +
.../5.1.0/_static/copybutton.js | 220 +
.../5.1.0/_static/copybutton_funcs.js | 58 +
.../5.1.0/_static/doctools.js | 264 +
.../5.1.0/_static/documentation_options.js | 14 +
.../5.1.0/_static/file.png | Bin 0 -> 286 bytes
.../5.1.0/_static/graphviz.css | 19 +
.../5.1.0/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../5.1.0/_static/jquery.js | 2 +
.../5.1.0/_static/language_data.js | 199 +
.../5.1.0/_static/minus.png | Bin 0 -> 90 bytes
.../5.1.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.1.0/_static/plus.png | Bin 0 -> 90 bytes
.../5.1.0/_static/pygments.css | 74 +
.../5.1.0/_static/searchtools.js | 530 +
.../5.1.0/_static/underscore-1.13.1.js | 2042 ++++
.../5.1.0/_static/underscore.js | 6 +
.../5.1.0/commits.html | 3930 +++++++
.../5.1.0/connections/aws.html} | 1102 +-
.../5.1.0/connections/index.html} | 159 +-
.../5.1.0/connections/redshift.html} | 207 +-
.../5.1.0/example-dags.html} | 200 +-
.../5.1.0/genindex.html | 5461 ++++++++++
.../5.1.0/index.html | 1755 +++
.../5.1.0/installing-providers-from-sources.html} | 316 +-
.../5.1.0/logging/cloud-watch-task-handlers.html} | 168 +-
.../5.1.0/logging/index.html} | 159 +-
.../5.1.0/logging/s3-task-handler.html} | 174 +-
.../5.1.0/objects.inv | Bin 0 -> 19013 bytes
.../5.1.0/operators/appflow.html} | 309 +-
.../5.1.0/operators/athena.html} | 219 +-
.../5.1.0/operators/batch.html} | 271 +-
.../5.1.0/operators/cloudformation.html} | 247 +-
.../5.1.0/operators/datasync.html} | 286 +-
.../5.1.0/operators/dms.html} | 292 +-
.../5.1.0/operators/ec2.html} | 227 +-
.../5.1.0/operators/ecs.html} | 528 +-
.../5.1.0/operators/eks.html} | 754 +-
.../5.1.0/operators/emr.html} | 343 +-
.../5.1.0/operators/emr_eks.html} | 289 +-
.../5.1.0/operators/emr_serverless.html} | 266 +-
.../5.1.0/operators/glacier.html} | 211 +-
.../5.1.0/operators/glue.html} | 265 +-
.../5.1.0/operators/google_api_to_s3_transfer.html | 1 +
.../5.1.0/operators/imap_attachment_to_s3.html | 1 +
.../5.1.0/operators/index.html} | 183 +-
.../5.1.0/operators/lambda.html} | 194 +-
.../5.1.0/operators/quicksight.html} | 217 +-
.../5.1.0/operators/rds.html} | 387 +-
.../5.1.0/operators/redshift_cluster.html} | 300 +-
.../5.1.0/operators/redshift_data.html} | 203 +-
.../5.1.0/operators/redshift_sql.html} | 205 +-
.../5.1.0/operators/s3.html} | 526 +-
.../5.1.0/operators/s3_to_redshift.html | 1 +
.../5.1.0/operators/sagemaker.html} | 385 +-
.../5.1.0/operators/salesforce_to_s3.html | 1 +
.../5.1.0/operators/sns.html} | 196 +-
.../5.1.0/operators/sqs.html} | 233 +-
.../5.1.0/operators/sqs_publish.html | 1 +
.../5.1.0/operators/step_functions.html} | 224 +-
.../5.1.0/operators/transfer/dynamodb_to_s3.html} | 276 +-
.../5.1.0/operators/transfer/ftp_to_s3.html} | 238 +-
.../5.1.0/operators/transfer/gcs_to_s3.html} | 237 +-
.../5.1.0/operators/transfer/glacier_to_gcs.html} | 247 +-
.../operators/transfer/google_api_to_s3.html} | 295 +-
.../operators/transfer/hive_to_dynamodb.html} | 242 +-
.../operators/transfer/imap_attachment_to_s3.html} | 239 +-
.../5.1.0/operators/transfer/index.html} | 215 +-
.../5.1.0/operators/transfer/local_to_s3.html} | 239 +-
.../5.1.0/operators/transfer/mongo_to_s3.html} | 247 +-
.../5.1.0/operators/transfer/redshift_to_s3.html} | 243 +-
.../5.1.0/operators/transfer/s3_to_ftp.html} | 238 +-
.../5.1.0/operators/transfer/s3_to_redshift.html} | 244 +-
.../5.1.0/operators/transfer/s3_to_sftp.html} | 239 +-
.../operators/transfer/salesforce_to_s3.html} | 239 +-
.../5.1.0/operators/transfer/sftp_to_s3.html} | 238 +-
.../5.1.0/operators/transfer/sql_to_s3.html} | 242 +-
.../5.1.0/py-modindex.html} | 1113 +-
.../5.1.0/search.html} | 244 +-
.../5.1.0/searchindex.js | 1 +
.../secrets-backends/aws-secrets-manager.html} | 252 +-
.../secrets-backends/aws-ssm-parameter-store.html} | 200 +-
.../5.1.0/secrets-backends/index.html} | 157 +-
.../apache-airflow-providers-amazon/stable.txt | 2 +-
.../1.2.0/.buildinfo | 4 +
.../airflow/providers/common/sql/hooks/index.html} | 198 +-
.../providers/common/sql/hooks/sql/index.html} | 787 +-
.../_api/airflow/providers/common/sql/index.html} | 205 +-
.../providers/common/sql/operators/index.html} | 198 +-
.../providers/common/sql/operators/sql/index.html} | 1158 +-
.../providers/common/sql/sensors/index.html} | 198 +-
.../providers/common/sql/sensors/sql/index.html} | 275 +-
.../sql/example_sql_column_table_check/index.html} | 223 +-
.../tests/system/providers/common/sql/index.html} | 198 +-
.../airflow/providers/common/sql/hooks/sql.html} | 757 +-
.../providers/common/sql/operators/sql.html | 1745 +++
.../airflow/providers/common/sql/sensors/sql.html} | 340 +-
.../1.2.0/_modules/index.html} | 180 +-
.../sql/example_sql_column_table_check.html} | 311 +-
.../providers/common/sql/hooks/index.rst.txt | 15 +
.../providers/common/sql/hooks/sql/index.rst.txt | 248 +
.../airflow/providers/common/sql/index.rst.txt | 17 +
.../providers/common/sql/operators/index.rst.txt | 15 +
.../common/sql/operators/sql/index.rst.txt | 457 +
.../providers/common/sql/sensors/index.rst.txt | 15 +
.../providers/common/sql/sensors/sql/index.rst.txt | 65 +
.../example_sql_column_table_check/index.rst.txt | 29 +
.../system/providers/common/sql/index.rst.txt | 15 +
.../1.2.0/_sources/commits.rst.txt | 75 +
.../1.2.0/_sources/connections.rst.txt | 32 +
.../1.2.0/_sources/index.rst.txt | 91 +
.../installing-providers-from-sources.rst.txt | 18 +
.../1.2.0/_sources/operators.rst.txt | 112 +
.../1.2.0/_static/_gen/css/main-custom.min.css | 1 +
.../1.2.0/_static/_gen/css/main.min.css | 7 +
.../1.2.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../1.2.0/_static/basic.css | 899 ++
.../1.2.0/_static/check-solid.svg | 4 +
.../1.2.0/_static/clipboard.min.js | 7 +
.../1.2.0/_static/copy-button.svg | 5 +
.../1.2.0/_static/copybutton.css | 93 +
.../1.2.0/_static/copybutton.js | 220 +
.../1.2.0/_static/copybutton_funcs.js | 58 +
.../1.2.0/_static/doctools.js | 264 +
.../1.2.0/_static/documentation_options.js | 14 +
.../1.2.0/_static/file.png | Bin 0 -> 286 bytes
.../1.2.0/_static/graphviz.css | 19 +
.../1.2.0/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../1.2.0/_static/jquery.js | 2 +
.../1.2.0/_static/language_data.js | 199 +
.../1.2.0/_static/minus.png | Bin 0 -> 90 bytes
.../1.2.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../1.2.0/_static/plus.png | Bin 0 -> 90 bytes
.../1.2.0/_static/pygments.css | 74 +
.../1.2.0/_static/searchtools.js | 530 +
.../1.2.0/_static/underscore-1.13.1.js | 2042 ++++
.../1.2.0/_static/underscore.js | 6 +
.../1.2.0/commits.html} | 378 +-
.../1.2.0/connections.html} | 201 +-
.../1.2.0/genindex.html} | 669 +-
.../1.2.0/index.html} | 312 +-
.../1.2.0/installing-providers-from-sources.html} | 312 +-
.../1.2.0/objects.inv | Bin 0 -> 1395 bytes
.../1.2.0/operators.html} | 349 +-
.../1.2.0/py-modindex.html} | 295 +-
.../1.2.0/search.html} | 240 +-
.../1.2.0/searchindex.js | 1 +
.../apache-airflow-providers-common-sql/stable.txt | 2 +-
.../5.2.1/.buildinfo | 4 +
.../airflow/providers/postgres/hooks/index.html} | 198 +-
.../providers/postgres/hooks/postgres/index.html} | 378 +-
.../_api/airflow/providers/postgres/index.html} | 201 +-
.../providers/postgres/operators/index.html} | 198 +-
.../postgres/operators/postgres/index.html} | 274 +-
.../postgres/example_postgres/index.html} | 223 +-
.../tests/system/providers/postgres/index.html} | 198 +-
.../providers/postgres/hooks/postgres.html} | 572 +-
.../providers/postgres/operators/postgres.html} | 316 +-
.../5.2.1/_modules/index.html} | 179 +-
.../providers/postgres/example_postgres.html} | 312 +-
.../airflow/providers/postgres/hooks/index.rst.txt | 15 +
.../postgres/hooks/postgres/index.rst.txt | 135 +
.../_api/airflow/providers/postgres/index.rst.txt | 16 +
.../providers/postgres/operators/index.rst.txt | 15 +
.../postgres/operators/postgres/index.rst.txt | 64 +
.../postgres/example_postgres/index.rst.txt | 29 +
.../tests/system/providers/postgres/index.rst.txt | 15 +
.../5.2.1/_sources/commits.rst.txt | 315 +
.../5.2.1/_sources/connections/postgres.rst.txt | 119 +
.../5.2.1/_sources/index.rst.txt | 123 +
.../installing-providers-from-sources.rst.txt | 18 +
.../postgres_operator_howto_guide.rst.txt | 188 +
.../5.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../5.2.1/_static/_gen/css/main.min.css | 7 +
.../5.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.2.1/_static/basic.css | 899 ++
.../5.2.1/_static/check-solid.svg | 4 +
.../5.2.1/_static/clipboard.min.js | 7 +
.../5.2.1/_static/copy-button.svg | 5 +
.../5.2.1/_static/copybutton.css | 93 +
.../5.2.1/_static/copybutton.js | 220 +
.../5.2.1/_static/copybutton_funcs.js | 58 +
.../5.2.1/_static/doctools.js | 264 +
.../5.2.1/_static/documentation_options.js | 14 +
.../5.2.1/_static/file.png | Bin 0 -> 286 bytes
.../5.2.1/_static/graphviz.css | 19 +
.../5.2.1/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../5.2.1/_static/jquery.js | 2 +
.../5.2.1/_static/language_data.js | 199 +
.../5.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pygments.css | 74 +
.../5.2.1/_static/searchtools.js | 530 +
.../5.2.1/_static/underscore-1.13.1.js | 2042 ++++
.../5.2.1/_static/underscore.js | 6 +
.../5.2.1/commits.html} | 1129 +-
.../5.2.1/connections/index.html | 1 +
.../5.2.1/connections/postgres.html} | 289 +-
.../5.2.1/genindex.html} | 476 +-
.../5.2.1/index.html} | 677 +-
.../5.2.1/installing-providers-from-sources.html} | 312 +-
.../5.2.1/objects.inv | 10 +
.../operators/postgres_operator_howto_guide.html} | 430 +-
.../5.2.1/py-modindex.html} | 285 +-
.../5.2.1/search.html} | 240 +-
.../5.2.1/searchindex.js | 1 +
.../apache-airflow-providers-postgres/stable.txt | 2 +-
.../4.0.1/.buildinfo | 4 +
.../airflow/providers/presto/hooks/index.html} | 196 +-
.../providers/presto/hooks/presto/index.html} | 424 +-
.../_api/airflow/providers/presto/index.html} | 199 +-
.../presto/transfers/gcs_to_presto/index.html} | 267 +-
.../airflow/providers/presto/transfers/index.html} | 196 +-
.../presto/example_gcs_to_presto/index.html} | 246 +-
.../_api/tests/system/providers/presto/index.html} | 196 +-
.../airflow/providers/presto/hooks/presto.html} | 521 +-
.../providers/presto/transfers/gcs_to_presto.html} | 342 +-
.../4.0.1/_modules/index.html} | 177 +-
.../providers/presto/example_gcs_to_presto.html} | 274 +-
.../airflow/providers/presto/hooks/index.rst.txt | 15 +
.../providers/presto/hooks/presto/index.rst.txt | 156 +
.../_api/airflow/providers/presto/index.rst.txt | 16 +
.../presto/transfers/gcs_to_presto/index.rst.txt | 66 +
.../providers/presto/transfers/index.rst.txt | 15 +
.../presto/example_gcs_to_presto/index.rst.txt | 49 +
.../tests/system/providers/presto/index.rst.txt | 15 +
.../4.0.1/_sources/commits.rst.txt | 266 +
.../4.0.1/_sources/index.rst.txt | 123 +
.../installing-providers-from-sources.rst.txt | 18 +
.../operators/transfer/gcs_to_presto.rst.txt | 52 +
.../4.0.1/_static/_gen/css/main-custom.min.css | 1 +
.../4.0.1/_static/_gen/css/main.min.css | 7 +
.../4.0.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.0.1/_static/basic.css | 899 ++
.../4.0.1/_static/check-solid.svg | 4 +
.../4.0.1/_static/clipboard.min.js | 7 +
.../4.0.1/_static/copy-button.svg | 5 +
.../4.0.1/_static/copybutton.css | 93 +
.../4.0.1/_static/copybutton.js | 220 +
.../4.0.1/_static/copybutton_funcs.js | 58 +
.../4.0.1/_static/doctools.js | 264 +
.../4.0.1/_static/documentation_options.js | 14 +
.../4.0.1/_static/file.png | Bin 0 -> 286 bytes
.../4.0.1/_static/graphviz.css | 19 +
.../4.0.1/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../4.0.1/_static/jquery.js | 2 +
.../4.0.1/_static/language_data.js | 199 +
.../4.0.1/_static/minus.png | Bin 0 -> 90 bytes
.../4.0.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.0.1/_static/plus.png | Bin 0 -> 90 bytes
.../4.0.1/_static/pygments.css | 74 +
.../4.0.1/_static/searchtools.js | 530 +
.../4.0.1/_static/underscore-1.13.1.js | 2042 ++++
.../4.0.1/_static/underscore.js | 6 +
.../4.0.1/commits.html} | 971 +-
.../4.0.1/genindex.html} | 421 +-
.../4.0.1/index.html} | 653 +-
.../4.0.1/installing-providers-from-sources.html} | 310 +-
.../4.0.1/objects.inv | Bin 0 -> 928 bytes
.../4.0.1/operators/transfer/gcs_to_presto.html} | 214 +-
.../4.0.1/py-modindex.html} | 283 +-
.../4.0.1/search.html} | 238 +-
.../4.0.1/searchindex.js | 1 +
.../apache-airflow-providers-presto/stable.txt | 2 +-
.../3.2.1/.buildinfo | 4 +
.../airflow/providers/sqlite/hooks/index.html} | 198 +-
.../providers/sqlite/hooks/sqlite/index.html} | 276 +-
.../_api/airflow/providers/sqlite/index.html} | 201 +-
.../airflow/providers/sqlite/operators/index.html} | 198 +-
.../providers/sqlite/operators/sqlite/index.html} | 280 +-
.../providers/sqlite/example_sqlite/index.html} | 228 +-
.../_api/tests/system/providers/sqlite/index.html} | 198 +-
.../airflow/providers/sqlite/hooks/sqlite.html} | 266 +-
.../providers/sqlite/operators/sqlite.html} | 283 +-
.../3.2.1/_modules/index.html} | 179 +-
.../system/providers/sqlite/example_sqlite.html} | 324 +-
.../airflow/providers/sqlite/hooks/index.rst.txt | 15 +
.../providers/sqlite/hooks/sqlite/index.rst.txt | 61 +
.../_api/airflow/providers/sqlite/index.rst.txt | 16 +
.../providers/sqlite/operators/index.rst.txt | 15 +
.../sqlite/operators/sqlite/index.rst.txt | 65 +
.../providers/sqlite/example_sqlite/index.rst.txt | 38 +
.../tests/system/providers/sqlite/index.rst.txt | 15 +
.../3.2.1/_sources/commits.rst.txt | 255 +
.../3.2.1/_sources/connections/sqlite.rst.txt | 36 +
.../3.2.1/_sources/index.rst.txt | 120 +
.../installing-providers-from-sources.rst.txt | 18 +
.../3.2.1/_sources/operators.rst.txt | 75 +
.../3.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../3.2.1/_static/_gen/css/main.min.css | 7 +
.../3.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../3.2.1/_static/basic.css | 899 ++
.../3.2.1/_static/check-solid.svg | 4 +
.../3.2.1/_static/clipboard.min.js | 7 +
.../3.2.1/_static/copy-button.svg | 5 +
.../3.2.1/_static/copybutton.css | 93 +
.../3.2.1/_static/copybutton.js | 220 +
.../3.2.1/_static/copybutton_funcs.js | 58 +
.../3.2.1/_static/doctools.js | 264 +
.../3.2.1/_static/documentation_options.js | 14 +
.../3.2.1/_static/file.png | Bin 0 -> 286 bytes
.../3.2.1/_static/graphviz.css | 19 +
.../3.2.1/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../3.2.1/_static/jquery.js | 2 +
.../3.2.1/_static/language_data.js | 199 +
.../3.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../3.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../3.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../3.2.1/_static/pygments.css | 74 +
.../3.2.1/_static/searchtools.js | 530 +
.../3.2.1/_static/underscore-1.13.1.js | 2042 ++++
.../3.2.1/_static/underscore.js | 6 +
.../3.2.1/commits.html} | 949 +-
.../3.2.1/connections/index.html | 1 +
.../3.2.1/connections/sqlite.html} | 164 +-
.../3.2.1/genindex.html} | 446 +-
.../3.2.1/index.html} | 605 +-
.../3.2.1/installing-providers-from-sources.html} | 312 +-
.../3.2.1/objects.inv | Bin 0 -> 774 bytes
.../3.2.1/operators.html} | 263 +-
.../3.2.1/py-modindex.html} | 285 +-
.../3.2.1/search.html} | 240 +-
.../3.2.1/searchindex.js | 1 +
.../apache-airflow-providers-sqlite/stable.txt | 2 +-
.../4.0.1/.buildinfo | 4 +
.../_api/airflow/providers/trino/hooks/index.html} | 200 +-
.../providers/trino/hooks/trino/index.html} | 441 +-
.../4.0.1/_api/airflow/providers/trino/index.html} | 207 +-
.../airflow/providers/trino/operators/index.html} | 200 +-
.../providers/trino/operators/trino/index.html} | 298 +-
.../trino/transfers/gcs_to_trino/index.html} | 274 +-
.../airflow/providers/trino/transfers/index.html} | 200 +-
.../trino/example_gcs_to_trino/index.html} | 250 +-
.../providers/trino/example_trino/index.html} | 244 +-
.../_api/tests/system/providers/trino/index.html} | 201 +-
.../airflow/providers/trino/hooks/trino.html} | 551 +-
.../airflow/providers/trino/operators/trino.html} | 322 +-
.../providers/trino/transfers/gcs_to_trino.html} | 348 +-
.../4.0.1/_modules/index.html} | 183 +-
.../providers/trino/example_gcs_to_trino.html} | 278 +-
.../system/providers/trino/example_trino.html} | 322 +-
.../airflow/providers/trino/hooks/index.rst.txt | 15 +
.../providers/trino/hooks/trino/index.rst.txt | 166 +
.../_api/airflow/providers/trino/index.rst.txt | 17 +
.../providers/trino/operators/index.rst.txt | 15 +
.../providers/trino/operators/trino/index.rst.txt | 82 +
.../trino/transfers/gcs_to_trino/index.rst.txt | 69 +
.../providers/trino/transfers/index.rst.txt | 15 +
.../trino/example_gcs_to_trino/index.rst.txt | 49 +
.../providers/trino/example_trino/index.rst.txt | 44 +
.../tests/system/providers/trino/index.rst.txt | 16 +
.../4.0.1/_sources/commits.rst.txt | 208 +
.../4.0.1/_sources/connections.rst.txt | 52 +
.../4.0.1/_sources/index.rst.txt | 125 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.0.1/_sources/operators/index.rst.txt | 25 +
.../operators/transfer/gcs_to_trino.rst.txt | 52 +
.../4.0.1/_sources/operators/trino.rst.txt | 42 +
.../4.0.1/_static/_gen/css/main-custom.min.css | 1 +
.../4.0.1/_static/_gen/css/main.min.css | 7 +
.../4.0.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.0.1/_static/basic.css | 899 ++
.../4.0.1/_static/check-solid.svg | 4 +
.../4.0.1/_static/clipboard.min.js | 7 +
.../4.0.1/_static/copy-button.svg | 5 +
.../4.0.1/_static/copybutton.css | 93 +
.../4.0.1/_static/copybutton.js | 220 +
.../4.0.1/_static/copybutton_funcs.js | 58 +
.../4.0.1/_static/doctools.js | 264 +
.../4.0.1/_static/documentation_options.js | 14 +
.../4.0.1/_static/file.png | Bin 0 -> 286 bytes
.../4.0.1/_static/graphviz.css | 19 +
.../4.0.1/_static/jquery-3.6.0.js | 10881 +++++++++++++++++++
.../4.0.1/_static/jquery.js | 2 +
.../4.0.1/_static/language_data.js | 199 +
.../4.0.1/_static/minus.png | Bin 0 -> 90 bytes
.../4.0.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.0.1/_static/plus.png | Bin 0 -> 90 bytes
.../4.0.1/_static/pygments.css | 74 +
.../4.0.1/_static/searchtools.js | 530 +
.../4.0.1/_static/underscore-1.13.1.js | 2042 ++++
.../4.0.1/_static/underscore.js | 6 +
.../4.0.1/commits.html} | 763 +-
.../4.0.1/connections.html} | 215 +-
.../4.0.1/genindex.html} | 601 +-
.../4.0.1/index.html} | 635 +-
.../4.0.1/installing-providers-from-sources.html} | 314 +-
.../4.0.1/objects.inv | Bin 0 -> 1158 bytes
.../4.0.1/operators/index.html} | 156 +-
.../4.0.1/operators/transfer/gcs_to_trino.html} | 218 +-
.../4.0.1/operators/trino.html} | 222 +-
.../4.0.1/py-modindex.html} | 302 +-
.../4.0.1/search.html} | 242 +-
.../4.0.1/searchindex.js | 1 +
.../apache-airflow-providers-trino/stable.txt | 2 +-
.../core-extensions/connections.html | 34 +-
.../core-extensions/extra-links.html | 14 +-
.../core-extensions/index.html | 2 +-
.../core-extensions/logging.html | 6 +-
.../core-extensions/secrets-backends.html | 4 +-
.../installing-from-sources.html | 2 +
docs-archive/apache-airflow-providers/objects.inv | Bin 1228 -> 1237 bytes
.../operators-and-hooks-ref/apache.html | 4 +-
.../operators-and-hooks-ref/aws.html | 253 +-
.../operators-and-hooks-ref/azure.html | 39 +
.../operators-and-hooks-ref/google.html | 55 +-
.../operators-and-hooks-ref/index.html | 15 +-
.../operators-and-hooks-ref/protocol.html | 20 +-
.../operators-and-hooks-ref/services.html | 83 +-
.../operators-and-hooks-ref/software.html | 141 +-
.../apache-airflow-providers/packages-ref.html | 283 +-
.../apache-airflow-providers/searchindex.js | 2 +-
911 files changed, 254229 insertions(+), 64225 deletions(-)
diff --git a/docs-archive/apache-airflow-providers-amazon/5.1.0/.buildinfo b/docs-archive/apache-airflow-providers-amazon/5.1.0/.buildinfo
new file mode 100644
index 0000000000..b81867dcbb
--- /dev/null
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/.buildinfo
@@ -0,0 +1,4 @@
+# Sphinx build info version 1
+# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
+config: c4ce4ef72b762e9ac224a3bf7a5288c2
+tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/exceptions/index.html
similarity index 86%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/exceptions/index.html
index 3f4eedb5bd..46ec5416b5 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/exceptions/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.exceptions — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../search.html" />
+ <link rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.utils.redshift" href="../utils/redshift/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,13 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a></li>
</ul>
</div>
@@ -555,54 +594,49 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
-</ul>
-</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
-</ul>
-</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
-</ul>
-</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
-</ul>
+ <div class="section" id="module-airflow.providers.amazon.aws.exceptions">
+<span id="airflow-providers-amazon-aws-exceptions"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.exceptions" title="airflow.providers.amazon.aws.exceptions"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.exceptions" title="Permalink to this heading">¶</a></h1>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsTaskFailToStart</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airfl [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS tasks fail to start AFTER processing the request.</p>
+<dl class="field-list simple">
+</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsTaskFailToStart.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsOperatorError</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">failures</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig- [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS cannot handle the request.</p>
+<dl class="field-list simple">
+</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsOperatorError.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
+</dd></dl>
+
+</dd></dl>
+
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.utils.redshift" href="../utils/redshift/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +706,18 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">EcsTaskFailToStart</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">__reduce__</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError">EcsOperatorError</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">__reduce__</a></li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +742,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/exceptions/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +876,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../" src="../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../" id="documentation_options" src="../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
similarity index 80%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
index 3f4eedb5bd..f1dcbfe367 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.appflow — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,116 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.appflow">
+<span id="airflow-providers-amazon-aws-hooks-appflow"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="airflow.providers.amazon.aws.hooks.appflow"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="Permalink to this heading">¶</a></h1>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook" title="airflow.providers.amazon.aws.hooks.appflow.AppflowHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AppflowHook</span></code></a></p></td>
+<td><p>Interact with Amazon Appflow, using the boto3 library.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.appflow.</span></span><span class="sig-name descname"><span class="pre">AppflowHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Appflow, using the boto3 library.
+Hook attribute <code class="docutils literal notranslate"><span class="pre">conn</span></code> has all methods that listed in documentation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/appflow.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/appflow.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/appflow/1.0/APIReference/Welcome.html">https://docs.aws.amazon.com/appflow/1.0/APIReference/Welcome.html</a></p></li>
</ul>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
-</ul>
+<dl class="simple">
+<dt>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code> or <code class="docutils literal notranslate"><span class="pre">region_name</span></code>) may be specified and</dt><dd><p>are passed down to the underlying AwsBaseHook.</p>
+</dd>
+</dl>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_OFFSET</span></span><em class="property"><span class="w"> </span><span class="pre">:int</span> <span class="pre">=</span> <span class="pre">15</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/appflow.html#AppflowHook.EVENTUAL_CONSISTENCY_OFFSET"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_POLLING</span></span><em class="property"><span class="w"> </span><span class="pre">:int</span> <span class="pre">=</span> <span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/appflow.html#AppflowHook.EVENTUAL_CONSISTENCY_POLLING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.p [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/appflow.html#AppflowHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 Appflow client (cached)</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">
+<span class="sig-name descname"><span class="pre">run_flow</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">poll_interval</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">20</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airfl [...]
+<dd><p>Execute an AppFlow run.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The flow name</p></li>
+<li><p><strong>poll_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- Time (seconds) to wait between two consecutive calls to check the run status</p></li>
</ul>
-</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>The run execution ID</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">
+<span class="sig-name descname"><span class="pre">update_flow_filter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filter_tasks</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">set_trigger_ondemand</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span [...]
+<dd><p>Update the flow task filter.
+All filters will be removed if an empty array is passed to filter_tasks.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The flow name</p></li>
+<li><p><strong>filter_tasks</strong> (<em>List</em><em>[</em><em>mypy_boto3_appflow.type_defs.TaskTypeDef</em><em>]</em>) -- List flow tasks to be added</p></li>
+<li><p><strong>set_trigger_ondemand</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- If True, set the trigger to on-demand; otherwise, keep the trigger as is</p></li>
</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +775,21 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook">AppflowHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">EVENTUAL_CONSISTENCY_OFFSET</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">EVENTUAL_CONSISTENCY_POLLING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">run_flow</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">update_flow_filter</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +814,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/appflow/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +948,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/athena/index.html
similarity index 71%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/athena/index.html
index 3f4eedb5bd..bd3bfa3287 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/athena/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.athena — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,231 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
-</ul>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.athena">
+<span id="airflow-providers-amazon-aws-hooks-athena"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.athena" title="airflow.providers.amazon.aws.hooks.athena"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.athena" title="Permalink to this heading">¶</a></h1>
+<p>This module contains AWS Athena hook.</p>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook" title="airflow.providers.amazon.aws.hooks.athena.AthenaHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AthenaHook</span></code></a></p></td>
+<td><p>Interact with AWS Athena to run, poll queries and return query results</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.athena.</span></span><span class="sig-name descname"><span class="pre">AthenaHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">sleep_ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Athena to run, poll queries and return query results</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>sleep_time</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- Time (in seconds) to wait between two consecutive calls to check query status on Athena</p>
+</dd>
+</dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['QUEUED',</span> <span class="pre">'RUNNING']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.INTERMEDIATE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provide [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['FAILED',</span> <span class="pre">'CANCELLED']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['SUCCEEDED']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCE [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">
+<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['SUCCEEDED',</span> <span class="pre">'FAILED',</span> <span class="pre">'CANCELLED']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="he [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">
+<span class="sig-name descname"><span class="pre">run_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">query_context</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">result_configuration</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">client_request_token</span></span><span class="o"><span class= [...]
+<dd><p>Run Presto query on athena with provided config and return submitted query_execution_id</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Presto query to run</p></li>
+<li><p><strong>query_context</strong> (<em>Dict</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- Context in which query need to be run</p></li>
+<li><p><strong>result_configuration</strong> (<em>Dict</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>, </em><em>Any</em><em>]</em>) -- Dict with path to store results in and config related to encryption</p></li>
+<li><p><strong>client_request_token</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- Unique token created by user to avoid multiple executions of same query</p></li>
+<li><p><strong>workgroup</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Athena workgroup name, when not specified, will be 'primary'</p></li>
</ul>
-</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>str</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">
+<span class="sig-name descname"><span class="pre">check_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.check_query_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dd><p>Fetch the status of submitted athena query. Returns None or one of valid query states.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>str</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">
+<span class="sig-name descname"><span class="pre">get_state_change_reason</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_state_change_reason"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Fetch the reason for a state change (e.g. error message). Returns None or reason string.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>str</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">
+<span class="sig-name descname"><span class="pre">get_query_results</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">next_token_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_results</span></span> [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else dict of query output</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p></li>
+<li><p><strong>next_token_id</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The token that specifies where to start pagination.</p></li>
+<li><p><strong>max_results</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- The maximum number of results (rows) to return in this request.</p></li>
</ul>
-</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>dict</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">
+<span class="sig-name descname"><span class="pre">get_query_results_paginator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_items</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">page_size</span></s [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else a paginator to iterate through pages of results. If you
+wish to get all results at once, call build_full_result() on the returned PageIterator</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p></li>
+<li><p><strong>max_items</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>]</em>) -- The total number of items to return.</p></li>
+<li><p><strong>page_size</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>]</em>) -- The size of each page.</p></li>
+<li><p><strong>starting_token</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- A token to specify where to start paginating.</p></li>
</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>PageIterator</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[botocore.paginate.PageIterator]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">
+<span class="sig-name descname"><span class="pre">poll_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_tries</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../. [...]
+<dd><p>Poll the status of submitted athena query until query state reaches final state.
+Returns one of the final states</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p></li>
+<li><p><strong>max_tries</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>]</em>) -- Number of times to poll for query state before function exits</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>str</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">
+<span class="sig-name descname"><span class="pre">get_output_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_output_location"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Function to get the output location of the query results
+in s3 uri format.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>str</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">
+<span class="sig-name descname"><span class="pre">stop_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.stop_query"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd><p>Cancel the submitted athena query</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Id of submitted athena query</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>dict</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +890,28 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook">AthenaHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">run_query</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">check_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">get_state_change_reason</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">get_query_results</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">get_query_results_paginator</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">poll_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">get_output_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">stop_query</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +936,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/athena/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +1070,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
similarity index 60%
copy from docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
index 26b47bd72c..fabee6f0c5 100644
--- a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>ASF: Apache Software Foundation — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="AWS: Amazon Web Services" href="aws.html" />
- <link rel="prev" title="Operators and Hooks Reference" href="index.html" />
+ <title>airflow.providers.amazon.aws.hooks.base_aws — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,23 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2 current"><a class="current reference internal" href="#">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -408,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -439,23 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2 current"><a class="current reference internal" href="#">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -544,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Operators and Hooks Reference</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="apache.html"> ASF: Apache Software Foundation</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a></li>
</ul>
</div>
@@ -559,418 +596,395 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="asf-apache-software-foundation">
-<h1>ASF: Apache Software Foundation<a class="headerlink" href="#asf-apache-software-foundation" title="Permalink to this heading">¶</a></h1>
-<p>Airflow supports various software created by <a class="reference external" href="https://www.apache.org/foundation/">Apache Software Foundation</a>.</p>
-<div class="section" id="software">
-<h2>Software<a class="headerlink" href="#software" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within software developed by Apache Software
-Foundation.</p>
-<div class="section" id="apache-beam">
-<h3>Apache Beam<a class="headerlink" href="#apache-beam" title="Permalink to this heading">¶</a></h3>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.base_aws">
+<span id="airflow-providers-amazon-aws-hooks-base-aws"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="airflow.providers.amazon.aws.hooks.base_aws"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="Permalink to this heading">¶</a></h1>
+<p>This module contains Base AWS Hook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p>For more information on how to use this hook, take a look at the guide:
+<a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-awshook"><span class="std std-ref">Amazon Web Services Connection</span></a></p>
+</div>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseSessionFactory</span></code></a></p></td>
+<td><p>Base AWS Session Factory class to handle boto3 session creation.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a></p></td>
+<td><p>Interact with AWS.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p></td>
+<td><p>Interact with AWS.</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory" title="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">resolve_session_factory</span></code></a>()</p></td>
+<td><p>Resolves custom SessionFactory class</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection" title="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseAwsConnection</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionFactory</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseAwsConnection</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseAwsConnection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnectio [...]
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseSessionFactory</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">conn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><spa [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMixin</span></code></p>
+<p>Base AWS Session Factory class to handle boto3 session creation.
+It can handle most of the AWS supported authentication methods.</p>
+<p>User can also derive from this class to have full control of boto3 session
+creation or to support custom federation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-aws-session-factory"><span class="std std-ref">Session Factory</span></a></p>
+</div>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/_api/airflow/providers/apache/beam/operators/beam/index.html#module-airflow.providers.apache.beam.operators.beam" title="(in apache-airflow-providers-apache-beam v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.beam.operators.beam</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/_api/airflow/providers/apache/beam/hooks/beam/index.html#module-airflow.providers.apache.beam.hooks.beam" title="(in apache-airflow-providers-apache-beam v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.beam.hooks.beam</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/operators.html" title="(in apache-airflow-providers-apache-beam v4.0.0)"><span>Apache Beam Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-beam"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-beam</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://beam.apache.org/">Apache Beam</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-cassandra">
-<h3>Apache Cassandra<a class="headerlink" href="#apache-cassandra" title="Permalink to this heading">¶</a></h3>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Cached AWS Connection Wrapper.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-cassandra/stable/_api/airflow/providers/apache/cassandra/hooks/cassandra/index.html#module-airflow.providers.apache.cassandra.hooks.cassandra" title="(in apache-airflow-providers-apache-cassandra v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.cassandra.hooks.cassandra</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-cassandra"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-cassandra</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://cassandra.apache.org/">Apache Cassandra</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-drill">
-<h3>Apache Drill<a class="headerlink" href="#apache-drill" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">
+<span class="sig-name descname"><span class="pre">basic_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.basic_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session" title="Permalink to thi [...]
+<dd><p>Cached property with basic boto3.session.Session.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/_api/airflow/providers/apache/drill/operators/drill/index.html#module-airflow.providers.apache.drill.operators.drill" title="(in apache-airflow-providers-apache-drill v2.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.drill.operators.drill</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/_api/airflow/providers/apache/drill/hooks/drill/index.html#module-airflow.providers.apache.drill.hooks.drill" title="(in apache-airflow-providers-apache-drill v2.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.drill.hooks.drill</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/operators.html" title="(in apache-airflow-providers-apache-drill v2.2.0)"><span>Apache Drill Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-drill"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-drill</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://drill.apache.org/">Apache Drill</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-druid">
-<h3>Apache Druid<a class="headerlink" href="#apache-druid" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">extra_config</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.extra_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config" title=" [...]
+<dd><p>AWS Connection extra_config.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/operators/druid/index.html#module-airflow.providers.apache.druid.operators.druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.operators.druid</span></code></a>, <a class="reference external" href="/docs/apache-airflow-provi [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/hooks/druid/index.html#module-airflow.providers.apache.druid.hooks.druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.hooks.druid</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/operators.html" title="(in apache-airflow-providers-apache-druid v3.2.0)"><span>Apache Druid Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-druid"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-druid</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://druid.apache.org/">Apache Druid</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-hive">
-<h3>Apache Hive<a class="headerlink" href="#apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.region_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name" title="Per [...]
+<dd><p>AWS Region Name read-only property.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/operators/hive/index.html#module-airflow.providers.apache.hive.operators.hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.operators.hive</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-apa [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/hooks/hive/index.html#module-airflow.providers.apache.hive.hooks.hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.hooks.hive</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/operators.html" title="(in apache-airflow-providers-apache-hive v4.0.0)"><span>Apache Hive Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-kylin">
-<h3>Apache Kylin<a class="headerlink" href="#apache-kylin" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config" title="Permalink to this [...]
+<dd><p>Configuration for botocore client read-only property.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-kylin/stable/_api/airflow/providers/apache/kylin/operators/kylin_cube/index.html#module-airflow.providers.apache.kylin.operators.kylin_cube" title="(in apache-airflow-providers-apache-kylin v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.kylin.operators.kylin_cube</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-kylin/stable/_api/airflow/providers/apache/kylin/hooks/kylin/index.html#module-airflow.providers.apache.kylin.hooks.kylin" title="(in apache-airflow-providers-apache-kylin v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.kylin.hooks.kylin</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-kylin"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-kylin</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://kylin.apache.org/">Apache Kylin</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-livy">
-<h3>Apache Livy<a class="headerlink" href="#apache-livy" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">role_arn</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.role_arn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn" title="Permalink to [...]
+<dd><p>Assume Role ARN from AWS Connection</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/_api/airflow/providers/apache/livy/operators/livy/index.html#module-airflow.providers.apache.livy.operators.livy" title="(in apache-airflow-providers-apache-livy v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.operators.livy</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/_api/airflow/providers/apache/livy/hooks/livy/index.html#module-airflow.providers.apache.livy.hooks.livy" title="(in apache-airflow-providers-apache-livy v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/operators.html" title="(in apache-airflow-providers-apache-livy v3.1.0)"><span>Apache Livy Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-livy"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-livy</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://livy.apache.org/">Apache Livy</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-pig">
-<h3>Apache Pig<a class="headerlink" href="#apache-pig" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">
+<span class="sig-name descname"><span class="pre">create_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.create_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session" title="Permalink to [...]
+<dd><p>Create boto3 Session from connection config.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/_api/airflow/providers/apache/pig/operators/pig/index.html#module-airflow.providers.apache.pig.operators.pig" title="(in apache-airflow-providers-apache-pig v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pig.operators.pig</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/_api/airflow/providers/apache/pig/hooks/pig/index.html#module-airflow.providers.apache.pig.hooks.pig" title="(in apache-airflow-providers-apache-pig v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pig.hooks.pig</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/operators.html" title="(in apache-airflow-providers-apache-pig v3.0.0)"><span>Apache Pig Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-pig"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-pig</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://pig.apache.org/">Apache Pig</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-pinot">
-<h3>Apache Pinot<a class="headerlink" href="#apache-pinot" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsGenericHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_co [...]
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/hooks/base/index.html#airflow.hooks.base.BaseHook" title="(in apache-airflow v2.4.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.hooks.base.BaseHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">Generic</span></code>[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsC [...]
+<p>Interact with AWS.
+This class is a thin wrapper around the boto3 python library.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pinot/stable/_api/airflow/providers/apache/pinot/hooks/pinot/index.html#module-airflow.providers.apache.pinot.hooks.pinot" title="(in apache-airflow-providers-apache-pinot v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pinot.hooks.pinot</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-pinot"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-pinot</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://pinot.apache.org/">Apache Pinot</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>aws_conn_id</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The Airflow connection used for AWS credentials.
+If this is None or empty then the default boto3 behaviour is used. If
+running Airflow in a distributed manner and aws_conn_id is None or
+empty, then default boto3 configuration would be used (and must be
+maintained on each worker node).</p></li>
+<li><p><strong>verify</strong> (<em>Optional</em><em>[</em><em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em><em>]</em>) -- Whether or not to verify SSL certificates. See:
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html</a></p></li>
+<li><p><strong>region_name</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- AWS region_name. If not specified then the default boto3 behaviour is used.</p></li>
+<li><p><strong>client_type</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- boto3.client client_type. Eg 's3', 'emr' etc</p></li>
+<li><p><strong>resource_type</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- boto3.resource resource_type. Eg 'dynamodb' etc</p></li>
+<li><p><strong>config</strong> (<em>Optional</em><em>[</em><em>botocore.config.Config</em><em>]</em>) -- Configuration for botocore client. See:
+<a class="reference external" href="https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html">https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html</a></p></li>
+</ul>
</dd>
</dl>
-</div>
-<div class="section" id="apache-spark">
-<h3>Apache Spark<a class="headerlink" href="#apache-spark" title="Permalink to this heading">¶</a></h3>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">
+<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">aws_conn_id</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGeneric [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">
+<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">aws_default</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsG [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">
+<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">aws</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type" ti [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">
+<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">Amazon</span> <span class="pre">Web</span> <span class="pre">Services</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">
+<span class="sig-name descname"><span class="pre">conn_config</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config" title="Permalink to this definition"> [...]
+<dd><p>Get the Airflow Connection object and wrap it in helper (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/_api/airflow/providers/apache/spark/operators/spark_jdbc/index.html#module-airflow.providers.apache.spark.operators.spark_jdbc" title="(in apache-airflow-providers-apache-spark v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.spark.operators.spark_jdbc</span></code></a>, <a class="reference external" href="/docs/apach [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/_api/airflow/providers/apache/spark/hooks/spark_jdbc/index.html#module-airflow.providers.apache.spark.hooks.spark_jdbc" title="(in apache-airflow-providers-apache-spark v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.spark.hooks.spark_jdbc</span></code></a>, <a class="reference external" href="/docs/apache-airflow-p [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/operators.html" title="(in apache-airflow-providers-apache-spark v3.0.0)"><span>Apache Spark Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-spark"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-spark</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://spark.apache.org/">Apache Spark</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-sqoop">
-<h3>Apache Sqoop<a class="headerlink" href="#apache-sqoop" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.region_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name" title="Permalink t [...]
+<dd><p>AWS Region Name read-only property.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/_api/airflow/providers/apache/sqoop/operators/sqoop/index.html#module-airflow.providers.apache.sqoop.operators.sqoop" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.sqoop.operators.sqoop</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/_api/airflow/providers/apache/sqoop/hooks/sqoop/index.html#module-airflow.providers.apache.sqoop.hooks.sqoop" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.sqoop.hooks.sqoop</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/operators.html" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><span>Apache Sqoop Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-sqoop"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-sqoop</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://sqoop.apache.org/">Apache Sqoop</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="hadoop-distributed-file-system-hdfs">
-<h3>Hadoop Distributed File System (HDFS)<a class="headerlink" href="#hadoop-distributed-file-system-hdfs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config" title="Permalink to this definiti [...]
+<dd><p>Configuration for botocore client read-only property.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hdfs/stable/_api/airflow/providers/apache/hdfs/hooks/hdfs/index.html#module-airflow.providers.apache.hdfs.hooks.hdfs" title="(in apache-airflow-providers-apache-hdfs v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hdfs.hooks.hdfs</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hdfs"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hdfs</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html">Hadoop Distributed File System (HDFS)</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="webhdfs">
-<h3>WebHDFS<a class="headerlink" href="#webhdfs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">verify</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.verify"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify" title="Permalink to this definiti [...]
+<dd><p>Verify or not SSL certificates boto3 client/resource read-only property.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hdfs/stable/_api/airflow/providers/apache/hdfs/hooks/webhdfs/index.html#module-airflow.providers.apache.hdfs.hooks.webhdfs" title="(in apache-airflow-providers-apache-hdfs v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hdfs.hooks.webhdfs</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hdfs"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hdfs</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS</a></p>
-</dd>
</dl>
-</div>
-</div>
-<div class="section" id="transfers">
-<h2>Transfers<a class="headerlink" href="#transfers" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to copy data from/to software developed by Apache Software
-Foundation.</p>
-<div class="section" id="apache-hive-to-amazon-dynamodb">
-<h3>Apache Hive to Amazon DynamoDB<a class="headerlink" href="#apache-hive-to-amazon-dynamodb" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">
+<span class="sig-name descname"><span class="pre">get_session</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_session"><span class [...]
+<dd><p>Get the underlying boto3.session.Session(region_name=region_name).</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/dynamodb/">Amazon DynamoDB</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/hive_to_dynamodb.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Apache Hive to Amazon DynamoDB</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/hive_to_dynamodb/index.html#module-airflow.providers.amazon.aws.transfers.hive_to_dynamodb" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.hive_to_dynamodb</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-hive-to-apache-druid">
-<h3>Apache Hive to Apache Druid<a class="headerlink" href="#apache-hive-to-apache-druid" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">
+<span class="sig-name descname"><span class="pre">get_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get the underlying boto3 client using boto3 session</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://druid.apache.org/">Apache Druid</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/transfers/hive_to_druid/index.html#module-airflow.providers.apache.druid.transfers.hive_to_druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.transfers.hive_to_druid</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-druid"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-druid</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="vertica-to-apache-hive">
-<h3>Vertica to Apache Hive<a class="headerlink" href="#vertica-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">
+<span class="sig-name descname"><span class="pre">get_resource_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</s [...]
+<dd><p>Get the underlying boto3 resource using boto3 session</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.vertica.com/">Vertica</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/vertica_to_hive/index.html#module-airflow.providers.apache.hive.transfers.vertica_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.vertica_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-hive-to-mysql">
-<h3>Apache Hive to MySQL<a class="headerlink" href="#apache-hive-to-mysql" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://www.mysql.com/">MySQL</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/hive_to_mysql/index.html#module-airflow.providers.apache.hive.transfers.hive_to_mysql" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.hive_to_mysql</span></code></a></p>
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>Union[boto3.client, boto3.resource]</p>
</dd>
</dl>
-</div>
-<div class="section" id="apache-hive-to-samba">
-<h3>Apache Hive to Samba<a class="headerlink" href="#apache-hive-to-samba" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">
+<span class="sig-name descname"><span class="pre">conn_client_meta</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_client_meta"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta" title="Permalink to th [...]
+<dd><p>Get botocore client metadata from Hook connection (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://www.samba.org/">Samba</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/hive_to_samba/index.html#module-airflow.providers.apache.hive.transfers.hive_to_samba" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.hive_to_samba</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="amazon-simple-storage-service-s3-to-apache-hive">
-<h3>Amazon Simple Storage Service (S3) to Apache Hive<a class="headerlink" href="#amazon-simple-storage-service-s3-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_region_name</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_region_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name" tit [...]
+<dd><p>Get actual AWS Region Name from Hook connection (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/s3_to_hive/index.html#module-airflow.providers.apache.hive.transfers.s3_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.s3_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="mysql-to-apache-hive">
-<h3>MySQL to Apache Hive<a class="headerlink" href="#mysql-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_partition</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_partition"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition" title="Pe [...]
+<dd><p>Get associated AWS Region Partition from Hook connection (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.mysql.com/">MySQL</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/mysql_to_hive/index.html#module-airflow.providers.apache.hive.transfers.mysql_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.mysql_to_hive</span></code></a></p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">
+<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
+<p>Implemented so that caching works as intended. It exists for compatibility
+with subclasses that rely on a super().get_conn() method.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>Union[boto3.client, boto3.resource]</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-sql-server-mssql-to-apache-hive">
-<h3>Microsoft SQL Server (MSSQL) to Apache Hive<a class="headerlink" href="#microsoft-sql-server-mssql-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">
+<span class="sig-name descname"><span class="pre">get_credentials</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_credentials"><sp [...]
+<dd><p>Get the underlying <cite>botocore.Credentials</cite> object.</p>
+<p>This contains the following authentication attributes: access_key, secret_key and token.
+By use this method also secret_key and token will mask in tasks logs.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.microsoft.com/en-us/sql-server/sql-server-downloads">Microsoft SQL Server (MSSQL)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">
+<span class="sig-name descname"><span class="pre">expand_role</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">role</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow [...]
+<dd><p>If the IAM role is a role name, get the Amazon Resource Name (ARN) for the role.
+If IAM role is already an IAM role ARN, no change is made.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>role</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- IAM role name or ARN</p></li>
+<li><p><strong>region_name</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- Optional region name to get credentials for</p></li>
+</ul>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/mssql_to_hive/index.html#module-airflow.providers.apache.hive.transfers.mssql_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.mssql_to_hive</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>IAM role ARN</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
</dd>
</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">should_retry</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.retry"><span class="viewcode-link"><span class="pre">[source] [...]
+<dd><p>A decorator that provides a mechanism to repeat requests in response to exceeding a temporary quote
+limit.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">get_ui_field_behaviour</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_ui_field_behaviour"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Returns custom UI field behaviour for AWS Connection.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">
+<span class="sig-name descname"><span class="pre">test_connection</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.test_connection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection" title="Permalink to this [...]
+<dd><p>Tests the AWS connection by call AWS STS (Security Token Service) GetCallerIdentity API.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference external" href="https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html">https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html</a></p>
+</div>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsBaseHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_ [...]
+<dd><p>Bases: <a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a>[<code class="xref py py-obj docutils literal notranslate"><span class="pre">Union</span></code>[<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/bo [...]
+<p>Interact with AWS.
+This class is a thin wrapper around the boto3 python library
+with basic conn annotation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a></p>
</div>
-<div class="section" id="apache-cassandra-to-google-cloud-storage-gcs">
-<h3>Apache Cassandra to Google Cloud Storage (GCS)<a class="headerlink" href="#apache-cassandra-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://cassandra.apache.org/">Apache Cassandra</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/cassandra_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.cassandra_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.cassandra_to_gcs</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
-</dd>
</dl>
+</dd></dl>
+
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">resolve_session_factory</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#resolve_session_factory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="hea [...]
+<dd><p>Resolves custom SessionFactory class</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">SessionFactory</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#SessionFactory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title= [...]
+<dd></dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Operators and Hooks Reference" href="index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="AWS: Amazon Web Services" href="aws.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -1040,33 +1054,51 @@ Foundation.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">ASF: Apache Software Foundation</a><ul>
-<li><a class="reference internal" href="#software">Software</a><ul>
-<li><a class="reference internal" href="#apache-beam">Apache Beam</a></li>
-<li><a class="reference internal" href="#apache-cassandra">Apache Cassandra</a></li>
-<li><a class="reference internal" href="#apache-drill">Apache Drill</a></li>
-<li><a class="reference internal" href="#apache-druid">Apache Druid</a></li>
-<li><a class="reference internal" href="#apache-hive">Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-kylin">Apache Kylin</a></li>
-<li><a class="reference internal" href="#apache-livy">Apache Livy</a></li>
-<li><a class="reference internal" href="#apache-pig">Apache Pig</a></li>
-<li><a class="reference internal" href="#apache-pinot">Apache Pinot</a></li>
-<li><a class="reference internal" href="#apache-spark">Apache Spark</a></li>
-<li><a class="reference internal" href="#apache-sqoop">Apache Sqoop</a></li>
-<li><a class="reference internal" href="#hadoop-distributed-file-system-hdfs">Hadoop Distributed File System (HDFS)</a></li>
-<li><a class="reference internal" href="#webhdfs">WebHDFS</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">BaseAwsConnection</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">BaseSessionFactory</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">basic_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">extra_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">role_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">create_session</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">AwsGenericHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">conn_name_attr</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">default_conn_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">conn_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">hook_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">conn_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">verify</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">get_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">get_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">get_resource_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">conn_client_meta</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">conn_region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">conn_partition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">get_conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">get_credentials</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">expand_role</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">get_ui_field_behaviour</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">test_connection</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">AwsBaseHook</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">resolve_session_factory</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">SessionFactory</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#transfers">Transfers</a><ul>
-<li><a class="reference internal" href="#apache-hive-to-amazon-dynamodb">Apache Hive to Amazon DynamoDB</a></li>
-<li><a class="reference internal" href="#apache-hive-to-apache-druid">Apache Hive to Apache Druid</a></li>
-<li><a class="reference internal" href="#vertica-to-apache-hive">Vertica to Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-hive-to-mysql">Apache Hive to MySQL</a></li>
-<li><a class="reference internal" href="#apache-hive-to-samba">Apache Hive to Samba</a></li>
-<li><a class="reference internal" href="#amazon-simple-storage-service-s3-to-apache-hive">Amazon Simple Storage Service (S3) to Apache Hive</a></li>
-<li><a class="reference internal" href="#mysql-to-apache-hive">MySQL to Apache Hive</a></li>
-<li><a class="reference internal" href="#microsoft-sql-server-mssql-to-apache-hive">Microsoft SQL Server (MSSQL) to Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-cassandra-to-google-cloud-storage-gcs">Apache Cassandra to Google Cloud Storage (GCS)</a></li>
</ul>
</li>
</ul>
@@ -1093,7 +1125,7 @@ Foundation.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/operators-and-hooks-ref/apache.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/base_aws/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -1227,18 +1259,18 @@ Foundation.</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/services.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
similarity index 56%
copy from docs-archive/apache-airflow-providers/operators-and-hooks-ref/services.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
index 793712fe9a..8f693fb420 100644
--- a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/services.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Services — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Software integrations" href="software.html" />
- <link rel="prev" title="Protocol integrations" href="protocol.html" />
+ <title>airflow.providers.amazon.aws.hooks.batch_client — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,23 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -408,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -439,23 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -544,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Operators and Hooks Reference</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="services.html"> Services</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a></li>
</ul>
</div>
@@ -559,518 +596,542 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="services">
-<h1>Services<a class="headerlink" href="#services" title="Permalink to this heading">¶</a></h1>
-<div class="section" id="id1">
-<h2>Services<a class="headerlink" href="#id1" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within various services.</p>
-<div class="section" id="airbyte">
-<h3>Airbyte<a class="headerlink" href="#airbyte" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-airbyte/stable/_api/airflow/providers/airbyte/operators/airbyte/index.html#module-airflow.providers.airbyte.operators.airbyte" title="(in apache-airflow-providers-airbyte v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.airbyte.operators.airbyte</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-airbyte/stable/_api/airflow/providers/airbyte/hooks/airbyte/index.html#module-airflow.providers.airbyte.hooks.airbyte" title="(in apache-airflow-providers-airbyte v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.airbyte.hooks.airbyte</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-airbyte/stable/operators/airbyte.html" title="(in apache-airflow-providers-airbyte v3.1.0)"><span>AirbyteTriggerSyncOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-airbyte"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-airbyte</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.airbyte.io/">Airbyte</a></p>
-</dd>
-</dl>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_client">
+<span id="airflow-providers-amazon-aws-hooks-batch-client"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="airflow.providers.amazon.aws.hooks.batch_client"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="Permalink to this heading">¶</a></h1>
+<p>A client for AWS Batch services</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="http://boto3.readthedocs.io/en/latest/guide/configuration.html">http://boto3.readthedocs.io/en/latest/guide/configuration.html</a></p></li>
+<li><p><a class="reference external" href="http://boto3.readthedocs.io/en/latest/reference/services/batch.html">http://boto3.readthedocs.io/en/latest/reference/services/batch.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html">https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html</a></p></li>
+</ul>
</div>
-<div class="section" id="databricks">
-<h3>Databricks<a class="headerlink" href="#databricks" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/_api/airflow/providers/databricks/operators/databricks/index.html#module-airflow.providers.databricks.operators.databricks" title="(in apache-airflow-providers-databricks v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.databricks.operators.databricks</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/_api/airflow/providers/databricks/hooks/databricks/index.html#module-airflow.providers.databricks.hooks.databricks" title="(in apache-airflow-providers-databricks v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.databricks.hooks.databricks</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-d [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/submit_run.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksSubmitRunOperator</span></a>, <a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/run_now.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksRunNowOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-databricks"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-databricks</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://databricks.com/">Databricks</a></p>
-</dd>
-</dl>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchClientHook</span></code></a></p></td>
+<td><p>A client for AWS Batch services.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class= [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.
+This is used for type hints on <code class="xref py py-meth docutils literal notranslate"><span class="pre">BatchClient.client()</span></code>; it covers
+only the subset of client methods required.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="http://boto3.readthedocs.io/en/latest/reference/services/batch.html">http://boto3.readthedocs.io/en/latest/reference/services/batch.html</a></p></li>
+</ul>
</div>
-<div class="section" id="databricks-repos">
-<h3>Databricks Repos<a class="headerlink" href="#databricks-repos" title="Permalink to this heading">¶</a></h3>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">
+<span class="sig-name descname"><span class="pre">describe_jobs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.describe_jobs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get job descriptions from AWS Batch</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/_api/airflow/providers/databricks/operators/databricks_repos/index.html#module-airflow.providers.databricks.operators.databricks_repos" title="(in apache-airflow-providers-databricks v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.databricks.operators.databricks_repos</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>jobs</strong> (<em>List</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- a list of JobId to describe</p>
</dd>
-<dt class="field-even">Guides</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/repos_create.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksReposCreateOperator</span></a>, <a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/repos_update.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksReposUpdateOperator</span></a>, <a class="reference external" [...]
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe jobs</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-databricks"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-databricks</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.databricks.com/repos/index.html">Databricks Repos</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="databricks-sql">
-<h3>Databricks SQL<a class="headerlink" href="#databricks-sql" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiterName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get an AWS Batch service waiter</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/_api/airflow/providers/databricks/operators/databricks_sql/index.html#module-airflow.providers.databricks.operators.databricks_sql" title="(in apache-airflow-providers-databricks v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.databricks.operators.databricks_sql</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/_api/airflow/providers/databricks/hooks/databricks_sql/index.html#module-airflow.providers.databricks.hooks.databricks_sql" title="(in apache-airflow-providers-databricks v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.databricks.hooks.databricks_sql</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/sql.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksSqlOperator</span></a>, <a class="reference external" href="/docs/apache-airflow-providers-databricks/stable/operators/copy_into.html" title="(in apache-airflow-providers-databricks v3.2.0)"><span>DatabricksCopyIntoOperator</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing).</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-databricks"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-databricks</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://databricks.com/product/databricks-sql">Databricks SQL</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
</dd>
</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>AWS Batch might not have any waiters (until botocore PR-1307 is released).</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">boto3</span>
+
+<span class="n">boto3</span><span class="o">.</span><span class="n">client</span><span class="p">(</span><span class="s2">"batch"</span><span class="p">)</span><span class="o">.</span><span class="n">waiter_names</span> <span class="o">==</span> <span class="p">[]</span>
+</pre></div>
</div>
-<div class="section" id="datadog">
-<h3>Datadog<a class="headerlink" href="#datadog" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-datadog/stable/_api/airflow/providers/datadog/hooks/datadog/index.html#module-airflow.providers.datadog.hooks.datadog" title="(in apache-airflow-providers-datadog v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.datadog.hooks.datadog</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-datadog"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-datadog</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.datadoghq.com/">Datadog</a></p>
-</dd>
-</dl>
</div>
-<div class="section" id="dingding">
-<h3>Dingding<a class="headerlink" href="#dingding" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-dingding/stable/_api/airflow/providers/dingding/operators/dingding/index.html#module-airflow.providers.dingding.operators.dingding" title="(in apache-airflow-providers-dingding v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dingding.operators.dingding</span></code></a>.</p>
-</dd>
-<dt class="field-even">Guides</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-dingding/stable/operators.html" title="(in apache-airflow-providers-dingding v3.0.0)"><span>Dingding Operators</span></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-dingding"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-dingding</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://oapi.dingtalk.com">Dingding</a></p>
-</dd>
-</dl>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/pull/1307">https://github.com/boto/botocore/pull/1307</a></p></li>
+</ul>
</div>
-<div class="section" id="discord">
-<h3>Discord<a class="headerlink" href="#discord" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">
+<span class="sig-name descname"><span class="pre">submit_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobQueue</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobDefinition</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">arrayProperties</span></span></em>, <em class="sig-param"><span class=" [...]
+<dd><p>Submit a Batch job</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-discord/stable/_api/airflow/providers/discord/operators/discord_webhook/index.html#module-airflow.providers.discord.operators.discord_webhook" title="(in apache-airflow-providers-discord v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-discord/stable/_api/airflow/providers/discord/hooks/discord_webhook/index.html#module-airflow.providers.discord.hooks.discord_webhook" title="(in apache-airflow-providers-discord v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.hooks.discord_webhook</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- the name for the AWS Batch job</p></li>
+<li><p><strong>jobQueue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- the queue name on AWS Batch</p></li>
+<li><p><strong>jobDefinition</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- the job definition name on AWS Batch</p></li>
+<li><p><strong>arrayProperties</strong> (<em>Dict</em>) -- the same parameter that boto3 will receive</p></li>
+<li><p><strong>parameters</strong> (<em>Dict</em>) -- the same parameter that boto3 will receive</p></li>
+<li><p><strong>containerOverrides</strong> (<em>Dict</em>) -- the same parameter that boto3 will receive</p></li>
+<li><p><strong>tags</strong> (<em>Dict</em>) -- the same parameter that boto3 will receive</p></li>
+</ul>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-discord"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-discord</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://discordapp.com">Discord</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="facebook-ads">
-<h3>Facebook Ads<a class="headerlink" href="#facebook-ads" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobId</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.terminate_job"><span class="viewcode-link"><span class= [...]
+<dd><p>Terminate a Batch job</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-facebook/stable/_api/airflow/providers/facebook/ads/hooks/ads/index.html#module-airflow.providers.facebook.ads.hooks.ads" title="(in apache-airflow-providers-facebook v3.0.1)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.facebook.ads.hooks.ads</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobId</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a reason to terminate job ID</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-facebook"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-facebook</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://business.facebook.com">Facebook Ads</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="ibm-cloudant">
-<h3>IBM Cloudant<a class="headerlink" href="#ibm-cloudant" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchClientHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class=" [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>A client for AWS Batch services.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-dingding/stable/_api/airflow/providers/dingding/hooks/dingding/index.html#module-airflow.providers.dingding.hooks.dingding" title="(in apache-airflow-providers-dingding v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dingding.hooks.dingding</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-cloudant"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-cloudant</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.ibm.com/cloud/cloudant">IBM Cloudant</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>max_retries</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>]</em>) -- exponential back-off retries, 4200 = 48 hours;
+polling is only used when waiters is None</p></li>
+<li><p><strong>status_retries</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>]</em>) -- number of HTTP retries to get job status, 10;
+polling is only used when waiters is None</p></li>
+</ul>
</dd>
</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>Several methods use a default random delay to check or poll for job status, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>
+Using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
+<p>To modify the global defaults for the range of jitter allowed when a
+random delay is used to check Batch job status, modify these defaults, e.g.:
+.. code-block:</p>
+<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MIN</span> <span class="o">=</span> <span class="mi">0</span>
+<span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MAX</span> <span class="o">=</span> <span class="mi">5</span>
+</pre></div>
</div>
-<div class="section" id="opsgenie">
-<h3>Opsgenie<a class="headerlink" href="#opsgenie" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-opsgenie/stable/_api/airflow/providers/opsgenie/operators/opsgenie_alert/index.html#module-airflow.providers.opsgenie.operators.opsgenie_alert" title="(in apache-airflow-providers-opsgenie v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.opsgenie.operators.opsgenie_alert</span></code></a>, <a class="reference external" href="/docs/apache-airflo [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-opsgenie/stable/_api/airflow/providers/opsgenie/hooks/opsgenie_alert/index.html#module-airflow.providers.opsgenie.hooks.opsgenie_alert" title="(in apache-airflow-providers-opsgenie v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.opsgenie.hooks.opsgenie_alert</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-opsgenie/stable/operators/opsgenie_alert.html" title="(in apache-airflow-providers-opsgenie v4.0.0)"><span>OpsgenieCreateAlertOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-opsgenie"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-opsgenie</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.opsgenie.com/">Opsgenie</a></p>
-</dd>
-</dl>
+<p>When explicit delay values are used, a 1 second random jitter is applied to the
+delay (e.g. a delay of 0 sec will be a <code class="docutils literal notranslate"><span class="pre">random.uniform(0,</span> <span class="pre">1)</span></code> delay. It is
+generally recommended that random jitter is added to API requests. A
+convenience method is provided for this, e.g. to get a random delay of
+10 sec +/- 5 sec: <code class="docutils literal notranslate"><span class="pre">delay</span> <span class="pre">=</span> <span class="pre">BatchClient.add_jitter(10,</span> <span class="pre">width=5,</span> <span class="pre">minima=0)</span></code></p>
</div>
-<div class="section" id="pagerduty">
-<h3>Pagerduty<a class="headerlink" href="#pagerduty" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-pagerduty/stable/_api/airflow/providers/pagerduty/hooks/pagerduty/index.html#module-airflow.providers.pagerduty.hooks.pagerduty" title="(in apache-airflow-providers-pagerduty v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.pagerduty.hooks.pagerduty</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-pagerduty/ [...]
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-pagerduty"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-pagerduty</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.pagerduty.com/">Pagerduty</a></p>
-</dd>
-</dl>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
</div>
-<div class="section" id="plexus">
-<h3>Plexus<a class="headerlink" href="#plexus" title="Permalink to this heading">¶</a></h3>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">
+<span class="sig-name descname"><span class="pre">MAX_RETRIES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">4200</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.MAX_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHoo [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">
+<span class="sig-name descname"><span class="pre">STATUS_RETRIES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.STATUS_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClien [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MIN</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">1</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MIN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.Batch [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MAX</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MAX"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.Batc [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">
+<span class="sig-name descname"><span class="pre">FAILURE_STATE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.FAILURE_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchCli [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">SUCCEEDED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.SUCCESS_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.Batch [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">
+<span class="sig-name descname"><span class="pre">RUNNING_STATE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">RUNNING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.RUNNING_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchCl [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.INTERMEDIATE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['VALID',</span> <span class="pre">'DELETED']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS"><span class="viewcode-lin [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['VALID',</span> <span class="pre">'DELETED']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_TERMINAL_STATUS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS"><span class="viewcode-link"><span class="pre" [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">client</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client" title="Permalink to thi [...]
+<dd><p>An AWS API client for Batch services.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-plexus/stable/_api/airflow/providers/plexus/operators/job/index.html#module-airflow.providers.plexus.operators.job" title="(in apache-airflow-providers-plexus v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.plexus.operators.job</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-plexus/stable/_api/airflow/providers/plexus/hooks/plexus/index.html#module-airflow.providers.plexus.hooks.plexus" title="(in apache-airflow-providers-plexus v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.plexus.hooks.plexus</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-plexus"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-plexus</span></code></a></p>
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a boto3 'batch' client for the <code class="docutils literal notranslate"><span class="pre">.region_name</span></code></p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://plexus.corescientific.com/">Plexus</a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>Union[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a>, botocore.client.BaseClient]</p>
</dd>
</dl>
-</div>
-<div class="section" id="qubole">
-<h3>Qubole<a class="headerlink" href="#qubole" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.terminate_job"><span class="viewcode-link"><span cla [...]
+<dd><p>Terminate a Batch job</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/_api/airflow/providers/qubole/operators/qubole/index.html#module-airflow.providers.qubole.operators.qubole" title="(in apache-airflow-providers-qubole v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.qubole.operators.qubole</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/_api/air [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/_api/airflow/providers/qubole/hooks/qubole/index.html#module-airflow.providers.qubole.hooks.qubole" title="(in apache-airflow-providers-qubole v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.qubole.hooks.qubole</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/_api/airflow/provid [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/operators/qubole.html" title="(in apache-airflow-providers-qubole v3.2.0)"><span>Qubole</span></a>, <a class="reference external" href="/docs/apache-airflow-providers-qubole/stable/operators/qubole_check.html" title="(in apache-airflow-providers-qubole v3.2.0)"><span>Qubole Check</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a reason to terminate job ID</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-qubole"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-qubole</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.qubole.com/en/latest/">Qubole</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="salesforce">
-<h3>Salesforce<a class="headerlink" href="#salesforce" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">
+<span class="sig-name descname"><span class="pre">check_job_success</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.check_job_success"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
+<dd><p>Check the final status of the Batch job; return True if the job
+'SUCCEEDED', else raise an AirflowException</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-salesforce/stable/_api/airflow/providers/salesforce/operators/salesforce_apex_rest/index.html#module-airflow.providers.salesforce.operators.salesforce_apex_rest" title="(in apache-airflow-providers-salesforce v5.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.salesforce.operators.salesforce_apex_rest</span></code></a>, <a class="reference externa [...]
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p>
</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-salesforce/stable/_api/airflow/providers/salesforce/hooks/salesforce/index.html#module-airflow.providers.salesforce.hooks.salesforce" title="(in apache-airflow-providers-salesforce v5.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.salesforce.hooks.salesforce</span></code></a>.</p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)">bool</a></p>
</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-salesforce/stable/operators/salesforce_apex_rest.html" title="(in apache-airflow-providers-salesforce v5.1.0)"><span>SalesforceApexRestOperator</span></a>, <a class="reference external" href="/docs/apache-airflow-providers-salesforce/stable/operators/bulk.html" title="(in apache-airflow-providers-salesforce v5.1.0)"><span>SalesforceBulkOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-salesforce"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-salesforce</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.salesforce.com/">Salesforce</a></p>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="segment">
-<h3>Segment<a class="headerlink" href="#segment" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-segment/stable/_api/airflow/providers/segment/operators/segment_track_event/index.html#module-airflow.providers.segment.operators.segment_track_event" title="(in apache-airflow-providers-segment v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.segment.operators.segment_track_event</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-segment/stable/_api/airflow/providers/segment/hooks/segment/index.html#module-airflow.providers.segment.hooks.segment" title="(in apache-airflow-providers-segment v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.segment.hooks.segment</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-segment"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-segment</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>, </em><em>None</em><em>]</em>) -- a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://segment.com/docs/">Segment</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="slack">
-<h3>Slack<a class="headerlink" href="#slack" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">
+<span class="sig-name descname"><span class="pre">poll_for_job_running</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/ai [...]
+<dd><p>Poll for job running. The status that indicates a job is running or
+already complete are: 'RUNNING'|'SUCCEEDED'|'FAILED'.</p>
+<p>So the status options that this will wait for are the transitions from:
+'SUBMITTED'>'PENDING'>'RUNNABLE'>'STARTING'>'RUNNING'|'SUCCEEDED'|'FAILED'</p>
+<p>The completed status options are included for cases where the status
+changes too quickly for polling to detect a RUNNING status that moves
+quickly from STARTING to RUNNING to completed (often a failure).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-slack/stable/_api/airflow/providers/slack/operators/slack/index.html#module-airflow.providers.slack.operators.slack" title="(in apache-airflow-providers-slack v5.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.slack.operators.slack</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-slack/stable/_api/airflow/prov [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-slack/stable/_api/airflow/providers/slack/hooks/slack/index.html#module-airflow.providers.slack.hooks.slack" title="(in apache-airflow-providers-slack v5.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.slack.hooks.slack</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-slack/stable/_api/airflow/providers/slack [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-slack/stable/operators/slack_operator_howto_guide.html" title="(in apache-airflow-providers-slack v5.1.0)"><span>How-to Guide for Slack Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-slack"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-slack</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>, </em><em>None</em><em>]</em>) -- a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://slack.com/">Slack</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="snowflake">
-<h3>Snowflake<a class="headerlink" href="#snowflake" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">
+<span class="sig-name descname"><span class="pre">poll_for_job_complete</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/a [...]
+<dd><p>Poll for job completion. The status that indicates job completion
+are: 'SUCCEEDED'|'FAILED'.</p>
+<p>So the status options that this will wait for are the transitions from:
+'SUBMITTED'>'PENDING'>'RUNNABLE'>'STARTING'>'RUNNING'>'SUCCEEDED'|'FAILED'</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/_api/airflow/providers/snowflake/operators/snowflake/index.html#module-airflow.providers.snowflake.operators.snowflake" title="(in apache-airflow-providers-snowflake v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.snowflake.operators.snowflake</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/_api/airflow/providers/snowflake/hooks/snowflake/index.html#module-airflow.providers.snowflake.hooks.snowflake" title="(in apache-airflow-providers-snowflake v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.snowflake.hooks.snowflake</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/operators/snowflake.html" title="(in apache-airflow-providers-snowflake v3.2.0)"><span>SnowflakeOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-snowflake"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-snowflake</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>, </em><em>None</em><em>]</em>) -- a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://snowflake.com/">Snowflake</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="tableau">
-<h3>Tableau<a class="headerlink" href="#tableau" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">
+<span class="sig-name descname"><span class="pre">poll_job_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">match_status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.poll_job_status"><span class="viewcode-link" [...]
+<dd><p>Poll for job status using an exponential back-off strategy (with max_retries).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-tableau/stable/_api/airflow/providers/tableau/operators/tableau/index.html#module-airflow.providers.tableau.operators.tableau" title="(in apache-airflow-providers-tableau v3.0.1)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.tableau.operators.tableau</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-tableau/stable [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-tableau/stable/_api/airflow/providers/tableau/hooks/tableau/index.html#module-airflow.providers.tableau.hooks.tableau" title="(in apache-airflow-providers-tableau v3.0.1)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.tableau.hooks.tableau</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-tableau/stable/operators.html" title="(in apache-airflow-providers-tableau v3.0.1)"><span>TableauOperator</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>match_status</strong> (<em>List</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- a list of job status to match; the Batch job status are:
+'SUBMITTED'|'PENDING'|'RUNNABLE'|'STARTING'|'RUNNING'|'SUCCEEDED'|'FAILED'</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-tableau"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-tableau</span></code></a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)">bool</a></p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.tableau.com/">Tableau</a></p>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="telegram">
-<h3>Telegram<a class="headerlink" href="#telegram" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">
+<span class="sig-name descname"><span class="pre">get_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
+<dd><p>Get job description (using status_retries).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-telegram/stable/_api/airflow/providers/telegram/operators/telegram/index.html#module-airflow.providers.telegram.operators.telegram" title="(in apache-airflow-providers-telegram v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.telegram.operators.telegram</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-telegram/stable/_api/airflow/providers/telegram/hooks/telegram/index.html#module-airflow.providers.telegram.hooks.telegram" title="(in apache-airflow-providers-telegram v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.telegram.hooks.telegram</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p>
</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-telegram/stable/operators.html" title="(in apache-airflow-providers-telegram v3.0.0)"><span>TelegramOperator</span></a>.</p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response for describe jobs</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-telegram"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-telegram</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://telegram.org/">Telegram</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
-</div>
-<div class="section" id="yandex-cloud">
-<h3>Yandex.Cloud<a class="headerlink" href="#yandex-cloud" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-yandex/stable/_api/airflow/providers/yandex/hooks/yandex/index.html#module-airflow.providers.yandex.hooks.yandex" title="(in apache-airflow-providers-yandex v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.yandex.hooks.yandex</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-yandex"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-yandex</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://cloud.yandex.com/">Yandex.Cloud</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="yandex-cloud-dataproc">
-<h3>Yandex.Cloud Dataproc<a class="headerlink" href="#yandex-cloud-dataproc" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">parse_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">response</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/h [...]
+<dd><p>Parse job description to extract description for job_id</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-yandex/stable/_api/airflow/providers/yandex/operators/yandexcloud_dataproc/index.html#module-airflow.providers.yandex.operators.yandexcloud_dataproc" title="(in apache-airflow-providers-yandex v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.yandex.operators.yandexcloud_dataproc</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-yandex/stable/_api/airflow/providers/yandex/hooks/yandexcloud_dataproc/index.html#module-airflow.providers.yandex.hooks.yandexcloud_dataproc" title="(in apache-airflow-providers-yandex v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.yandex.hooks.yandexcloud_dataproc</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>response</strong> (<em>Dict</em>) -- an API response for describe jobs</p></li>
+</ul>
</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-yandex/stable/operators.html" title="(in apache-airflow-providers-yandex v3.1.0)"><span>Yandex.Cloud Data Proc Operators</span></a>.</p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe job_id</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-yandex"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-yandex</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://cloud.yandex.com/dataproc">Yandex.Cloud Dataproc</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
-</div>
-</div>
-<div class="section" id="transfers">
-<h2>Transfers<a class="headerlink" href="#transfers" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within various services.</p>
-<div class="section" id="salesforce-to-amazon-simple-storage-service-s3">
-<h3>Salesforce to Amazon Simple Storage Service (S3)<a class="headerlink" href="#salesforce-to-amazon-simple-storage-service-s3" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">
+<span class="sig-name descname"><span class="pre">get_job_awslogs_info</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_awslogs_info"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airfl [...]
+<dd><p>Parse job description to extract AWS CloudWatch information.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.salesforce.com/">Salesforce</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/salesforce_to_s3.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Salesforce to Amazon S3</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/salesforce_to_s3/index.html#module-airflow.providers.amazon.aws.transfers.salesforce_to_s3" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.salesforce_to_s3</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- AWS Batch Job ID</p>
</dd>
</dl>
-</div>
-<div class="section" id="facebook-ads-to-google-cloud-storage-gcs">
-<h3>Facebook Ads to Google Cloud Storage (GCS)<a class="headerlink" href="#facebook-ads-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">add_jitter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">width</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">1</span></span></em>, <em class="sig-param"><span cla [...]
+<dd><p>Use delay +/- width for random jitter</p>
+<p>Adding jitter to status polling can help to avoid
+AWS Batch API limits for monitoring Batch jobs with
+a high concurrency in Airflow tasks.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://business.facebook.com">Facebook Ads</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/operators/transfer/facebook_ads_to_gcs.html" title="(in apache-airflow-providers-google v8.3.0)"><span>Facebook Ads To GCS Operators</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>]</em>) -- number of seconds to pause;
+delay is assumed to be a positive number</p></li>
+<li><p><strong>width</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>]</em>) -- delay +/- width for random jitter;
+width is assumed to be a positive number</p></li>
+<li><p><strong>minima</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>]</em>) -- minimum delay allowed;
+minima is assumed to be a non-negative number</p></li>
+</ul>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/facebook_ads_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.facebook_ads_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.facebook_ads_to_gcs</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>uniform(delay - width, delay + width) jitter
+and it is a non-negative number</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)">float</a></p>
</dd>
</dl>
-</div>
-<div class="section" id="salesforce-to-google-cloud-storage-gcs">
-<h3>Salesforce to Google Cloud Storage (GCS)<a class="headerlink" href="#salesforce-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/a [...]
+<dd><p>Pause execution for <code class="docutils literal notranslate"><span class="pre">delay</span></code> seconds.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.salesforce.com/">Salesforce</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/operators/transfer/salesforce_to_gcs.html" title="(in apache-airflow-providers-google v8.3.0)"><span>Salesforce To GCS Operators</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/salesforce_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.salesforce_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.salesforce_to_gcs</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>, </em><em>None</em><em>]</em>) -- a delay to pause execution using <code class="docutils literal notranslate"><span class="pre">time.sl [...]
+a small 1 second jitter is applied to the delay.</p>
</dd>
</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method uses a default random delay, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>;
+using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
</div>
-<div class="section" id="sql-to-slack">
-<h3>SQL to Slack<a class="headerlink" href="#sql-to-slack" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">exponential_delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">tries</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.exponential_delay"><span class="viewcode-link"><spa [...]
+<dd><p>An exponential back-off delay, with random jitter. There is a maximum
+interval of 10 minutes (with random jitter between 3 and 10 minutes).
+This is used in the <code class="xref py py-meth docutils literal notranslate"><span class="pre">poll_for_job_status()</span></code> method.</p>
<dl class="field-list simple">
-<dt class="field-odd">Target product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://slack.com/">Slack</a></p>
-</dd>
-<dt class="field-even">Operator guide</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-slack/stable/operators/sql_to_slack.html" title="(in apache-airflow-providers-slack v5.1.0)"><span>SqlToSlackOperator</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>tries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- Number of tries</p>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-slack/stable/_api/airflow/providers/slack/transfers/sql_to_slack/index.html#module-airflow.providers.slack.transfers.sql_to_slack" title="(in apache-airflow-providers-slack v5.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.slack.transfers.sql_to_slack</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-slack"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-slack</span></code></a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)">float</a></p>
</dd>
</dl>
+<p>Examples of behavior:</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="k">def</span> <span class="nf">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">):</span>
+ <span class="n">max_interval</span> <span class="o">=</span> <span class="mf">600.0</span> <span class="c1"># 10 minutes in seconds</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="mi">1</span> <span class="o">+</span> <span class="nb">pow</span><span class="p">(</span><span class="n">tries</span> <span class="o">*</span> <span class="mf">0.6</span><span class="p">,</span> <span class="mi">2</span><span class="p">)</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="nb">min</span><span class="p">(</span><span class="n">max_interval</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+ <span class="nb">print</span><span class="p">(</span><span class="n">delay</span> <span class="o">/</span> <span class="mi">3</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+
+
+<span class="k">for</span> <span class="n">tries</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">10</span><span class="p">):</span>
+ <span class="n">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">)</span>
+
+<span class="c1"># 0.33 1.0</span>
+<span class="c1"># 0.45 1.35</span>
+<span class="c1"># 0.81 2.44</span>
+<span class="c1"># 1.41 4.23</span>
+<span class="c1"># 2.25 6.76</span>
+<span class="c1"># 3.33 10.00</span>
+<span class="c1"># 4.65 13.95</span>
+<span class="c1"># 6.21 18.64</span>
+<span class="c1"># 8.01 24.04</span>
+<span class="c1"># 10.05 30.15</span>
+</pre></div>
</div>
-<div class="section" id="amazon-simple-storage-service-s3-to-snowflake">
-<h3>Amazon Simple Storage Service (S3) to Snowflake<a class="headerlink" href="#amazon-simple-storage-service-s3-to-snowflake" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://snowflake.com/">Snowflake</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/operators/s3_to_snowflake.html" title="(in apache-airflow-providers-snowflake v3.2.0)"><span>S3ToSnowflakeOperator</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/_api/airflow/providers/snowflake/transfers/s3_to_snowflake/index.html#module-airflow.providers.snowflake.transfers.s3_to_snowflake" title="(in apache-airflow-providers-snowflake v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.snowflake.transfers.s3_to_snowflake</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-snowflake"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-snowflake</span></code></a></p>
-</dd>
-</dl>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
</div>
-<div class="section" id="snowflake-to-slack">
-<h3>Snowflake to Slack<a class="headerlink" href="#snowflake-to-slack" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://snowflake.com/">Snowflake</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://slack.com/">Slack</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/operators/snowflake_to_slack.html" title="(in apache-airflow-providers-snowflake v3.2.0)"><span>SnowflakeToSlackOperator</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-snowflake/stable/_api/airflow/providers/snowflake/transfers/snowflake_to_slack/index.html#module-airflow.providers.snowflake.transfers.snowflake_to_slack" title="(in apache-airflow-providers-snowflake v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.snowflake.transfers.snowflake_to_slack</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-snowflake"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-snowflake</span></code></a></p>
-</dd>
-</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Protocol integrations" href="protocol.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Software integrations" href="software.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -1140,38 +1201,46 @@
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Services</a><ul>
-<li><a class="reference internal" href="#id1">Services</a><ul>
-<li><a class="reference internal" href="#airbyte">Airbyte</a></li>
-<li><a class="reference internal" href="#databricks">Databricks</a></li>
-<li><a class="reference internal" href="#databricks-repos">Databricks Repos</a></li>
-<li><a class="reference internal" href="#databricks-sql">Databricks SQL</a></li>
-<li><a class="reference internal" href="#datadog">Datadog</a></li>
-<li><a class="reference internal" href="#dingding">Dingding</a></li>
-<li><a class="reference internal" href="#discord">Discord</a></li>
-<li><a class="reference internal" href="#facebook-ads">Facebook Ads</a></li>
-<li><a class="reference internal" href="#ibm-cloudant">IBM Cloudant</a></li>
-<li><a class="reference internal" href="#opsgenie">Opsgenie</a></li>
-<li><a class="reference internal" href="#pagerduty">Pagerduty</a></li>
-<li><a class="reference internal" href="#plexus">Plexus</a></li>
-<li><a class="reference internal" href="#qubole">Qubole</a></li>
-<li><a class="reference internal" href="#salesforce">Salesforce</a></li>
-<li><a class="reference internal" href="#segment">Segment</a></li>
-<li><a class="reference internal" href="#slack">Slack</a></li>
-<li><a class="reference internal" href="#snowflake">Snowflake</a></li>
-<li><a class="reference internal" href="#tableau">Tableau</a></li>
-<li><a class="reference internal" href="#telegram">Telegram</a></li>
-<li><a class="reference internal" href="#yandex-cloud">Yandex.Cloud</a></li>
-<li><a class="reference internal" href="#yandex-cloud-dataproc">Yandex.Cloud Dataproc</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">describe_jobs</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">submit_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">terminate_job</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">BatchClientHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">MAX_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">STATUS_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">DEFAULT_DELAY_MIN</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">DEFAULT_DELAY_MAX</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">FAILURE_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">SUCCESS_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">RUNNING_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">JOB_QUEUE_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">JOB_QUEUE_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">client</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">terminate_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">check_job_success</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">wait_for_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">poll_for_job_running</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">poll_for_job_complete</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">poll_job_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">get_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">parse_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">get_job_awslogs_info</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">add_jitter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">delay</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">exponential_delay</a></li>
+</ul>
+</li>
</ul>
</li>
-<li><a class="reference internal" href="#transfers">Transfers</a><ul>
-<li><a class="reference internal" href="#salesforce-to-amazon-simple-storage-service-s3">Salesforce to Amazon Simple Storage Service (S3)</a></li>
-<li><a class="reference internal" href="#facebook-ads-to-google-cloud-storage-gcs">Facebook Ads to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#salesforce-to-google-cloud-storage-gcs">Salesforce to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#sql-to-slack">SQL to Slack</a></li>
-<li><a class="reference internal" href="#amazon-simple-storage-service-s3-to-snowflake">Amazon Simple Storage Service (S3) to Snowflake</a></li>
-<li><a class="reference internal" href="#snowflake-to-slack">Snowflake to Slack</a></li>
</ul>
</li>
</ul>
@@ -1198,7 +1267,7 @@
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/operators-and-hooks-ref/services.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_client/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -1332,18 +1401,18 @@
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
similarity index 71%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
index 3f4eedb5bd..9bcb43de25 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.batch_waiters — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,228 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_waiters">
+<span id="airflow-providers-amazon-aws-hooks-batch-waiters"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="airflow.providers.amazon.aws.hooks.batch_waiters"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="Permalink to this heading">¶</a></h1>
+<p>AWS Batch service waiters</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
</ul>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook" title="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchWaitersHook</span></code></a></p></td>
+<td><p>A utility to manage waiters for AWS Batch services.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters.</span></span><span class="sig-name descname"><span class="pre">BatchWaitersHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class [...]
+<dd><p>Bases: <a class="reference internal" href="../batch_client/index.html#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook</span></code></a></p>
+<p>A utility to manage waiters for AWS Batch services.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+<span class="kn">from</span> <span class="nn">airflow.providers.amazon.aws.operators.batch_waiters</span> <span class="kn">import</span> <span class="n">BatchWaiters</span>
+
+<span class="c1"># to inspect default waiters</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">()</span>
+<span class="n">config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># type: Dict</span>
+<span class="n">waiter_names</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># -> ["JobComplete", "JobExists", "JobRunning"]</span>
+
+<span class="c1"># The default_config is a useful stepping stone to creating custom waiters, e.g.</span>
+<span class="n">custom_config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># this is a deepcopy</span>
+<span class="c1"># modify custom_config['waiters'] as necessary and get a new instance:</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">(</span><span class="n">waiter_config</span><span class="o">=</span><span class="n">custom_config</span><span class="p">)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_config</span> <span class="c1"># check the custom configuration (this is a deepcopy)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># names of custom waiters</span>
+
+<span class="c1"># During the init for BatchWaiters, the waiter_config is used to build a waiter_model;</span>
+<span class="c1"># and note that this only occurs during the class init, to avoid any accidental mutations</span>
+<span class="c1"># of waiter_config leaking into the waiter_model.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_model</span> <span class="c1"># -> botocore.waiter.WaiterModel object</span>
+
+<span class="c1"># The waiter_model is combined with the waiters.client to get a specific waiter</span>
+<span class="c1"># and the details of the config on that waiter can be further modified without any</span>
+<span class="c1"># accidental impact on the generation of new waiters from the defined waiter_model, e.g.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+
+<span class="c1"># To use a specific waiter, update the config and call the `wait()` method for jobId, e.g.</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
+</div>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
+<li><p><a class="reference external" href="https://www.2ndwatch.com/blog/use-waiters-boto3-write/">https://www.2ndwatch.com/blog/use-waiters-boto3-write/</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15">https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/issues/1915">https://github.com/boto/botocore/issues/1915</a></p></li>
</ul>
</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>waiter_config</strong> (<em>Optional</em><em>[</em><em>Dict</em><em>]</em>) -- a custom waiter configuration for AWS Batch services</p></li>
+<li><p><strong>aws_conn_id</strong> -- connection id of AWS credentials / region name. If None,
+credential boto3 strategy will be used
+(<a class="reference external" href="http://boto3.readthedocs.io/en/latest/guide/configuration.html">http://boto3.readthedocs.io/en/latest/guide/configuration.html</a>).</p></li>
+<li><p><strong>region_name</strong> -- region name to use in AWS client.
+Override the AWS region in connection (if provided)</p></li>
</ul>
+</dd>
+</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">default_config</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.default_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_con [...]
+<dd><p>An immutable default waiter configuration</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>Dict</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_config</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.waiter_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config [...]
+<dd><p>An immutable waiter configuration for this instance; a <code class="docutils literal notranslate"><span class="pre">deepcopy</span></code> is returned by this
+property. During the init for BatchWaiters, the waiter_config is used to build a
+waiter_model and this only occurs during the class init, to avoid any accidental
+mutations of waiter_config leaking into the waiter_model.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>Dict</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_model</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.waiter_model"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model" t [...]
+<dd><p>A configured waiter model used to generate waiters on AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter model for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>botocore.waiter.WaiterModel</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiter_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Get an AWS Batch service waiter, using the configured <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>.</p>
+<p>The <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is combined with the <code class="docutils literal notranslate"><span class="pre">.client</span></code> to get a specific waiter and
+the properties of that waiter can be modified without any accidental impact on the
+generation of new waiters from the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+</pre></div>
</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
+<p>To use a specific waiter, update the config and call the <cite>wait()</cite> method for jobId, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiter_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing); see <code class="docutils literal notranslate"><span class="pre">.list_waiters</span></code>.</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">
+<span class="sig-name descname"><span class="pre">list_waiters</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.list_waiters"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters" title="Permalink to [...]
+<dd><p>List the waiters in a waiter configuration for AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>waiter names for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>List[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete. This assumes that the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is configured
+using some variation of the <code class="docutils literal notranslate"><span class="pre">.default_config</span></code> so that it can generate waiters with the
+following names: "JobExists", "JobRunning" and "JobComplete".</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<em>Union</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a><em>, </em><em>None</em><em>]</em>) -- A delay before polling for job status</p></li>
</ul>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method adds a small random jitter to the <code class="docutils literal notranslate"><span class="pre">delay</span></code> (+/- 2 sec, >= 1 sec).
+Using a random interval helps to avoid AWS API throttle limits when many
+concurrent tasks request job-descriptions.</p>
+<p>It also modifies the <code class="docutils literal notranslate"><span class="pre">max_attempts</span></code> to use the <code class="docutils literal notranslate"><span class="pre">sys.maxsize</span></code>,
+which allows Airflow to manage the timeout on waiting.</p>
+</div>
+</dd></dl>
+
+</dd></dl>
+
+</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +887,22 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">BatchWaitersHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">default_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">waiter_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">waiter_model</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">list_waiters</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">wait_for_job</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +927,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +1061,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
similarity index 83%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
index 3f4eedb5bd..d29885146d 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.cloud_formation — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,83 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
-</ul>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.cloud_formation">
+<span id="airflow-providers-amazon-aws-hooks-cloud-formation"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="airflow.providers.amazon.aws.hooks.cloud_formation"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="Permalink to this heading [...]
+<p>This module contains AWS CloudFormation Hook</p>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook" title="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">CloudFormationHook</span></code></a></p></td>
+<td><p>Interact with AWS CloudFormation.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation.</span></span><span class="sig-name descname"><span class="pre">CloudFormationHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span c [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS CloudFormation.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">
+<span class="sig-name descname"><span class="pre">get_stack_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.get_stack_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><p>Get stack status from CloudFormation.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">
+<span class="sig-name descname"><span class="pre">create_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.create_stack"><span clas [...]
+<dd><p>Create stack in CloudFormation.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)"><em>dict</em></a>) -- parameters to be passed to CloudFormation.</p></li>
</ul>
-</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">
+<span class="sig-name descname"><span class="pre">delete_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../. [...]
+<dd><p>Delete stack in CloudFormation.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)"><em>dict</em></a><em>]</em>) -- parameters to be passed to CloudFormation (optional).</p></li>
</ul>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
-</ul>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +742,19 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">CloudFormationHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">get_stack_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">create_stack</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">delete_stack</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +779,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +913,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/protocol.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
similarity index 67%
copy from docs-archive/apache-airflow-providers/operators-and-hooks-ref/protocol.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
index ce931d0b65..b756fccf23 100644
--- a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/protocol.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Protocol integrations — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Services" href="services.html" />
- <link rel="prev" title="Google" href="google.html" />
+ <title>airflow.providers.amazon.aws.hooks.datasync — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,23 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -408,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -439,23 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -544,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Operators and Hooks Reference</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="protocol.html"> Protocol integrations</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a></li>
</ul>
</div>
@@ -559,388 +596,318 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="protocol-integrations">
-<h1>Protocol integrations<a class="headerlink" href="#protocol-integrations" title="Permalink to this heading">¶</a></h1>
-<div class="section" id="protocols">
-<h2>Protocols<a class="headerlink" href="#protocols" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within various services using standardized
-communication protocols or interface.</p>
-<div class="section" id="file-transfer-protocol-ftp">
-<h3>File Transfer Protocol (FTP)<a class="headerlink" href="#file-transfer-protocol-ftp" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-ftp/stable/_api/airflow/providers/ftp/hooks/ftp/index.html#module-airflow.providers.ftp.hooks.ftp" title="(in apache-airflow-providers-ftp v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.ftp.hooks.ftp</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-ftp"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-ftp</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/html/rfc114">File Transfer Protocol (FTP)</a></p>
-</dd>
-</dl>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.datasync">
+<span id="airflow-providers-amazon-aws-hooks-datasync"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="airflow.providers.amazon.aws.hooks.datasync"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="Permalink to this heading">¶</a></h1>
+<p>Interact with AWS DataSync, using the AWS <code class="docutils literal notranslate"><span class="pre">boto3</span></code> library.</p>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook" title="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DataSyncHook</span></code></a></p></td>
+<td><p>Interact with AWS DataSync.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.datasync.</span></span><span class="sig-name descname"><span class="pre">DataSyncHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">wait_interval_seconds</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">30 [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS DataSync.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a>
+<a class="reference internal" href="../../operators/datasync/index.html#airflow.providers.amazon.aws.operators.datasync.DataSyncOperator" title="airflow.providers.amazon.aws.operators.datasync.DataSyncOperator"><code class="xref py py-class docutils literal notranslate"><span class="pre">DataSyncOperator</span></code></a></p>
</div>
-<div class="section" id="grpc">
-<h3>gRPC<a class="headerlink" href="#grpc" title="Permalink to this heading">¶</a></h3>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-grpc/stable/_api/airflow/providers/grpc/operators/grpc/index.html#module-airflow.providers.grpc.operators.grpc" title="(in apache-airflow-providers-grpc v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.grpc.operators.grpc</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-grpc/stable/_api/airflow/providers/grpc/hooks/grpc/index.html#module-airflow.providers.grpc.hooks.grpc" title="(in apache-airflow-providers-grpc v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.grpc.hooks.grpc</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>wait_interval_seconds</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- Time to wait between two
+consecutive calls to check TaskExecution status. Defaults to 30 seconds.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-grpc"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-grpc</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://grpc.io/">gRPC</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/exceptions.html#ValueError" title="(in Python v3.10)"><strong>ValueError</strong></a> -- If wait_interval_seconds is not between 0 and 15*60 seconds.</p>
</dd>
</dl>
-</div>
-<div class="section" id="hypertext-transfer-protocol-http">
-<h3>Hypertext Transfer Protocol (HTTP)<a class="headerlink" href="#hypertext-transfer-protocol-http" title="Permalink to this heading">¶</a></h3>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['INITIALIZING',</span> <span class="pre">'QUEUED',</span> <span class="pre">'LAUNCHING',</span> <span class="pre">'PREPARING',</span> <span class="pre">'TRANSFERRING',</span> <span class="pre">'VERIFYING']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/am [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['ERROR']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">['SUCCESS']</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.a [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">
+<span class="sig-name descname"><span class="pre">create_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_location_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.htm [...]
+<dd><p>Creates a new location.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/operators/http/index.html#module-airflow.providers.http.operators.http" title="(in apache-airflow-providers-http v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.http.operators.http</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#module-airflow.providers.http.hooks.http" title="(in apache-airflow-providers-http v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-http/stable/operators.html" title="(in apache-airflow-providers-http v4.0.0)"><span>HTTP Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-http"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-http</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.w3.org/Protocols/">Hypertext Transfer Protocol (HTTP)</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="internet-message-access-protocol-imap">
-<h3>Internet Message Access Protocol (IMAP)<a class="headerlink" href="#internet-message-access-protocol-imap" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-imap/stable/_api/airflow/providers/imap/hooks/imap/index.html#module-airflow.providers.imap.hooks.imap" title="(in apache-airflow-providers-imap v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.imap.hooks.imap</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-imap"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-imap</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/html/rfc3501">Internet Message Access Protocol (IMAP)</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="java-database-connectivity-jdbc">
-<h3>Java Database Connectivity (JDBC)<a class="headerlink" href="#java-database-connectivity-jdbc" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-jdbc/stable/_api/airflow/providers/jdbc/operators/jdbc/index.html#module-airflow.providers.jdbc.operators.jdbc" title="(in apache-airflow-providers-jdbc v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.jdbc.operators.jdbc</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-jdbc/stable/_api/airflow/providers/jdbc/hooks/jdbc/index.html#module-airflow.providers.jdbc.hooks.jdbc" title="(in apache-airflow-providers-jdbc v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.jdbc.hooks.jdbc</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-jdbc/stable/operators.html" title="(in apache-airflow-providers-jdbc v3.2.0)"><span>JdbcOperator</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-jdbc"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-jdbc</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.oracle.com/javase/8/docs/technotes/guides/jdbc/">Java Database Connectivity (JDBC)</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="odbc">
-<h3>ODBC<a class="headerlink" href="#odbc" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-odbc/stable/_api/airflow/providers/odbc/hooks/odbc/index.html#module-airflow.providers.odbc.hooks.odbc" title="(in apache-airflow-providers-odbc v3.1.1)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.odbc.hooks.odbc</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-odbc"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-odbc</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://github.com/mkleehammer/pyodbc/wiki">ODBC</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="samba">
-<h3>Samba<a class="headerlink" href="#samba" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-samba/stable/_api/airflow/providers/samba/hooks/samba/index.html#module-airflow.providers.samba.hooks.samba" title="(in apache-airflow-providers-samba v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.samba.hooks.samba</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-samba"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-samba</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.samba.org/">Samba</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="secure-shell-ssh">
-<h3>Secure Shell (SSH)<a class="headerlink" href="#secure-shell-ssh" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-ssh/stable/_api/airflow/providers/ssh/operators/ssh/index.html#module-airflow.providers.ssh.operators.ssh" title="(in apache-airflow-providers-ssh v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.ssh.operators.ssh</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-ssh/stable/_api/airflow/providers/ssh/hooks/ssh/index.html#module-airflow.providers.ssh.hooks.ssh" title="(in apache-airflow-providers-ssh v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.ssh.hooks.ssh</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-ssh"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-ssh</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://tools.ietf.org/html/rfc4251">Secure Shell (SSH)</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="ssh-file-transfer-protocol-sftp">
-<h3>SSH File Transfer Protocol (SFTP)<a class="headerlink" href="#ssh-file-transfer-protocol-sftp" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-sftp/stable/_api/airflow/providers/sftp/operators/sftp/index.html#module-airflow.providers.sftp.operators.sftp" title="(in apache-airflow-providers-sftp v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.sftp.operators.sftp</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Location URI used to determine the location type (S3, SMB, NFS, EFS).</p></li>
+<li><p><strong>create_location_kwargs</strong> -- Passed to <code class="docutils literal notranslate"><span class="pre">boto.create_location_xyz()</span></code>.
+See AWS boto3 datasync documentation.</p></li>
+</ul>
</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-sftp/stable/_api/airflow/providers/sftp/hooks/sftp/index.html#module-airflow.providers.sftp.hooks.sftp" title="(in apache-airflow-providers-sftp v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.sftp.hooks.sftp</span></code></a>.</p>
+<dt class="field-even">Return str</dt>
+<dd class="field-even"><p>LocationArn of the created Location.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-sftp"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-sftp</span></code></a></p>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowException</strong> -- If location type (prefix from <code class="docutils literal notranslate"><span class="pre">location_uri</span></code>) is invalid.</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
</dd>
</dl>
-</div>
-<div class="section" id="windows-powershell-remoting-protocol">
-<h3>Windows PowerShell Remoting Protocol<a class="headerlink" href="#windows-powershell-remoting-protocol" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">
+<span class="sig-name descname"><span class="pre">get_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">case_sensitive</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ignore_trailing_slash</span>< [...]
+<dd><p>Return all LocationArns which match a LocationUri.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-psrp/stable/_api/airflow/providers/microsoft/psrp/operators/psrp/index.html#module-airflow.providers.microsoft.psrp.operators.psrp" title="(in apache-airflow-providers-microsoft-psrp v2.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.psrp.operators.psrp</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Location URI to search for, eg <code class="docutils literal notranslate"><span class="pre">s3://mybucket/mypath</span></code></p></li>
+<li><p><strong>case_sensitive</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Do a case sensitive search for location URI.</p></li>
+<li><p><strong>ignore_trailing_slash</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Ignore / at the end of URI when matching.</p></li>
+</ul>
</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-psrp/stable/_api/airflow/providers/microsoft/psrp/hooks/psrp/index.html#module-airflow.providers.microsoft.psrp.hooks.psrp" title="(in apache-airflow-providers-microsoft-psrp v2.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.psrp.hooks.psrp</span></code></a>.</p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of LocationArns.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-psrp"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-psrp</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)">list</a>(<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>)</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.microsoft.com/en-us/openspecs/windows_protocols/ms-psrp/">Windows PowerShell Remoting Protocol</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- if <code class="docutils literal notranslate"><span class="pre">location_uri</span></code> is empty</p>
</dd>
</dl>
-</div>
-<div class="section" id="windows-remote-management-winrm">
-<h3>Windows Remote Management (WinRM)<a class="headerlink" href="#windows-remote-management-winrm" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">
+<span class="sig-name descname"><span class="pre">create_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="ref [...]
+<dd><p>Create a Task between the specified source and destination LocationArns.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-winrm/stable/_api/airflow/providers/microsoft/winrm/operators/winrm/index.html#module-airflow.providers.microsoft.winrm.operators.winrm" title="(in apache-airflow-providers-microsoft-winrm v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.winrm.operators.winrm</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-winrm/stable/_api/airflow/providers/microsoft/winrm/hooks/winrm/index.html#module-airflow.providers.microsoft.winrm.hooks.winrm" title="(in apache-airflow-providers-microsoft-winrm v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.winrm.hooks.winrm</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-winrm/stable/operators.html" title="(in apache-airflow-providers-microsoft-winrm v3.0.0)"><span>Microsoft WinRM Operators</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Source LocationArn. Must exist already.</p></li>
+<li><p><strong>destination_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Destination LocationArn. Must exist already.</p></li>
+<li><p><strong>create_task_kwargs</strong> -- Passed to <code class="docutils literal notranslate"><span class="pre">boto.create_task()</span></code>. See AWS boto3 datasync documentation.</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-winrm"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-winrm</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskArn of the created Task</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.microsoft.com/en-us/windows/win32/winrm/portal">Windows Remote Management (WinRM)</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
</dd>
</dl>
-</div>
-</div>
-<div class="section" id="transfers">
-<h2>Transfers<a class="headerlink" href="#transfers" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to copy data.</p>
-<div class="section" id="internet-message-access-protocol-imap-to-amazon-simple-storage-service-s3">
-<h3>Internet Message Access Protocol (IMAP) to Amazon Simple Storage Service (S3)<a class="headerlink" href="#internet-message-access-protocol-imap-to-amazon-simple-storage-service-s3" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">
+<span class="sig-name descname"><span class="pre">update_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">update_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHo [...]
+<dd><p>Update a Task.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/html/rfc3501">Internet Message Access Protocol (IMAP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/imap_attachment_to_s3.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Imap Attachment to Amazon S3</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/imap_attachment_to_s3/index.html#module-airflow.providers.amazon.aws.transfers.imap_attachment_to_s3" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.imap_attachment_to_s3</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The TaskArn to update.</p></li>
+<li><p><strong>update_task_kwargs</strong> -- Passed to <code class="docutils literal notranslate"><span class="pre">boto.update_task()</span></code>, See AWS boto3 datasync documentation.</p></li>
+</ul>
</dd>
</dl>
-</div>
-<div class="section" id="amazon-simple-storage-service-s3-to-ssh-file-transfer-protocol-sftp">
-<h3>Amazon Simple Storage Service (S3) to SSH File Transfer Protocol (SFTP)<a class="headerlink" href="#amazon-simple-storage-service-s3-to-ssh-file-transfer-protocol-sftp" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">
+<span class="sig-name descname"><span class="pre">delete_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.delete_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Delete a Task.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/s3_to_sftp.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Amazon S3 to SFTP</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/s3_to_sftp/index.html#module-airflow.providers.amazon.aws.transfers.s3_to_sftp" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.s3_to_sftp</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The TaskArn to delete.</p>
</dd>
</dl>
-</div>
-<div class="section" id="ssh-file-transfer-protocol-sftp-to-amazon-simple-storage-service-s3">
-<h3>SSH File Transfer Protocol (SFTP) to Amazon Simple Storage Service (S3)<a class="headerlink" href="#ssh-file-transfer-protocol-sftp-to-amazon-simple-storage-service-s3" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">
+<span class="sig-name descname"><span class="pre">get_task_arns_for_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arns</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arns</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task [...]
+<dd><p>Return list of TaskArns for which use any one of the specified
+source LocationArns and any one of the specified destination LocationArns.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)"><em>list</em></a>) -- List of source LocationArns.</p></li>
+<li><p><strong>destination_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)"><em>list</em></a>) -- List of destination LocationArns.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/sftp_to_s3.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>SFTP to Amazon S3</span></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>list</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/sftp_to_s3/index.html#module-airflow.providers.amazon.aws.transfers.sftp_to_s3" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.sftp_to_s3</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)">list</a>(TaskArns)</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- if <code class="docutils literal notranslate"><span class="pre">source_location_arns</span></code> or <code class="docutils literal notranslate"><span class="pre">destination_location_arns</span></code> are empty.</p>
</dd>
</dl>
-</div>
-<div class="section" id="amazon-simple-storage-service-s3-to-file-transfer-protocol-ftp">
-<h3>Amazon Simple Storage Service (S3) to File Transfer Protocol (FTP)<a class="headerlink" href="#amazon-simple-storage-service-s3-to-file-transfer-protocol-ftp" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">
+<span class="sig-name descname"><span class="pre">start_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook. [...]
+<dd><p>Start a TaskExecution for the specified task_arn.
+Each task can have at most one TaskExecution.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://tools.ietf.org/html/rfc114">File Transfer Protocol (FTP)</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskArn</p></li>
+<li><p><strong>kwargs</strong> -- kwargs sent to <code class="docutils literal notranslate"><span class="pre">boto3.start_task_execution()</span></code></p></li>
+</ul>
</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/s3_to_ftp.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Amazon S3 to FTP</span></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskExecutionArn</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/s3_to_ftp/index.html#module-airflow.providers.amazon.aws.transfers.s3_to_ftp" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.s3_to_ftp</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><ul class="simple">
+<li><p><strong>ClientError</strong> -- If a TaskExecution is already busy running for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p></li>
+<li><p><strong>AirflowBadRequest</strong> -- If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p></li>
+</ul>
</dd>
</dl>
-</div>
-<div class="section" id="file-transfer-protocol-ftp-to-amazon-simple-storage-service-s3">
-<h3>File Transfer Protocol (FTP) to Amazon Simple Storage Service (S3)<a class="headerlink" href="#file-transfer-protocol-ftp-to-amazon-simple-storage-service-s3" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">
+<span class="sig-name descname"><span class="pre">cancel_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.cancel_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Cancel a TaskExecution for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/html/rfc114">File Transfer Protocol (FTP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/ftp_to_s3.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>FTP to Amazon S3</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskExecutionArn.</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/ftp_to_s3/index.html#module-airflow.providers.amazon.aws.transfers.ftp_to_s3" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.ftp_to_s3</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
</dd>
</dl>
-</div>
-<div class="section" id="apache-hive-to-samba">
-<h3>Apache Hive to Samba<a class="headerlink" href="#apache-hive-to-samba" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">
+<span class="sig-name descname"><span class="pre">get_task_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pr [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskArn</p>
</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://www.samba.org/">Samba</a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task.</p>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/hive_to_samba/index.html#module-airflow.providers.apache.hive.transfers.hive_to_samba" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.hive_to_samba</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a></p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
</dd>
</dl>
-</div>
-<div class="section" id="google-cloud-storage-gcs-to-ssh-file-transfer-protocol-sftp">
-<h3>Google Cloud Storage (GCS) to SSH File Transfer Protocol (SFTP)<a class="headerlink" href="#google-cloud-storage-gcs-to-ssh-file-transfer-protocol-sftp" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">
+<span class="sig-name descname"><span class="pre">describe_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.describe_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" h [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskExecutionArn</p>
</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task execution.</p>
</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/operators/transfer/gcs_to_sftp.html" title="(in apache-airflow-providers-google v8.3.0)"><span>Google Cloud Storage Transfer Operator to SFTP</span></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a></p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/gcs_to_sftp/index.html#module-airflow.providers.google.cloud.transfers.gcs_to_sftp" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.gcs_to_sftp</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
</dd>
</dl>
-</div>
-<div class="section" id="ssh-file-transfer-protocol-sftp-to-google-cloud-storage-gcs">
-<h3>SSH File Transfer Protocol (SFTP) to Google Cloud Storage (GCS)<a class="headerlink" href="#ssh-file-transfer-protocol-sftp-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">
+<span class="sig-name descname"><span class="pre">get_current_task_execution_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_current_task_execution_arn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
+<dd><p>Get current TaskExecutionArn (if one exists) for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskArn</p>
</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/operators/transfer/sftp_to_gcs.html" title="(in apache-airflow-providers-google v8.3.0)"><span>SFTP to Google Cloud Storage Transfer Operator</span></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>CurrentTaskExecutionArn for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> or None.</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/sftp_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.sftp_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.sftp_to_gcs</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> -- if <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
</dd>
</dl>
-</div>
-<div class="section" id="ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage">
-<h3>SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage<a class="headerlink" href="#ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">
+<span class="sig-name descname"><span class="pre">wait_for_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_iterations</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">60</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../. [...]
+<dd><p>Wait for Task Execution status to be complete (SUCCESS/ERROR).
+The <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> must exist, or a boto3 ClientError will be raised.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- TaskExecutionArn</p></li>
+<li><p><strong>max_iterations</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.10)"><em>int</em></a>) -- Maximum number of iterations before timing out.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/sftp_to_wasb.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure Blob Storage Transfer Operator</span></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Result of task execution.</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/sftp_to_wasb/index.html#module-airflow.providers.microsoft.azure.transfers.sftp_to_wasb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.sftp_to_wasb</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)">bool</a></p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><ul class="simple">
+<li><p><strong>AirflowTaskTimeout</strong> -- If maximum iterations is exceeded.</p></li>
+<li><p><strong>AirflowBadRequest</strong> -- If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p></li>
+</ul>
</dd>
</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Google" href="google.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Services" href="services.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -1010,31 +977,29 @@ communication protocols or interface.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Protocol integrations</a><ul>
-<li><a class="reference internal" href="#protocols">Protocols</a><ul>
-<li><a class="reference internal" href="#file-transfer-protocol-ftp">File Transfer Protocol (FTP)</a></li>
-<li><a class="reference internal" href="#grpc">gRPC</a></li>
-<li><a class="reference internal" href="#hypertext-transfer-protocol-http">Hypertext Transfer Protocol (HTTP)</a></li>
-<li><a class="reference internal" href="#internet-message-access-protocol-imap">Internet Message Access Protocol (IMAP)</a></li>
-<li><a class="reference internal" href="#java-database-connectivity-jdbc">Java Database Connectivity (JDBC)</a></li>
-<li><a class="reference internal" href="#odbc">ODBC</a></li>
-<li><a class="reference internal" href="#samba">Samba</a></li>
-<li><a class="reference internal" href="#secure-shell-ssh">Secure Shell (SSH)</a></li>
-<li><a class="reference internal" href="#ssh-file-transfer-protocol-sftp">SSH File Transfer Protocol (SFTP)</a></li>
-<li><a class="reference internal" href="#windows-powershell-remoting-protocol">Windows PowerShell Remoting Protocol</a></li>
-<li><a class="reference internal" href="#windows-remote-management-winrm">Windows Remote Management (WinRM)</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">DataSyncHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">TASK_EXECUTION_INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">TASK_EXECUTION_FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">TASK_EXECUTION_SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">create_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">get_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">create_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">update_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">delete_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">get_task_arns_for_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">start_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">cancel_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">get_task_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">describe_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">get_current_task_execution_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">wait_for_task_execution</a></li>
+</ul>
+</li>
</ul>
</li>
-<li><a class="reference internal" href="#transfers">Transfers</a><ul>
-<li><a class="reference internal" href="#internet-message-access-protocol-imap-to-amazon-simple-storage-service-s3">Internet Message Access Protocol (IMAP) to Amazon Simple Storage Service (S3)</a></li>
-<li><a class="reference internal" href="#amazon-simple-storage-service-s3-to-ssh-file-transfer-protocol-sftp">Amazon Simple Storage Service (S3) to SSH File Transfer Protocol (SFTP)</a></li>
-<li><a class="reference internal" href="#ssh-file-transfer-protocol-sftp-to-amazon-simple-storage-service-s3">SSH File Transfer Protocol (SFTP) to Amazon Simple Storage Service (S3)</a></li>
-<li><a class="reference internal" href="#amazon-simple-storage-service-s3-to-file-transfer-protocol-ftp">Amazon Simple Storage Service (S3) to File Transfer Protocol (FTP)</a></li>
-<li><a class="reference internal" href="#file-transfer-protocol-ftp-to-amazon-simple-storage-service-s3">File Transfer Protocol (FTP) to Amazon Simple Storage Service (S3)</a></li>
-<li><a class="reference internal" href="#apache-hive-to-samba">Apache Hive to Samba</a></li>
-<li><a class="reference internal" href="#google-cloud-storage-gcs-to-ssh-file-transfer-protocol-sftp">Google Cloud Storage (GCS) to SSH File Transfer Protocol (SFTP)</a></li>
-<li><a class="reference internal" href="#ssh-file-transfer-protocol-sftp-to-google-cloud-storage-gcs">SSH File Transfer Protocol (SFTP) to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage">SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage</a></li>
</ul>
</li>
</ul>
@@ -1061,7 +1026,7 @@ communication protocols or interface.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/operators-and-hooks-ref/protocol.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/datasync/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -1195,18 +1160,18 @@ communication protocols or interface.</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dms/index.html
similarity index 73%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dms/index.html
index 3f4eedb5bd..c02035d627 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dms/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.dms — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,190 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dms">
+<span id="airflow-providers-amazon-aws-hooks-dms"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dms" title="airflow.providers.amazon.aws.hooks.dms"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dms" title="Permalink to this heading">¶</a></h1>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus</span></code></a></p></td>
+<td><p>Available AWS DMS Task Waiter statuses.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook" title="airflow.providers.amazon.aws.hooks.dms.DmsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsHook</span></code></a></p></td>
+<td><p>Interact with AWS Database Migration Service.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsTaskWaiterStatus</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="heade [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">str</span></code></a>, <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Available AWS DMS Task Waiter statuses.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">
+<span class="sig-name descname"><span class="pre">DELETED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">deleted</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.DELETED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED" titl [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">
+<span class="sig-name descname"><span class="pre">READY</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ready</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.READY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY" title="Perma [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">running</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING" titl [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">stopped</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED" titl [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Database Migration Service.</p>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">
+<span class="sig-name descname"><span class="pre">describe_replication_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.describe_replication_tasks"><span class="viewcode-link"><span class="pre">[source]</span> [...]
+<dd><p>Describe replication tasks</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>Marker and list of replication tasks</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>(Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>], <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)">list</a>)</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">
+<span class="sig-name descname"><span class="pre">find_replication_tasks_by_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">without_settings</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" hre [...]
+<dd><p>Find and describe replication tasks by task ARN
+:param replication_task_arn: Replication task arn
+:param without_settings: Indicates whether to return task information with settings.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>list of replication tasks that match the ARN</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">
+<span class="sig-name descname"><span class="pre">get_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.get_task_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Retrieve task status.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication task ARN</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Current task status</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Optional[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">
+<span class="sig-name descname"><span class="pre">create_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">source_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">replication_instance_arn</spa [...]
+<dd><p>Create DMS replication task</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication task id</p></li>
+<li><p><strong>source_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Source endpoint ARN</p></li>
+<li><p><strong>target_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Target endpoint ARN</p></li>
+<li><p><strong>replication_instance_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication instance ARN</p></li>
+<li><p><strong>table_mappings</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)"><em>dict</em></a>) -- Table mappings</p></li>
+<li><p><strong>migration_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Migration type ('full-load'|'cdc'|'full-load-and-cdc'), full-load by default.</p></li>
</ul>
-</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Replication task ARN</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">
+<span class="sig-name descname"><span class="pre">start_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">start_replication_task_type</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class=" [...]
+<dd><p>Starts replication task.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication task ARN</p></li>
+<li><p><strong>start_replication_task_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication task start type (default='start-replication')
+('start-replication'|'resume-processing'|'reload-target')</p></li>
</ul>
-</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">
+<span class="sig-name descname"><span class="pre">stop_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.stop_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Stops replication task.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> -- Replication task ARN</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">
+<span class="sig-name descname"><span class="pre">delete_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.delete_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Starts replication task deletion and waits for it to be deleted</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> -- Replication task ARN</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">
+<span class="sig-name descname"><span class="pre">wait_for_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.wait_for_task_status"><span class="viewcode-link [...]
+<dd><p>Waits for replication task to reach status.
+Supported statuses: deleted, ready, running, stopped.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>status</strong> (<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><em>DmsTaskWaiterStatus</em></a>) -- Status to wait for</p></li>
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- Replication task ARN</p></li>
</ul>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
-</ul>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +849,31 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">DmsTaskWaiterStatus</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">DELETED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">READY</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">STOPPED</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook">DmsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">describe_replication_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">find_replication_tasks_by_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">get_task_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">create_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">start_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">stop_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">delete_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">wait_for_task_status</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +898,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dms/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +1032,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
similarity index 85%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
index 3f4eedb5bd..3d5c6d8d70 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.dynamodb — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,63 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
-</ul>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dynamodb">
+<span id="airflow-providers-amazon-aws-hooks-dynamodb"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="airflow.providers.amazon.aws.hooks.dynamodb"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="Permalink to this heading">¶</a></h1>
+<p>This module contains the AWS DynamoDB hook</p>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook" title="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DynamoDBHook</span></code></a></p></td>
+<td><p>Interact with AWS DynamoDB.</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb.</span></span><span class="sig-name descname"><span class="pre">DynamoDBHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ta [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS DynamoDB.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
-</ul>
-</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>table_keys</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- partition key and sort key</p></li>
+<li><p><strong>table_name</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- target DynamoDB table</p></li>
</ul>
+</dd>
+</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">
+<span class="sig-name descname"><span class="pre">write_batch_data</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">items</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dynamodb.html#DynamoDBHook.write_batch_data"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Write batch items to DynamoDB table with provisioned throughout capacity.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
-</ul>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +722,17 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">DynamoDBHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">write_batch_data</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +757,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +891,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
similarity index 73%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
index 3f4eedb5bd..b2e70675e3 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.ec2 — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,234 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
-</ul>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ec2">
+<span id="airflow-providers-amazon-aws-hooks-ec2"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="airflow.providers.amazon.aws.hooks.ec2"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="Permalink to this heading">¶</a></h1>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook" title="airflow.providers.amazon.aws.hooks.ec2.EC2Hook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EC2Hook</span></code></a></p></td>
+<td><p>Interact with AWS EC2 Service.</p></td>
+</tr>
+</tbody>
+</table>
</div>
-<div class="section" id="google">
-<h2>Google<a class="headerlink" href="#google" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/secrets/secret_manager/index.html#airflow.providers.google.cloud.secrets.secret_manager.CloudSecretManagerBackend" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">CloudSecretManagerBackend</span></code></a></p></li>
-</ul>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type" title="airflow.providers.amazon.aws.hooks.ec2.only_client_type"><code class="xref py py-obj docutils literal notranslate"><span class="pre">only_client_type</span></code></a>(func)</p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.only_client_type">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">only_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">func</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#only_client_type"><span class="viewcode-link"><s [...]
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">EC2Hook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">api_type</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'resource_type'</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS EC2 Service.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="hashicorp">
-<h2>Hashicorp<a class="headerlink" href="#hashicorp" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-hashicorp/stable/_api/airflow/providers/hashicorp/secrets/vault/index.html#airflow.providers.hashicorp.secrets.vault.VaultBackend" title="(in apache-airflow-providers-hashicorp v3.1.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">VaultBackend</span></code></a></p></li>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">
+<span class="sig-name descname"><span class="pre">API_TYPES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.API_TYPES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">
+<span class="sig-name descname"><span class="pre">get_instance</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/air [...]
+<dd><p>Get EC2 instance by id and return it.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- id of the AWS EC2 instance</p></li>
+<li><p><strong>filters</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of filters to specify instances to get</p></li>
</ul>
-</div>
-<div class="section" id="microsoft-azure">
-<h2>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/secrets/key_vault/index.html#airflow.providers.microsoft.azure.secrets.key_vault.AzureKeyVaultBackend" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></a></p></li>
-<li><p><code class="xref py py-class docutils literal notranslate"><span class="pre">AzureKeyVaultBackend</span></code></p></li>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Instance object</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>ec2.Instance</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">
+<span class="sig-name descname"><span class="pre">stop_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.stop_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Stop instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)"><em>list</em></a>) -- List of instance ids to stop</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StoppingInstances</cite> and value as list of instances being stopped</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">
+<span class="sig-name descname"><span class="pre">start_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.start_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.a [...]
+<dd><p>Start instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)"><em>list</em></a>) -- List of instance ids to start</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StartingInstances</cite> and value as list of instances being started</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">
+<span class="sig-name descname"><span class="pre">terminate_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.terminate_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Terminate instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)"><em>list</em></a>) -- List of instance ids to terminate</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>TerminatingInstances</cite> and value as list of instances being terminated</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.10)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">
+<span class="sig-name descname"><span class="pre">describe_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None [...]
+<dd><p>Describe EC2 instances, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>filters</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of filters to specify instances to describe</p></li>
+<li><p><strong>instance_ids</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of instance IDs to describe</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Response from EC2 describe_instances API</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">
+<span class="sig-name descname"><span class="pre">get_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get list of instance details, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_ids</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of ids to get instances for</p></li>
+<li><p><strong>filters</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of filters to specify instances to get</p></li>
</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instances</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)">list</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">
+<span class="sig-name descname"><span class="pre">get_instance_ids</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_ids"><span class="view [...]
+<dd><p>Get list of instance ids, optionally applying filters to fetch selective instances</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>filters</strong> (<em>Optional</em><em>[</em><em>List</em><em>]</em>) -- List of filters to specify instances to get</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instance ids</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.10)">list</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">
+<span class="sig-name descname"><span class="pre">get_instance_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Get EC2 instance state by id and return it.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- id of the AWS EC2 instance</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>current state of the instance</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">
+<span class="sig-name descname"><span class="pre">wait_for_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_state</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">check_interval</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/ [...]
+<dd><p>Wait EC2 instance until its state is equal to the target_state.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- id of the AWS EC2 instance</p></li>
+<li><p><strong>target_state</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- target state of instance</p></li>
+<li><p><strong>check_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.10)"><em>float</em></a>) -- time in seconds that the job should wait in
+between each instance state checks until operation is completed</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Writing logs" href="logging.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Community Providers" href="../howto/create-update-providers.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -672,11 +893,28 @@ provided by the community-managed providers:</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Secret backends</a><ul>
-<li><a class="reference internal" href="#amazon">Amazon</a></li>
-<li><a class="reference internal" href="#google">Google</a></li>
-<li><a class="reference internal" href="#hashicorp">Hashicorp</a></li>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type">only_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook">EC2Hook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">API_TYPES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">get_instance</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">stop_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">start_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">terminate_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">describe_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">get_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">get_instance_ids</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">get_instance_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">wait_for_state</a></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</li>
</ul>
</li>
</ul>
@@ -701,7 +939,7 @@ provided by the community-managed providers:</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/core-extensions/secrets-backends.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ec2/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -835,18 +1073,18 @@ provided by the community-managed providers:</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
similarity index 61%
copy from docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
index 26b47bd72c..5b774218f9 100644
--- a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/apache.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>ASF: Apache Software Foundation — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="AWS: Amazon Web Services" href="aws.html" />
- <link rel="prev" title="Operators and Hooks Reference" href="index.html" />
+ <title>airflow.providers.amazon.aws.hooks.ecs — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,23 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2 current"><a class="current reference internal" href="#">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -408,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -439,23 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2 current"><a class="current reference internal" href="#">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="azure.html">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -544,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Operators and Hooks Reference</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="apache.html"> ASF: Apache Software Foundation</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a></li>
</ul>
</div>
@@ -559,418 +596,342 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="asf-apache-software-foundation">
-<h1>ASF: Apache Software Foundation<a class="headerlink" href="#asf-apache-software-foundation" title="Permalink to this heading">¶</a></h1>
-<p>Airflow supports various software created by <a class="reference external" href="https://www.apache.org/foundation/">Apache Software Foundation</a>.</p>
-<div class="section" id="software">
-<h2>Software<a class="headerlink" href="#software" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within software developed by Apache Software
-Foundation.</p>
-<div class="section" id="apache-beam">
-<h3>Apache Beam<a class="headerlink" href="#apache-beam" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/_api/airflow/providers/apache/beam/operators/beam/index.html#module-airflow.providers.apache.beam.operators.beam" title="(in apache-airflow-providers-apache-beam v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.beam.operators.beam</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/_api/airflow/providers/apache/beam/hooks/beam/index.html#module-airflow.providers.apache.beam.hooks.beam" title="(in apache-airflow-providers-apache-beam v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.beam.hooks.beam</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-beam/stable/operators.html" title="(in apache-airflow-providers-apache-beam v4.0.0)"><span>Apache Beam Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-beam"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-beam</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://beam.apache.org/">Apache Beam</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="apache-cassandra">
-<h3>Apache Cassandra<a class="headerlink" href="#apache-cassandra" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-cassandra/stable/_api/airflow/providers/apache/cassandra/hooks/cassandra/index.html#module-airflow.providers.apache.cassandra.hooks.cassandra" title="(in apache-airflow-providers-apache-cassandra v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.cassandra.hooks.cassandra</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-cassandra"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-cassandra</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://cassandra.apache.org/">Apache Cassandra</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="apache-drill">
-<h3>Apache Drill<a class="headerlink" href="#apache-drill" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/_api/airflow/providers/apache/drill/operators/drill/index.html#module-airflow.providers.apache.drill.operators.drill" title="(in apache-airflow-providers-apache-drill v2.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.drill.operators.drill</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/_api/airflow/providers/apache/drill/hooks/drill/index.html#module-airflow.providers.apache.drill.hooks.drill" title="(in apache-airflow-providers-apache-drill v2.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.drill.hooks.drill</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-drill/stable/operators.html" title="(in apache-airflow-providers-apache-drill v2.2.0)"><span>Apache Drill Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-drill"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-drill</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://drill.apache.org/">Apache Drill</a></p>
-</dd>
-</dl>
-</div>
-<div class="section" id="apache-druid">
-<h3>Apache Druid<a class="headerlink" href="#apache-druid" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/operators/druid/index.html#module-airflow.providers.apache.druid.operators.druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.operators.druid</span></code></a>, <a class="reference external" href="/docs/apache-airflow-provi [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/hooks/druid/index.html#module-airflow.providers.apache.druid.hooks.druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.hooks.druid</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/operators.html" title="(in apache-airflow-providers-apache-druid v3.2.0)"><span>Apache Druid Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-druid"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-druid</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://druid.apache.org/">Apache Druid</a></p>
-</dd>
-</dl>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ecs">
+<span id="airflow-providers-amazon-aws-hooks-ecs"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="airflow.providers.amazon.aws.hooks.ecs"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="Permalink to this heading">¶</a></h1>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Cluster.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task Definition.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook" title="airflow.providers.amazon.aws.hooks.ecs.EcsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsHook</span></code></a></p></td>
+<td><p>Interact with AWS Elastic Container Service, using the boto3 library</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskLogFetcher</span></code></a></p></td>
+<td><p>Fetches Cloudwatch log events with specific interval as a thread</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol" title="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on</p></td>
+</tr>
+</tbody>
+</table>
</div>
-<div class="section" id="apache-hive">
-<h3>Apache Hive<a class="headerlink" href="#apache-hive" title="Permalink to this heading">¶</a></h3>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry" title="airflow.providers.amazon.aws.hooks.ecs.should_retry"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ECS resource quota (CPU, MEM).</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni" title="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry_eni</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ENI (Elastic Network Interfaces).</p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry"><span class="viewcode-link"><span [...]
+<dd><p>Check if exception is related to ECS resource quota (CPU, MEM).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/operators/hive/index.html#module-airflow.providers.apache.hive.operators.hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.operators.hive</span></code></a>, <a class="reference external" href="/docs/apache-airflow-providers-apa [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/hooks/hive/index.html#module-airflow.providers.apache.hive.hooks.hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.hooks.hive</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/operators.html" title="(in apache-airflow-providers-apache-hive v4.0.0)"><span>Apache Hive Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-kylin">
-<h3>Apache Kylin<a class="headerlink" href="#apache-kylin" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry_eni</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry_eni"><span class="viewcode-lin [...]
+<dd><p>Check if exception is related to ENI (Elastic Network Interfaces).</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-kylin/stable/_api/airflow/providers/apache/kylin/operators/kylin_cube/index.html#module-airflow.providers.apache.kylin.operators.kylin_cube" title="(in apache-airflow-providers-apache-kylin v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.kylin.operators.kylin_cube</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-kylin/stable/_api/airflow/providers/apache/kylin/hooks/kylin/index.html#module-airflow.providers.apache.kylin.hooks.kylin" title="(in apache-airflow-providers-apache-kylin v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.kylin.hooks.kylin</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-kylin"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-kylin</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://kylin.apache.org/">Apache Kylin</a></p>
-</dd>
</dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsClusterStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Cluster.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE" title="Permali [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">PROVISIONING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROV [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DEPROVISIONING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterState [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">
+<span class="sig-name descname"><span class="pre">FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED" title="Permali [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">INACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE" title= [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskDefinitionStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a clas [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task Definition.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE" [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">INACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.IN [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">PROVISIONING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONI [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">
+<span class="sig-name descname"><span class="pre">PENDING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">PENDING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PENDING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING" title="Permalink [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">
+<span class="sig-name descname"><span class="pre">ACTIVATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.ACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING" titl [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">RUNNING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING" title="Permalink [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">
+<span class="sig-name descname"><span class="pre">DEACTIVATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DEACTIVATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATI [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">
+<span class="sig-name descname"><span class="pre">STOPPING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">STOPPING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING" title="Perma [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DEPROVISIONING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPR [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">STOPPED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED" title="Permalink [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">
+<span class="sig-name descname"><span class="pre">NONE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">NONE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.NONE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE" title="Permalink to this def [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook</span></code></a></p>
+<p>Interact with AWS Elastic Container Service, using the boto3 library
+Hook attribute <cite>conn</cite> has all methods that listed in documentation</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/AmazonECS/latest/APIReference/Welcome.html">https://docs.aws.amazon.com/AmazonECS/latest/APIReference/Welcome.html</a></p></li>
+</ul>
</div>
-<div class="section" id="apache-livy">
-<h3>Apache Livy<a class="headerlink" href="#apache-livy" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/_api/airflow/providers/apache/livy/operators/livy/index.html#module-airflow.providers.apache.livy.operators.livy" title="(in apache-airflow-providers-apache-livy v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.operators.livy</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/_api/airflow/providers/apache/livy/hooks/livy/index.html#module-airflow.providers.apache.livy.hooks.livy" title="(in apache-airflow-providers-apache-livy v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-livy/stable/operators.html" title="(in apache-airflow-providers-apache-livy v3.1.0)"><span>Apache Livy Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-livy"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-livy</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://livy.apache.org/">Apache Livy</a></p>
+<dl class="simple">
+<dt>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code> or <code class="docutils literal notranslate"><span class="pre">region_name</span></code>) may be specified and</dt><dd><p>are passed down to the underlying AwsBaseHook.</p>
</dd>
</dl>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a></p>
</div>
-<div class="section" id="apache-pig">
-<h3>Apache Pig<a class="headerlink" href="#apache-pig" title="Permalink to this heading">¶</a></h3>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/_api/airflow/providers/apache/pig/operators/pig/index.html#module-airflow.providers.apache.pig.operators.pig" title="(in apache-airflow-providers-apache-pig v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pig.operators.pig</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/_api/airflow/providers/apache/pig/hooks/pig/index.html#module-airflow.providers.apache.pig.hooks.pig" title="(in apache-airflow-providers-apache-pig v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pig.hooks.pig</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pig/stable/operators.html" title="(in apache-airflow-providers-apache-pig v3.0.0)"><span>Apache Pig Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-pig"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-pig</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://pig.apache.org/">Apache Pig</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>aws_conn_id</strong> -- The Airflow connection used for AWS credentials.</p>
</dd>
</dl>
-</div>
-<div class="section" id="apache-pinot">
-<h3>Apache Pinot<a class="headerlink" href="#apache-pinot" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-pinot/stable/_api/airflow/providers/apache/pinot/hooks/pinot/index.html#module-airflow.providers.apache.pinot.hooks.pinot" title="(in apache-airflow-providers-apache-pinot v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.pinot.hooks.pinot</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-pinot"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-pinot</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://pinot.apache.org/">Apache Pinot</a></p>
-</dd>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">
+<span class="sig-name descname"><span class="pre">get_cluster_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_cluster_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amaz [...]
+<dd><dl class="field-list simple">
</dl>
-</div>
-<div class="section" id="apache-spark">
-<h3>Apache Spark<a class="headerlink" href="#apache-spark" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/_api/airflow/providers/apache/spark/operators/spark_jdbc/index.html#module-airflow.providers.apache.spark.operators.spark_jdbc" title="(in apache-airflow-providers-apache-spark v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.spark.operators.spark_jdbc</span></code></a>, <a class="reference external" href="/docs/apach [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/_api/airflow/providers/apache/spark/hooks/spark_jdbc/index.html#module-airflow.providers.apache.spark.hooks.spark_jdbc" title="(in apache-airflow-providers-apache-spark v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.spark.hooks.spark_jdbc</span></code></a>, <a class="reference external" href="/docs/apache-airflow-p [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-spark/stable/operators.html" title="(in apache-airflow-providers-apache-spark v3.0.0)"><span>Apache Spark Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-spark"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-spark</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://spark.apache.org/">Apache Spark</a></p>
-</dd>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">
+<span class="sig-name descname"><span class="pre">get_task_definition_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_definition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_definition_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><dl class="field-list simple">
</dl>
-</div>
-<div class="section" id="apache-sqoop">
-<h3>Apache Sqoop<a class="headerlink" href="#apache-sqoop" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/_api/airflow/providers/apache/sqoop/operators/sqoop/index.html#module-airflow.providers.apache.sqoop.operators.sqoop" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.sqoop.operators.sqoop</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/_api/airflow/providers/apache/sqoop/hooks/sqoop/index.html#module-airflow.providers.apache.sqoop.hooks.sqoop" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.sqoop.hooks.sqoop</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-sqoop/stable/operators.html" title="(in apache-airflow-providers-apache-sqoop v3.0.0)"><span>Apache Sqoop Operators</span></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-sqoop"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-sqoop</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://sqoop.apache.org/">Apache Sqoop</a></p>
-</dd>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">
+<span class="sig-name descname"><span class="pre">get_task_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_state"><span class="viewcode-link"><span class="pre">[source [...]
+<dd><dl class="field-list simple">
</dl>
-</div>
-<div class="section" id="hadoop-distributed-file-system-hdfs">
-<h3>Hadoop Distributed File System (HDFS)<a class="headerlink" href="#hadoop-distributed-file-system-hdfs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskLogFetcher</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_group</span></span></em>, <em class="sig-param"><s [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/threading.html#threading.Thread" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">threading.Thread</span></code></a></p>
+<p>Fetches Cloudwatch log events with specific interval as a thread
+and sends the log events to the info channel of the provided logger.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hdfs/stable/_api/airflow/providers/apache/hdfs/hooks/hdfs/index.html#module-airflow.providers.apache.hdfs.hooks.hdfs" title="(in apache-airflow-providers-apache-hdfs v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hdfs.hooks.hdfs</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hdfs"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hdfs</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html">Hadoop Distributed File System (HDFS)</a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="webhdfs">
-<h3>WebHDFS<a class="headerlink" href="#webhdfs" title="Permalink to this heading">¶</a></h3>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">
+<span class="sig-name descname"><span class="pre">run</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.run"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run" title="Permalink to this definition">¶</a></dt>
+<dd><p>Method representing the thread's activity.</p>
+<p>You may override this method in a subclass. The standard run() method
+invokes the callable object passed to the object's constructor as the
+target argument, if any, with sequential and keyword arguments taken
+from the args and kwargs arguments, respectively.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hdfs/stable/_api/airflow/providers/apache/hdfs/hooks/webhdfs/index.html#module-airflow.providers.apache.hdfs.hooks.webhdfs" title="(in apache-airflow-providers-apache-hdfs v3.1.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hdfs.hooks.webhdfs</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hdfs"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hdfs</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS</a></p>
-</dd>
</dl>
-</div>
-</div>
-<div class="section" id="transfers">
-<h2>Transfers<a class="headerlink" href="#transfers" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to copy data from/to software developed by Apache Software
-Foundation.</p>
-<div class="section" id="apache-hive-to-amazon-dynamodb">
-<h3>Apache Hive to Amazon DynamoDB<a class="headerlink" href="#apache-hive-to-amazon-dynamodb" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://aws.amazon.com/dynamodb/">Amazon DynamoDB</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/operators/transfer/hive_to_dynamodb.html" title="(in apache-airflow-providers-amazon v5.0.0)"><span>Apache Hive to Amazon DynamoDB</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/transfers/hive_to_dynamodb/index.html#module-airflow.providers.amazon.aws.transfers.hive_to_dynamodb" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.transfers.hive_to_dynamodb</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-amazon"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-amazon</span></code></a></p>
-</dd>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">
+<span class="sig-name descname"><span class="pre">get_last_log_messages</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">number_messages</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_messages"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#a [...]
+<dd><dl class="field-list simple">
</dl>
-</div>
-<div class="section" id="apache-hive-to-apache-druid">
-<h3>Apache Hive to Apache Druid<a class="headerlink" href="#apache-hive-to-apache-druid" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://druid.apache.org/">Apache Druid</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-druid/stable/_api/airflow/providers/apache/druid/transfers/hive_to_druid/index.html#module-airflow.providers.apache.druid.transfers.hive_to_druid" title="(in apache-airflow-providers-apache-druid v3.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.druid.transfers.hive_to_druid</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-druid"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-druid</span></code></a></p>
-</dd>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">
+<span class="sig-name descname"><span class="pre">get_last_log_message</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_message"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message" title="Permali [...]
+<dd><dl class="field-list simple">
</dl>
-</div>
-<div class="section" id="vertica-to-apache-hive">
-<h3>Vertica to Apache Hive<a class="headerlink" href="#vertica-to-apache-hive" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.vertica.com/">Vertica</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/vertica_to_hive/index.html#module-airflow.providers.apache.hive.transfers.vertica_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.vertica_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">
+<span class="sig-name descname"><span class="pre">is_stopped</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.is_stopped"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped" title="Permalink to this definition">¶</a></dt>
+<dd><dl class="field-list simple">
</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">
+<span class="sig-name descname"><span class="pre">stop</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.stop"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on
+<code class="xref py py-meth docutils literal notranslate"><span class="pre">EcsOperator.client()</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html</a></p></li>
+</ul>
</div>
-<div class="section" id="apache-hive-to-mysql">
-<h3>Apache Hive to MySQL<a class="headerlink" href="#apache-hive-to-mysql" title="Permalink to this heading">¶</a></h3>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">
+<span class="sig-name descname"><span class="pre">run_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.run_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://www.mysql.com/">MySQL</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/hive_to_mysql/index.html#module-airflow.providers.apache.hive.transfers.hive_to_mysql" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.hive_to_mysql</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-hive-to-samba">
-<h3>Apache Hive to Samba<a class="headerlink" href="#apache-hive-to-samba" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsP [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://www.samba.org/">Samba</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/hive_to_samba/index.html#module-airflow.providers.apache.hive.transfers.hive_to_samba" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.hive_to_samba</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="amazon-simple-storage-service-s3-to-apache-hive">
-<h3>Amazon Simple Storage Service (S3) to Apache Hive<a class="headerlink" href="#amazon-simple-storage-service-s3-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">
+<span class="sig-name descname"><span class="pre">describe_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">tasks</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_tasks"><span class="viewcode-link"><span class="pre">[s [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (S3)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/s3_to_hive/index.html#module-airflow.providers.apache.hive.transfers.s3_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.s3_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="mysql-to-apache-hive">
-<h3>MySQL to Apache Hive<a class="headerlink" href="#mysql-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">
+<span class="sig-name descname"><span class="pre">stop_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.mysql.com/">MySQL</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/mysql_to_hive/index.html#module-airflow.providers.apache.hive.transfers.mysql_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.mysql_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="microsoft-sql-server-mssql-to-apache-hive">
-<h3>Microsoft SQL Server (MSSQL) to Apache Hive<a class="headerlink" href="#microsoft-sql-server-mssql-to-apache-hive" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">
+<span class="sig-name descname"><span class="pre">describe_task_definition</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">taskDefinition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_task_definition"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.microsoft.com/en-us/sql-server/sql-server-downloads">Microsoft SQL Server (MSSQL)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://hive.apache.org/">Apache Hive</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-apache-hive/stable/_api/airflow/providers/apache/hive/transfers/mssql_to_hive/index.html#module-airflow.providers.apache.hive.transfers.mssql_to_hive" title="(in apache-airflow-providers-apache-hive v4.0.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.hive.transfers.mssql_to_hive</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-apache-hive"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-apache-hive</span></code></a></p>
-</dd>
</dl>
-</div>
-<div class="section" id="apache-cassandra-to-google-cloud-storage-gcs">
-<h3>Apache Cassandra to Google Cloud Storage (GCS)<a class="headerlink" href="#apache-cassandra-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">
+<span class="sig-name descname"><span class="pre">list_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">launchType</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">desiredStatus</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">family</span></span></em><span class="sig-paren">)</span><a class="re [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="http://cassandra.apache.org/">Apache Cassandra</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/cassandra_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.cassandra_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.cassandra_to_gcs</span></code></a></p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
-</dd>
</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="Operators and Hooks Reference" href="index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="AWS: Amazon Web Services" href="aws.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -1040,33 +1001,62 @@ Foundation.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">ASF: Apache Software Foundation</a><ul>
-<li><a class="reference internal" href="#software">Software</a><ul>
-<li><a class="reference internal" href="#apache-beam">Apache Beam</a></li>
-<li><a class="reference internal" href="#apache-cassandra">Apache Cassandra</a></li>
-<li><a class="reference internal" href="#apache-drill">Apache Drill</a></li>
-<li><a class="reference internal" href="#apache-druid">Apache Druid</a></li>
-<li><a class="reference internal" href="#apache-hive">Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-kylin">Apache Kylin</a></li>
-<li><a class="reference internal" href="#apache-livy">Apache Livy</a></li>
-<li><a class="reference internal" href="#apache-pig">Apache Pig</a></li>
-<li><a class="reference internal" href="#apache-pinot">Apache Pinot</a></li>
-<li><a class="reference internal" href="#apache-spark">Apache Spark</a></li>
-<li><a class="reference internal" href="#apache-sqoop">Apache Sqoop</a></li>
-<li><a class="reference internal" href="#hadoop-distributed-file-system-hdfs">Hadoop Distributed File System (HDFS)</a></li>
-<li><a class="reference internal" href="#webhdfs">WebHDFS</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry">should_retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">should_retry_eni</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">EcsClusterStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">EcsTaskDefinitionStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">EcsTaskStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">PENDING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">ACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">DEACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">STOPPING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">STOPPED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">NONE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook">EcsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">get_cluster_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">get_task_definition_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">get_task_state</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">EcsTaskLogFetcher</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">run</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">get_last_log_messages</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">get_last_log_message</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">is_stopped</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">stop</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">EcsProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">run_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">describe_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">stop_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">describe_task_definition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">list_tasks</a></li>
+</ul>
+</li>
</ul>
</li>
-<li><a class="reference internal" href="#transfers">Transfers</a><ul>
-<li><a class="reference internal" href="#apache-hive-to-amazon-dynamodb">Apache Hive to Amazon DynamoDB</a></li>
-<li><a class="reference internal" href="#apache-hive-to-apache-druid">Apache Hive to Apache Druid</a></li>
-<li><a class="reference internal" href="#vertica-to-apache-hive">Vertica to Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-hive-to-mysql">Apache Hive to MySQL</a></li>
-<li><a class="reference internal" href="#apache-hive-to-samba">Apache Hive to Samba</a></li>
-<li><a class="reference internal" href="#amazon-simple-storage-service-s3-to-apache-hive">Amazon Simple Storage Service (S3) to Apache Hive</a></li>
-<li><a class="reference internal" href="#mysql-to-apache-hive">MySQL to Apache Hive</a></li>
-<li><a class="reference internal" href="#microsoft-sql-server-mssql-to-apache-hive">Microsoft SQL Server (MSSQL) to Apache Hive</a></li>
-<li><a class="reference internal" href="#apache-cassandra-to-google-cloud-storage-gcs">Apache Cassandra to Google Cloud Storage (GCS)</a></li>
</ul>
</li>
</ul>
@@ -1093,7 +1083,7 @@ Foundation.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/operators-and-hooks-ref/apache.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ecs/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -1227,18 +1217,18 @@ Foundation.</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/azure.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/eks/index.html
similarity index 54%
copy from docs-archive/apache-airflow-providers/operators-and-hooks-ref/azure.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/eks/index.html
index 74dee1c61a..219895a20b 100644
--- a/docs-archive/apache-airflow-providers/operators-and-hooks-ref/azure.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/eks/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Azure: Microsoft Azure — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Google" href="google.html" />
- <link rel="prev" title="AWS: Amazon Web Services" href="aws.html" />
+ <title>airflow.providers.amazon.aws.hooks.eks — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.elasticache_replication_group" href="../elasticache_replication_group/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,23 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -408,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -439,23 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Operators and hooks</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="apache.html">ASF: Apache Software Foundation</a></li>
-<li class="toctree-l2"><a class="reference internal" href="aws.html">AWS: Amazon Web Services</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Azure: Microsoft Azure</a></li>
-<li class="toctree-l2"><a class="reference internal" href="google.html">Google</a></li>
-<li class="toctree-l2"><a class="reference internal" href="protocol.html">Protocol integrations</a></li>
-<li class="toctree-l2"><a class="reference internal" href="services.html">Services</a></li>
-<li class="toctree-l2"><a class="reference internal" href="software.html">Software integrations</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../core-extensions/index.html">Core Extensions</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -544,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Operators and Hooks Reference</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="azure.html"> Azure: Microsoft Azure</a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a></li>
</ul>
</div>
@@ -559,341 +596,539 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="azure-microsoft-azure">
-<h1>Azure: Microsoft Azure<a class="headerlink" href="#azure-microsoft-azure" title="Permalink to this heading">¶</a></h1>
-<p>Airflow has limited support for <a class="reference external" href="https://azure.microsoft.com/">Microsoft Azure</a>.</p>
-<p>Some hooks are based on <a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/base_azure/index.html#module-airflow.providers.microsoft.azure.hooks.base_azure" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.base_azure</span></code></a>
-which authenticate Azure’s Python SDK Clients.</p>
-<div class="section" id="services">
-<h2>Services<a class="headerlink" href="#services" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to perform various operations within the Microsoft Azure.</p>
-<div class="section" id="microsoft-azure">
-<h3>Microsoft Azure<a class="headerlink" href="#microsoft-azure" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/base_azure/index.html#module-airflow.providers.microsoft.azure.hooks.base_azure" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.base_azure</span></code></a>.</p>
-</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
-</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/">Microsoft Azure</a></p>
-</dd>
-</dl>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.eks">
+<span id="airflow-providers-amazon-aws-hooks-eks"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.eks" title="airflow.providers.amazon.aws.hooks.eks"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.eks" title="Permalink to this heading">¶</a></h1>
+<p>Interact with Amazon EKS, using the boto3 library.</p>
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates" title="airflow.providers.amazon.aws.hooks.eks.ClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">ClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Cluster.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates" title="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FargateProfileStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an AWS Fargate profile.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates" title="airflow.providers.amazon.aws.hooks.eks.NodegroupStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">NodegroupStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Managed Nodegroup.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook" title="airflow.providers.amazon.aws.hooks.eks.EksHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EksHook</span></code></a></p></td>
+<td><p>Interact with Amazon EKS, using the boto3 library.</p></td>
+</tr>
+</tbody>
+</table>
</div>
-<div class="section" id="microsoft-azure-batch">
-<h3>Microsoft Azure Batch<a class="headerlink" href="#microsoft-azure-batch" title="Permalink to this heading">¶</a></h3>
-<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/batch/index.html#module-airflow.providers.microsoft.azure.operators.batch" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.batch</span></code></a>, <a class="reference external" href="/docs/apach [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/batch/index.html#module-airflow.providers.microsoft.azure.hooks.batch" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.batch</span></code></a>, <a class="reference external" href="/docs/apache-airflow-p [...]
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
-</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/batch/">Microsoft Azure Batch</a></p>
-</dd>
-</dl>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.DEFAULT_PAGINATION_TOKEN" title="airflow.providers.amazon.aws.hooks.eks.DEFAULT_PAGINATION_TOKEN"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DEFAULT_PAGINATION_TOKEN</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.STS_TOKEN_EXPIRES_IN" title="airflow.providers.amazon.aws.hooks.eks.STS_TOKEN_EXPIRES_IN"><code class="xref py py-obj docutils literal notranslate"><span class="pre">STS_TOKEN_EXPIRES_IN</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.AUTHENTICATION_API_VERSION" title="airflow.providers.amazon.aws.hooks.eks.AUTHENTICATION_API_VERSION"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AUTHENTICATION_API_VERSION</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.DEFAULT_PAGINATION_TOKEN">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">DEFAULT_PAGINATION_TOKEN</span></span><em class="property"><span class="w"> </span><span class="pre">=</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#DEFAULT_PAGINATION_TOKEN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class= [...]
+<dd></dd></dl>
+
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.STS_TOKEN_EXPIRES_IN">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">STS_TOKEN_EXPIRES_IN</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">60</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#STS_TOKEN_EXPIRES_IN"><span class="viewcode-link"><span class="pre">[source]</span> [...]
+<dd></dd></dl>
+
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.AUTHENTICATION_API_VERSION">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">AUTHENTICATION_API_VERSION</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">client.authentication.k8s.io/v1alpha1</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#AUTHENTICATION_API_VERSION"><span class="v [...]
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">ClusterStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an EKS Cluster.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.CREATING">
+<span class="sig-name descname"><span class="pre">CREATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">CREATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.CREATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.CREATING" title="Perma [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.ACTIVE" title="Permalink to [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.DELETING">
+<span class="sig-name descname"><span class="pre">DELETING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DELETING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.DELETING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.DELETING" title="Perma [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.FAILED">
+<span class="sig-name descname"><span class="pre">FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.FAILED" title="Permalink to [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.UPDATING">
+<span class="sig-name descname"><span class="pre">UPDATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">UPDATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.UPDATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.UPDATING" title="Perma [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.ClusterStates.NONEXISTENT">
+<span class="sig-name descname"><span class="pre">NONEXISTENT</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">NONEXISTENT</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#ClusterStates.NONEXISTENT"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.NONEXISTENT" [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">FargateProfileStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="hea [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an AWS Fargate profile.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.CREATING">
+<span class="sig-name descname"><span class="pre">CREATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">CREATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.CREATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.CREATING [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.ACTIVE" title= [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.DELETING">
+<span class="sig-name descname"><span class="pre">DELETING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DELETING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.DELETING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.DELETING [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.CREATE_FAILED">
+<span class="sig-name descname"><span class="pre">CREATE_FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">CREATE_FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.CREATE_FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfile [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.DELETE_FAILED">
+<span class="sig-name descname"><span class="pre">DELETE_FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DELETE_FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.DELETE_FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfile [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.NONEXISTENT">
+<span class="sig-name descname"><span class="pre">NONEXISTENT</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">NONEXISTENT</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#FargateProfileStates.NONEXISTENT"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">NodegroupStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" h [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.10)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an EKS Managed Nodegroup.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CREATING">
+<span class="sig-name descname"><span class="pre">CREATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">CREATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.CREATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CREATING" title="P [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">ACTIVE</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.ACTIVE" title="Permalink [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.UPDATING">
+<span class="sig-name descname"><span class="pre">UPDATING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">UPDATING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.UPDATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.UPDATING" title="P [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DELETING">
+<span class="sig-name descname"><span class="pre">DELETING</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DELETING</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.DELETING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DELETING" title="P [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CREATE_FAILED">
+<span class="sig-name descname"><span class="pre">CREATE_FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">CREATE_FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.CREATE_FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CRE [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DELETE_FAILED">
+<span class="sig-name descname"><span class="pre">DELETE_FAILED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DELETE_FAILED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.DELETE_FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DEL [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DEGRADED">
+<span class="sig-name descname"><span class="pre">DEGRADED</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">DEGRADED</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.DEGRADED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DEGRADED" title="P [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.NodegroupStates.NONEXISTENT">
+<span class="sig-name descname"><span class="pre">NONEXISTENT</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">NONEXISTENT</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#NodegroupStates.NONEXISTENT"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.NONEXISTE [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.eks.</span></span><span class="sig-name descname"><span class="pre">EksHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon EKS, using the boto3 library.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p>
</div>
-<div class="section" id="microsoft-azure-blob-storage">
-<h3>Microsoft Azure Blob Storage<a class="headerlink" href="#microsoft-azure-blob-storage" title="Permalink to this heading">¶</a></h3>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.client_type">
+<span class="sig-name descname"><span class="pre">client_type</span></span><em class="property"><span class="w"> </span><span class="pre">=</span> <span class="pre">eks</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.client_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.client_type" title="Permalink to [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.create_cluster">
+<span class="sig-name descname"><span class="pre">create_cluster</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">roleArn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">resourcesVpcConfig</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></s [...]
+<dd><p>Creates an Amazon EKS control plane.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/wasb_delete_blob/index.html#module-airflow.providers.microsoft.azure.operators.wasb_delete_blob" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.wasb_delete_blob</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/wasb/index.html#module-airflow.providers.microsoft.azure.hooks.wasb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.wasb</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The unique name to give to your Amazon EKS Cluster.</p></li>
+<li><p><strong>roleArn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The Amazon Resource Name (ARN) of the IAM role that provides permissions
+for the Kubernetes control plane to make calls to AWS API operations on your behalf.</p></li>
+<li><p><strong>resourcesVpcConfig</strong> (<em>Dict</em>) -- The VPC configuration used by the cluster control plane.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the created EKS Cluster.</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-container-instances">
-<h3>Microsoft Azure Container Instances<a class="headerlink" href="#microsoft-azure-container-instances" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.create_nodegroup">
+<span class="sig-name descname"><span class="pre">create_nodegroup</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">nodegroupName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">subnets</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">nodeRole</span></span></em>, <em class="sig-param"><span class [...]
+<dd><p>Creates an Amazon EKS managed node group for an Amazon EKS Cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/container_instances/index.html#module-airflow.providers.microsoft.azure.operators.container_instances" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.container_instances</span></code></a>, <a cl [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/container_volume/index.html#module-airflow.providers.microsoft.azure.hooks.container_volume" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.container_volume</span></code></a>, <a class="reference exter [...]
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS cluster to create the EKS Managed Nodegroup in.</p></li>
+<li><p><strong>nodegroupName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The unique name to give your managed nodegroup.</p></li>
+<li><p><strong>subnets</strong> (<em>List</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The subnets to use for the Auto Scaling group that is created for your nodegroup.</p></li>
+<li><p><strong>nodeRole</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The Amazon Resource Name (ARN) of the IAM role to associate with your nodegroup.</p></li>
+<li><p><strong>tags</strong> (<em>Optional</em><em>[</em><em>Dict</em><em>]</em>) -- Optional tags to apply to your nodegroup.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the created EKS Managed Nodegroup.</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/container-instances/">Microsoft Azure Container Instances</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-cosmos-db">
-<h3>Microsoft Azure Cosmos DB<a class="headerlink" href="#microsoft-azure-cosmos-db" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.create_fargate_profile">
+<span class="sig-name descname"><span class="pre">create_fargate_profile</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">fargateProfileName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">podExecutionRoleArn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">selectors</span></span></em>, <em class [...]
+<dd><p>Creates an AWS Fargate profile for an Amazon EKS cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/cosmos/index.html#module-airflow.providers.microsoft.azure.operators.cosmos" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.cosmos</span></code></a>, <a class="reference external" href="/docs/ap [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/cosmos/index.html#module-airflow.providers.microsoft.azure.hooks.cosmos" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.cosmos</span></code></a>, <a class="reference external" href="/docs/apache-airflo [...]
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS cluster to apply the Fargate profile to.</p></li>
+<li><p><strong>fargateProfileName</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The name of the Fargate profile.</p></li>
+<li><p><strong>podExecutionRoleArn</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The Amazon Resource Name (ARN) of the pod execution role to
+use for pods that match the selectors in the Fargate profile.</p></li>
+<li><p><strong>selectors</strong> (<em>List</em>) -- The selectors to match for pods to use this Fargate profile.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the created Fargate profile.</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/cosmos-db/">Microsoft Azure Cosmos DB</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-data-explorer">
-<h3>Microsoft Azure Data Explorer<a class="headerlink" href="#microsoft-azure-data-explorer" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.delete_cluster">
+<span class="sig-name descname"><span class="pre">delete_cluster</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.delete_cluster"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.e [...]
+<dd><p>Deletes the Amazon EKS Cluster control plane.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/adx/index.html#module-airflow.providers.microsoft.azure.operators.adx" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.adx</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/adx/index.html#module-airflow.providers.microsoft.azure.hooks.adx" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.adx</span></code></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the cluster to delete.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the deleted EKS Cluster.</p>
</dd>
-<dt class="field-even">Product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/data-explorer/">Microsoft Azure Data Explorer</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-data-factory">
-<h3>Microsoft Azure Data Factory<a class="headerlink" href="#microsoft-azure-data-factory" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.delete_nodegroup">
+<span class="sig-name descname"><span class="pre">delete_nodegroup</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">nodegroupName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.delete_nodegroup"><span class="viewcode-link"><span cl [...]
+<dd><p>Deletes an Amazon EKS managed node group from a specified cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/data_factory/index.html#module-airflow.providers.microsoft.azure.operators.data_factory" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.data_factory</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/data_factory/index.html#module-airflow.providers.microsoft.azure.hooks.data_factory" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.data_factory</span></code></a>, <a class="reference external" href="/ [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/adf_run_pipeline.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure Data Factory Operators</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster that is associated with your nodegroup.</p></li>
+<li><p><strong>nodegroupName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the nodegroup to delete.</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the deleted EKS Managed Nodegroup.</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/data-factory/">Microsoft Azure Data Factory</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-data-lake-storage">
-<h3>Microsoft Azure Data Lake Storage<a class="headerlink" href="#microsoft-azure-data-lake-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.delete_fargate_profile">
+<span class="sig-name descname"><span class="pre">delete_fargate_profile</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">fargateProfileName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.delete_fargate_profile"><span class="viewco [...]
+<dd><p>Deletes an AWS Fargate profile from a specified Amazon EKS cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/adls_list/index.html#module-airflow.providers.microsoft.azure.operators.adls_list" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.adls_list</span></code></a>, <a class="reference external" href= [...]
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/data_lake/index.html#module-airflow.providers.microsoft.azure.hooks.data_lake" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.data_lake</span></code></a>, <a class="reference external" href="/docs/apac [...]
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/adls.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure DataLake Storage Operators</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS cluster associated with the Fargate profile to delete.</p></li>
+<li><p><strong>fargateProfileName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Fargate profile to delete.</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about the deleted Fargate profile.</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/data-lake-storage/">Microsoft Azure Data Lake Storage</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-fileshare">
-<h3>Microsoft Azure FileShare<a class="headerlink" href="#microsoft-azure-fileshare" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.describe_cluster">
+<span class="sig-name descname"><span class="pre">describe_cluster</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airfl [...]
+<dd><p>Returns descriptive information about an Amazon EKS Cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Hooks</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/fileshare/index.html#module-airflow.providers.microsoft.azure.hooks.fileshare" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.fileshare</span></code></a>, <a class="reference external" href="/docs/apach [...]
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the cluster to describe.</p></li>
+<li><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about a specific EKS Cluster.</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://cloud.google.com/storage/">Microsoft Azure FileShare</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-service-bus">
-<h3>Microsoft Azure Service Bus<a class="headerlink" href="#microsoft-azure-service-bus" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.describe_nodegroup">
+<span class="sig-name descname"><span class="pre">describe_nodegroup</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">nodegroupName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><spa [...]
+<dd><p>Returns descriptive information about an Amazon EKS managed node group.</p>
<dl class="field-list simple">
-<dt class="field-odd">Operators</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/operators/asb/index.html#module-airflow.providers.microsoft.azure.operators.asb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.operators.asb</span></code></a>.</p>
-</dd>
-<dt class="field-even">Hooks</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/asb/index.html#module-airflow.providers.microsoft.azure.hooks.asb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.hooks.asb</span></code></a>.</p>
-</dd>
-<dt class="field-odd">Guides</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/asb.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure Service Bus Operators</span></a>.</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster associated with the nodegroup.</p></li>
+<li><p><strong>nodegroupName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the nodegroup to describe.</p></li>
+<li><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p></li>
+</ul>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about a specific EKS Nodegroup.</p>
</dd>
-<dt class="field-odd">Product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/service-bus/">Microsoft Azure Service Bus</a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-</div>
-<div class="section" id="transfers">
-<h2>Transfers<a class="headerlink" href="#transfers" title="Permalink to this heading">¶</a></h2>
-<p>These integrations allow you to copy data from/to Microsoft Azure.</p>
-<div class="section" id="microsoft-azure-fileshare-to-google-cloud-storage-gcs">
-<h3>Microsoft Azure FileShare to Google Cloud Storage (GCS)<a class="headerlink" href="#microsoft-azure-fileshare-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.describe_fargate_profile">
+<span class="sig-name descname"><span class="pre">describe_fargate_profile</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">fargateProfileName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></spa [...]
+<dd><p>Returns descriptive information about an AWS Fargate profile.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://cloud.google.com/storage/">Microsoft Azure FileShare</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/operators/transfer/azure_fileshare_to_gcs.html" title="(in apache-airflow-providers-google v8.3.0)"><span>Transfers data from Azure FileShare Storage to Google Cloud Storage</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster associated with the Fargate profile.</p></li>
+<li><p><strong>fargateProfileName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Fargate profile to describe.</p></li>
+<li><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p></li>
+</ul>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/azure_fileshare_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns descriptive information about an AWS Fargate profile.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>Dict</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-data-lake-storage-to-google-cloud-storage-gcs">
-<h3>Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)<a class="headerlink" href="#microsoft-azure-data-lake-storage-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.get_cluster_state">
+<span class="sig-name descname"><span class="pre">get_cluster_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.get_cluster_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Returns the current status of a given Amazon EKS Cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/data-lake-storage/">Microsoft Azure Data Lake Storage</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the cluster to check.</p>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/adls_to_gcs/index.html#module-airflow.providers.google.cloud.transfers.adls_to_gcs" title="(in apache-airflow-providers-google v8.3.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.google.cloud.transfers.adls_to_gcs</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns the current status of a given Amazon EKS Cluster.</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-google"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-google</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates" title="airflow.providers.amazon.aws.hooks.eks.ClusterStates">ClusterStates</a></p>
</dd>
</dl>
-</div>
-<div class="section" id="local-to-microsoft-azure-data-lake-storage">
-<h3>Local to Microsoft Azure Data Lake Storage<a class="headerlink" href="#local-to-microsoft-azure-data-lake-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.get_fargate_profile_state">
+<span class="sig-name descname"><span class="pre">get_fargate_profile_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">fargateProfileName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.get_fargate_profile_state"><span class=" [...]
+<dd><p>Returns the current status of a given AWS Fargate profile.</p>
<dl class="field-list simple">
-<dt class="field-odd">Target product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/data-lake-storage/">Microsoft Azure Data Lake Storage</a></p>
-</dd>
-<dt class="field-even">Operator guide</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/local_to_adls.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Upload data from Local Filesystem to Azure Data Lake</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster associated with the Fargate profile.</p></li>
+<li><p><strong>fargateProfileName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Fargate profile to check.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/local_to_adls/index.html#module-airflow.providers.microsoft.azure.transfers.local_to_adls" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.local_to_adls</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns the current status of a given AWS Fargate profile.</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>AWS FargateProfileStates</p>
</dd>
</dl>
-</div>
-<div class="section" id="oracle-to-microsoft-azure-data-lake-storage">
-<h3>Oracle to Microsoft Azure Data Lake Storage<a class="headerlink" href="#oracle-to-microsoft-azure-data-lake-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.get_nodegroup_state">
+<span class="sig-name descname"><span class="pre">get_nodegroup_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">nodegroupName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.get_nodegroup_state"><span class="viewcode-link"><s [...]
+<dd><p>Returns the current status of a given Amazon EKS managed node group.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://www.oracle.com/en/database/">Oracle</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/data-lake-storage/">Microsoft Azure Data Lake Storage</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster associated with the nodegroup.</p></li>
+<li><p><strong>nodegroupName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the nodegroup to check.</p></li>
+</ul>
</dd>
-<dt class="field-odd">Python API</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/oracle_to_azure_data_lake/index.html#module-airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake</span> [...]
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Returns the current status of a given Amazon EKS Nodegroup.</p>
</dd>
-<dt class="field-even">Provider</dt>
-<dd class="field-even"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates" title="airflow.providers.amazon.aws.hooks.eks.NodegroupStates">NodegroupStates</a></p>
</dd>
</dl>
-</div>
-<div class="section" id="local-to-microsoft-azure-blob-storage">
-<h3>Local to Microsoft Azure Blob Storage<a class="headerlink" href="#local-to-microsoft-azure-blob-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.list_clusters">
+<span class="sig-name descname"><span class="pre">list_clusters</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.list_clusters"><span class="viewcode- [...]
+<dd><p>Lists all Amazon EKS Clusters in your AWS account.</p>
<dl class="field-list simple">
-<dt class="field-odd">Target product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/file_to_wasb/index.html#module-airflow.providers.microsoft.azure.transfers.file_to_wasb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.file_to_wasb</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>A List containing the cluster names.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>List</p>
</dd>
</dl>
-</div>
-<div class="section" id="id1">
-<h3>Local to Microsoft Azure Blob Storage<a class="headerlink" href="#id1" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.list_nodegroups">
+<span class="sig-name descname"><span class="pre">list_nodegroups</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules [...]
+<dd><p>Lists all Amazon EKS managed node groups associated with the specified cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Target product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster containing nodegroups to list.</p></li>
+<li><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p></li>
+</ul>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/local_to_wasb/index.html#module-airflow.providers.microsoft.azure.transfers.local_to_wasb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.local_to_wasb</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>A List of nodegroup names within the given cluster.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>List</p>
</dd>
</dl>
-</div>
-<div class="section" id="microsoft-azure-blob-storage-to-google-cloud-storage-gcs">
-<h3>Microsoft Azure Blob Storage to Google Cloud Storage (GCS)<a class="headerlink" href="#microsoft-azure-blob-storage-to-google-cloud-storage-gcs" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.list_fargate_profiles">
+<span class="sig-name descname"><span class="pre">list_fargate_profiles</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">clusterName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">verbose</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_m [...]
+<dd><p>Lists all AWS Fargate profiles associated with the specified cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://cloud.google.com/storage/">Google Cloud Storage (GCS)</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/azure_blob_to_gcs.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure Blob Storage Transfer Operator</span></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>clusterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the Amazon EKS Cluster containing Fargate profiles to list.</p></li>
+<li><p><strong>verbose</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.10)"><em>bool</em></a>) -- Provides additional logging if set to True. Defaults to False.</p></li>
+</ul>
</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/azure_blob_to_gcs/index.html#module-airflow.providers.microsoft.azure.transfers.azure_blob_to_gcs" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.azure_blob_to_gcs</span></code></a></p>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>A list of Fargate profile names within a given cluster.</p>
</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>List</p>
</dd>
</dl>
-</div>
-<div class="section" id="ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage">
-<h3>SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage<a class="headerlink" href="#ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage" title="Permalink to this heading">¶</a></h3>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.generate_config_file">
+<span class="sig-name descname"><span class="pre">generate_config_file</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">eks_cluster_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">pod_namespace</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.generate_config_file"><span class="viewcode-l [...]
+<dd><p>Writes the kubeconfig file given an EKS Cluster.</p>
<dl class="field-list simple">
-<dt class="field-odd">Source product documentation</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://tools.ietf.org/wg/secsh/draft-ietf-secsh-filexfer/">SSH File Transfer Protocol (SFTP)</a></p>
-</dd>
-<dt class="field-even">Target product documentation</dt>
-<dd class="field-even"><p><a class="reference external" href="https://azure.microsoft.com/en-us/services/storage/blobs/">Microsoft Azure Blob Storage</a></p>
-</dd>
-<dt class="field-odd">Operator guide</dt>
-<dd class="field-odd"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/operators/sftp_to_wasb.html" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><span>Azure Blob Storage Transfer Operator</span></a></p>
-</dd>
-<dt class="field-even">Python API</dt>
-<dd class="field-even"><p><a class="reference external" href="/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/transfers/sftp_to_wasb/index.html#module-airflow.providers.microsoft.azure.transfers.sftp_to_wasb" title="(in apache-airflow-providers-microsoft-azure v4.2.0)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.microsoft.azure.transfers.sftp_to_wasb</span></code></a></p>
-</dd>
-<dt class="field-odd">Provider</dt>
-<dd class="field-odd"><p><a class="reference internal" href="../packages-ref.html#std-provider-apache-airflow-providers-microsoft-azure"><code class="xref std std-provider docutils literal notranslate"><span class="pre">apache-airflow-providers-microsoft-azure</span></code></a></p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>eks_cluster_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a>) -- The name of the cluster to generate kubeconfig file for.</p></li>
+<li><p><strong>pod_namespace</strong> (<em>Optional</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.10)"><em>str</em></a><em>]</em>) -- The namespace to run within kubernetes.</p></li>
+</ul>
</dd>
</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.eks.EksHook.fetch_access_token_for_cluster">
+<span class="sig-name descname"><span class="pre">fetch_access_token_for_cluster</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">eks_cluster_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/eks.html#EksHook.fetch_access_token_for_cluster"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+</dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="AWS: Amazon Web Services" href="aws.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Google" href="google.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.elasticache_replication_group" href="../elasticache_replication_group/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -963,29 +1198,65 @@ which authenticate Azure’s Python SDK Clients.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#">Azure: Microsoft Azure</a><ul>
-<li><a class="reference internal" href="#services">Services</a><ul>
-<li><a class="reference internal" href="#microsoft-azure">Microsoft Azure</a></li>
-<li><a class="reference internal" href="#microsoft-azure-batch">Microsoft Azure Batch</a></li>
-<li><a class="reference internal" href="#microsoft-azure-blob-storage">Microsoft Azure Blob Storage</a></li>
-<li><a class="reference internal" href="#microsoft-azure-container-instances">Microsoft Azure Container Instances</a></li>
-<li><a class="reference internal" href="#microsoft-azure-cosmos-db">Microsoft Azure Cosmos DB</a></li>
-<li><a class="reference internal" href="#microsoft-azure-data-explorer">Microsoft Azure Data Explorer</a></li>
-<li><a class="reference internal" href="#microsoft-azure-data-factory">Microsoft Azure Data Factory</a></li>
-<li><a class="reference internal" href="#microsoft-azure-data-lake-storage">Microsoft Azure Data Lake Storage</a></li>
-<li><a class="reference internal" href="#microsoft-azure-fileshare">Microsoft Azure FileShare</a></li>
-<li><a class="reference internal" href="#microsoft-azure-service-bus">Microsoft Azure Service Bus</a></li>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a><ul>
+<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.DEFAULT_PAGINATION_TOKEN">DEFAULT_PAGINATION_TOKEN</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.STS_TOKEN_EXPIRES_IN">STS_TOKEN_EXPIRES_IN</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.AUTHENTICATION_API_VERSION">AUTHENTICATION_API_VERSION</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates">ClusterStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.CREATING">CREATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.DELETING">DELETING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.FAILED">FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.UPDATING">UPDATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates.NONEXISTENT">NONEXISTENT</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates">FargateProfileStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.CREATING">CREATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.DELETING">DELETING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.CREATE_FAILED">CREATE_FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.DELETE_FAILED">DELETE_FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates.NONEXISTENT">NONEXISTENT</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates">NodegroupStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CREATING">CREATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.UPDATING">UPDATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DELETING">DELETING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.CREATE_FAILED">CREATE_FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DELETE_FAILED">DELETE_FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.DEGRADED">DEGRADED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates.NONEXISTENT">NONEXISTENT</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook">EksHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.client_type">client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.create_cluster">create_cluster</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.create_nodegroup">create_nodegroup</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.create_fargate_profile">create_fargate_profile</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.delete_cluster">delete_cluster</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.delete_nodegroup">delete_nodegroup</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.delete_fargate_profile">delete_fargate_profile</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.describe_cluster">describe_cluster</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.describe_nodegroup">describe_nodegroup</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.describe_fargate_profile">describe_fargate_profile</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.get_cluster_state">get_cluster_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.get_fargate_profile_state">get_fargate_profile_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.get_nodegroup_state">get_nodegroup_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.list_clusters">list_clusters</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.list_nodegroups">list_nodegroups</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.list_fargate_profiles">list_fargate_profiles</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.generate_config_file">generate_config_file</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook.fetch_access_token_for_cluster">fetch_access_token_for_cluster</a></li>
+</ul>
+</li>
</ul>
</li>
-<li><a class="reference internal" href="#transfers">Transfers</a><ul>
-<li><a class="reference internal" href="#microsoft-azure-fileshare-to-google-cloud-storage-gcs">Microsoft Azure FileShare to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#microsoft-azure-data-lake-storage-to-google-cloud-storage-gcs">Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#local-to-microsoft-azure-data-lake-storage">Local to Microsoft Azure Data Lake Storage</a></li>
-<li><a class="reference internal" href="#oracle-to-microsoft-azure-data-lake-storage">Oracle to Microsoft Azure Data Lake Storage</a></li>
-<li><a class="reference internal" href="#local-to-microsoft-azure-blob-storage">Local to Microsoft Azure Blob Storage</a></li>
-<li><a class="reference internal" href="#id1">Local to Microsoft Azure Blob Storage</a></li>
-<li><a class="reference internal" href="#microsoft-azure-blob-storage-to-google-cloud-storage-gcs">Microsoft Azure Blob Storage to Google Cloud Storage (GCS)</a></li>
-<li><a class="reference internal" href="#ssh-file-transfer-protocol-sftp-to-microsoft-azure-blob-storage">SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage</a></li>
</ul>
</li>
</ul>
@@ -1012,7 +1283,7 @@ which authenticate Azure’s Python SDK Clients.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers/operators-and-hooks-ref/azure.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/eks/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -1146,18 +1417,18 @@ which authenticate Azure’s Python SDK Clients.</p>
</span>
</div>
</footer>
- <script type="text/javascript" src="../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
- <script src="../_static/jquery.js"></script>
- <script src="../_static/underscore.js"></script>
- <script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../_static/doctools.js"></script>
- <script src="../_static/clipboard.min.js"></script>
- <script src="../_static/copybutton.js"></script>
- <script src="../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/elasticache_replication_group/index.html
similarity index 70%
copy from docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
copy to docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/elasticache_replication_group/index.html
index 3f4eedb5bd..c00b693538 100644
--- a/docs-archive/apache-airflow-providers/core-extensions/secrets-backends.html
+++ b/docs-archive/apache-airflow-providers-amazon/5.1.0/_api/airflow/providers/amazon/aws/hooks/elasticache_replication_group/index.html
@@ -9,17 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Secret backends — apache-airflow-providers Documentation</title>
- <link rel="stylesheet" href="../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../_static/_gen/css/main-custom.min.css" />
- <link rel="shortcut icon" href="../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../genindex.html" />
- <link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Community Providers" href="../howto/create-update-providers.html" />
- <link rel="prev" title="Writing logs" href="logging.html" />
+ <title>airflow.providers.amazon.aws.hooks.elasticache_replication_group — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.emr" href="../emr/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -280,8 +281,21 @@
<div class="content-drawer">
<div class="td-sidebar">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -311,21 +325,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -406,8 +425,21 @@
<div class="td-sidebar desktop-only d-print-none">
+<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
+ <a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
+ aria-expanded="false">
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">5.1.0</span>
+ </a>
+ <div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
+
+ </div>
+ <script type="application/x-template" id="version-item-template">
+ <a class="dropdown-item"></a>
+ </script>
+</div>
+
<div class="searchb-box">
- <form class="search-form" action="../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -437,21 +469,26 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <ul class="current">
-<li class="toctree-l1"><a class="reference internal" href="../index.html">Providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../packages-ref.html">Packages</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../operators-and-hooks-ref/index.html">Operators and hooks</a></li>
-<li class="toctree-l1 current"><a class="reference internal" href="index.html">Core Extensions</a><ul class="current">
-<li class="toctree-l2"><a class="reference internal" href="auth-backends.html">Auth backends</a></li>
-<li class="toctree-l2"><a class="reference internal" href="connections.html">Connections</a></li>
-<li class="toctree-l2"><a class="reference internal" href="extra-links.html">Extra Links</a></li>
-<li class="toctree-l2"><a class="reference internal" href="logging.html">Writing logs</a></li>
-<li class="toctree-l2 current"><a class="current reference internal" href="#">Secret backends</a></li>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
-</li>
-<li class="toctree-l1"><a class="reference internal" href="../howto/create-update-providers.html">Update community providers</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-sources.html">Installing from sources</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../installing-from-pypi.html">Installing from PyPI</a></li>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
+<ul class="current">
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -540,11 +577,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html">Core Extensions</a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="secrets-backends.html"> Secret backends</a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.elasticache_replication_group</span></code></a></li>
</ul>
</div>
@@ -555,54 +596,220 @@
<div class="bodywrapper">
<div class="body" role="main">
- <blockquote>
-<div></div></blockquote>
-<div class="section" id="secret-backends">
-<h1>Secret backends<a class="headerlink" href="#secret-backends" title="Permalink to this heading">¶</a></h1>
-<p>This is a summary of all Apache Airflow Community provided implementations of secret backends
-exposed via community-managed providers.</p>
-<p>Airflow has the capability of reading connections, variables and configuration from Secret Backends rather
-than from its own Database. While storing such information in Airflow’s database is possible, many of the
-enterprise customers already have some secret managers storing secrets, and Airflow can tap into those
-via providers that implement secrets backends for services Airflow integrates with.</p>
-<p>You can also take a
-look at Secret backends available in the core Airflow in
-<a class="reference external" href="/docs/apache-airflow/stable/security/secrets/secrets-backend/index.html" title="(in apache-airflow v2.4.0.dev0)"><span>Secrets Backend</span></a> and here you can see the ones
-provided by the community-managed providers:</p>
-<div class="section" id="amazon">
-<h2>Amazon<a class="headerlink" href="#amazon" title="Permalink to this heading">¶</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/secrets_manager/index.html#airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SecretsManagerBackend</span></code></a></p></li>
-<li><p><a class="reference external" href="/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/secrets/systems_manager/index.html#airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend" title="(in apache-airflow-providers-amazon v5.0.0)"><code class="xref py py-class docutils literal notranslate"><span class="pre">SystemsManagerParameterStoreBackend</span></code></a></p></li>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.elasticache_replication_group">
+<span id="airflow-providers-amazon-aws-hooks-elasticache-replication-group"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.elasticache_replication_group" title="airflow.providers.amazon.aws.hooks.elasticache_replication_group"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.elasticache_replication_group</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws [...]
+<div class="section" id="module-contents">
+<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
+<div class="section" id="classes">
+<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
... 353711 lines suppressed ...