You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2023/02/23 12:25:47 UTC
[airflow-site] 01/01: Add docs for recently released providers
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch add-missing-docs-for-latest-providers
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit 2f29024febd3ff8ffd2b71d0eee5a71818469a06
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Thu Feb 23 13:24:12 2023 +0100
Add docs for recently released providers
Recent providers documentation has been missing from the latest
docs PR (needs to investigate why). This PR adds them back.
---
.../providers/airbyte/hooks/airbyte/index.html | 2 +-
.../7.2.1/.buildinfo | 4 +
.../providers/amazon/aws/exceptions}/index.html | 160 +-
.../providers/amazon/aws/hooks/appflow}/index.html | 176 +-
.../providers/amazon/aws/hooks/athena}/index.html | 303 +-
.../amazon/aws/hooks/base_aws}/index.html | 704 +-
.../amazon/aws/hooks/batch_client}/index.html | 716 +-
.../amazon/aws/hooks/batch_waiters}/index.html | 303 +-
.../amazon/aws/hooks/cloud_formation}/index.html | 167 +-
.../amazon/aws/hooks/datasync}/index.html | 451 +-
.../providers/amazon/aws/hooks/dms}/index.html | 329 +-
.../amazon/aws/hooks/dynamodb}/index.html | 199 +-
.../providers/amazon/aws/hooks/ec2}/index.html | 331 +-
.../providers/amazon/aws/hooks/ecr}/index.html | 236 +-
.../providers/amazon/aws/hooks/ecs}/index.html | 630 +-
.../providers/amazon/aws/hooks/eks}/index.html | 912 +-
.../elasticache_replication_group}/index.html | 329 +-
.../providers/amazon/aws/hooks/emr}/index.html | 645 +-
.../providers/amazon/aws/hooks/glacier}/index.html | 171 +-
.../providers/amazon/aws/hooks/glue}/index.html | 367 +-
.../amazon/aws/hooks/glue_catalog}/index.html | 284 +-
.../amazon/aws/hooks/glue_crawler}/index.html | 296 +-
.../airflow/providers/amazon/aws/hooks}/index.html | 179 +-
.../providers/amazon/aws/hooks/kinesis}/index.html | 197 +-
.../amazon/aws/hooks/lambda_function}/index.html | 211 +-
.../providers/amazon/aws/hooks/logs}/index.html | 157 +-
.../amazon/aws/hooks/quicksight}/index.html | 222 +-
.../providers/amazon/aws/hooks/rds}/index.html | 428 +-
.../amazon/aws/hooks/redshift_cluster}/index.html | 273 +-
.../amazon/aws/hooks/redshift_data}/index.html | 194 +-
.../amazon/aws/hooks/redshift_sql}/index.html | 194 +-
.../providers/amazon/aws/hooks/s3}/index.html | 1158 +-
.../amazon/aws/hooks/sagemaker/index.html | 1978 +++
.../amazon/aws/hooks/secrets_manager}/index.html | 155 +-
.../providers/amazon/aws/hooks/ses}/index.html | 155 +-
.../providers/amazon/aws/hooks/sns}/index.html | 208 +-
.../providers/amazon/aws/hooks/sqs}/index.html | 165 +-
.../providers/amazon/aws/hooks/ssm}/index.html | 197 +-
.../amazon/aws/hooks/step_function}/index.html | 159 +-
.../providers/amazon/aws/hooks/sts}/index.html | 194 +-
.../_api/airflow/providers/amazon/aws}/index.html | 454 +-
.../amazon/aws/links/base_aws}/index.html | 196 +-
.../providers/amazon/aws/links/batch}/index.html | 222 +-
.../providers/amazon/aws/links/emr}/index.html | 162 +-
.../providers/amazon/aws/links/glue}/index.html | 194 +-
.../airflow/providers/amazon/aws/links/index.html} | 219 +-
.../providers/amazon/aws/links/logs}/index.html | 198 +-
.../aws/log/cloudwatch_task_handler}/index.html | 165 +-
.../airflow/providers/amazon/aws/log/index.html} | 216 +-
.../amazon/aws/log/s3_task_handler}/index.html | 223 +-
.../amazon/aws/operators/appflow}/index.html | 581 +-
.../amazon/aws/operators/athena}/index.html | 172 +-
.../amazon/aws/operators/aws_lambda/index.html} | 217 +-
.../amazon/aws/operators/batch}/index.html | 306 +-
.../aws/operators/cloud_formation}/index.html | 209 +-
.../amazon/aws/operators/datasync}/index.html | 243 +-
.../providers/amazon/aws/operators/dms}/index.html | 573 +-
.../providers/amazon/aws/operators/ec2}/index.html | 201 +-
.../providers/amazon/aws/operators/ecs}/index.html | 682 +-
.../providers/amazon/aws/operators/eks}/index.html | 1036 +-
.../providers/amazon/aws/operators/emr/index.html | 1690 ++
.../amazon/aws/operators/glacier}/index.html | 185 +-
.../amazon/aws/operators/glue}/index.html | 176 +-
.../amazon/aws/operators/glue_crawler}/index.html | 138 +-
.../providers/amazon/aws/operators}/index.html | 168 +-
.../aws/operators/lambda_function}/index.html | 224 +-
.../amazon/aws/operators/quicksight}/index.html | 163 +-
.../providers/amazon/aws/operators/rds}/index.html | 988 +-
.../aws/operators/redshift_cluster}/index.html | 670 +-
.../amazon/aws/operators/redshift_data}/index.html | 184 +-
.../amazon/aws/operators/redshift_sql}/index.html | 130 +-
.../providers/amazon/aws/operators/s3/index.html | 1700 ++
.../amazon/aws/operators/sagemaker/index.html | 1874 ++
.../providers/amazon/aws/operators/sns}/index.html | 131 +-
.../providers/amazon/aws/operators/sqs}/index.html | 141 +-
.../amazon/aws/operators/step_function}/index.html | 200 +-
.../providers/amazon/aws/secrets/index.html} | 216 +-
.../amazon/aws/secrets/secrets_manager}/index.html | 233 +-
.../amazon/aws/secrets/systems_manager}/index.html | 218 +-
.../amazon/aws/sensors/athena}/index.html | 156 +-
.../providers/amazon/aws/sensors/batch}/index.html | 298 +-
.../amazon/aws/sensors/cloud_formation}/index.html | 212 +-
.../providers/amazon/aws/sensors/dms}/index.html | 199 +-
.../providers/amazon/aws/sensors/ec2}/index.html | 136 +-
.../providers/amazon/aws/sensors/ecs}/index.html | 293 +-
.../providers/amazon/aws/sensors/eks}/index.html | 613 +-
.../providers/amazon/aws/sensors/emr}/index.html | 1040 +-
.../amazon/aws/sensors/glacier}/index.html | 166 +-
.../providers/amazon/aws/sensors/glue}/index.html | 123 +-
.../aws/sensors/glue_catalog_partition}/index.html | 152 +-
.../amazon/aws/sensors/glue_crawler}/index.html | 138 +-
.../providers/amazon/aws/sensors}/index.html | 163 +-
.../amazon/aws/sensors/lambda_function}/index.html | 131 +-
.../amazon/aws/sensors/quicksight}/index.html | 148 +-
.../providers/amazon/aws/sensors/rds}/index.html | 225 +-
.../aws/sensors/redshift_cluster}/index.html | 137 +-
.../providers/amazon/aws/sensors/s3}/index.html | 286 +-
.../amazon/aws/sensors/sagemaker}/index.html | 1002 +-
.../providers/amazon/aws/sensors/sqs}/index.html | 225 +-
.../amazon/aws/sensors/step_function}/index.html | 183 +-
.../aws/transfers/dynamodb_to_s3}/index.html | 184 +-
.../amazon/aws/transfers/exasol_to_s3}/index.html | 167 +-
.../amazon/aws/transfers/ftp_to_s3}/index.html | 146 +-
.../amazon/aws/transfers/gcs_to_s3}/index.html | 194 +-
.../aws/transfers/glacier_to_gcs}/index.html | 146 +-
.../aws/transfers/google_api_to_s3}/index.html | 199 +-
.../aws/transfers/hive_to_dynamodb}/index.html | 162 +-
.../transfers/imap_attachment_to_s3}/index.html | 134 +-
.../providers/amazon/aws/transfers}/index.html | 161 +-
.../amazon/aws/transfers/local_to_s3}/index.html | 156 +-
.../amazon/aws/transfers/mongo_to_s3}/index.html | 170 +-
.../aws/transfers/redshift_to_s3}/index.html | 187 +-
.../amazon/aws/transfers/s3_to_ftp}/index.html | 192 +-
.../aws/transfers/s3_to_redshift}/index.html | 198 +-
.../amazon/aws/transfers/s3_to_sftp}/index.html | 139 +-
.../amazon/aws/transfers/s3_to_sql}/index.html | 175 +-
.../aws/transfers/salesforce_to_s3}/index.html | 164 +-
.../amazon/aws/transfers/sftp_to_s3}/index.html | 143 +-
.../amazon/aws/transfers/sql_to_s3}/index.html | 241 +-
.../aws/utils/connection_wrapper}/index.html | 317 +-
.../amazon/aws/utils/eks_get_token}/index.html | 229 +-
.../providers/amazon/aws/utils/emailer}/index.html | 191 +-
.../airflow/providers/amazon/aws/utils}/index.html | 194 +-
.../providers/amazon/aws/utils/rds}/index.html | 187 +-
.../amazon/aws/utils/redshift}/index.html | 219 +-
.../amazon/aws/utils/sagemaker}/index.html | 194 +-
.../providers/amazon/aws/utils/tags}/index.html | 192 +-
.../providers/amazon/aws/utils/waiter}/index.html | 172 +-
.../amazon/aws/waiters/base_waiter}/index.html | 180 +-
.../providers/amazon/aws/waiters/index.html} | 215 +-
.../_api/airflow/providers/amazon}/index.html | 449 +-
.../amazon/aws/example_athena}/index.html | 214 +-
.../providers/amazon/aws/example_batch}/index.html | 307 +-
.../amazon/aws/example_cloudformation}/index.html | 224 +-
.../amazon/aws/example_datasync}/index.html | 297 +-
.../providers/amazon/aws/example_dms}/index.html | 315 +-
.../amazon/aws/example_dynamodb_to_s3}/index.html | 253 +-
.../providers/amazon/aws/example_ec2}/index.html | 210 +-
.../providers/amazon/aws/example_ecs}/index.html | 196 +-
.../amazon/aws/example_ecs_fargate}/index.html | 247 +-
.../index.html | 175 +-
.../example_eks_with_fargate_profile}/index.html | 182 +-
.../index.html | 168 +-
.../aws/example_eks_with_nodegroups}/index.html | 231 +-
.../providers/amazon/aws/example_emr}/index.html | 264 +-
.../amazon/aws/example_emr_eks}/index.html | 293 +-
.../aws/example_emr_notebook_execution}/index.html | 231 +-
.../amazon/aws/example_emr_serverless}/index.html | 224 +-
.../providers/amazon/aws/example_glue}/index.html | 257 +-
.../example_google_api_youtube_to_s3}/index.html | 300 +-
.../amazon/aws/example_lambda}/index.html | 212 +-
.../amazon/aws/example_local_to_s3}/index.html | 206 +-
.../amazon/aws/example_quicksight}/index.html | 274 +-
.../amazon/aws/example_rds_event}/index.html | 188 +-
.../amazon/aws/example_rds_export}/index.html | 194 +-
.../amazon/aws/example_rds_instance}/index.html | 231 +-
.../amazon/aws/example_rds_snapshot}/index.html | 217 +-
.../amazon/aws/example_redshift}/index.html | 261 +-
.../aws/example_redshift_s3_transfers}/index.html | 316 +-
.../providers/amazon/aws/example_s3}/index.html | 196 +-
.../amazon/aws/example_s3_to_sql}/index.html | 289 +-
.../amazon/aws/example_sagemaker}/index.html | 328 +-
.../aws/example_sagemaker_endpoint}/index.html | 278 +-
.../providers/amazon/aws/example_sns}/index.html | 188 +-
.../amazon/aws/example_sql_to_s3}/index.html | 291 +-
.../providers/amazon/aws/example_sqs}/index.html | 188 +-
.../amazon/aws/example_step_functions}/index.html | 206 +-
.../tests/system/providers/amazon/aws}/index.html | 199 +-
.../providers/amazon/aws/utils/ec2}/index.html | 293 +-
.../system/providers/amazon/aws/utils}/index.html | 421 +-
.../_api/tests/system/providers/amazon}/index.html | 248 +-
.../7.2.1/_images/aws-base-conn-airflow.png | Bin 0 -> 186727 bytes
.../7.2.1/_images/aws-secrets-manager-json.png | Bin 0 -> 86477 bytes
.../7.2.1/_images/aws-secrets-manager-uri.png | Bin 0 -> 60559 bytes
.../_images/aws-web-identity-federation-gcp.png | Bin 0 -> 40170 bytes
.../airflow/providers/amazon/aws/exceptions.html} | 283 +-
.../providers/amazon/aws/hooks/appflow.html} | 335 +-
.../providers/amazon/aws/hooks/athena.html} | 555 +-
.../providers/amazon/aws/hooks/base_aws.html | 1690 ++
.../providers/amazon/aws/hooks/batch_client.html} | 785 +-
.../providers/amazon/aws/hooks/batch_waiters.html} | 493 +-
.../amazon/aws/hooks/cloud_formation.html} | 265 +-
.../providers/amazon/aws/hooks/datasync.html} | 584 +-
.../airflow/providers/amazon/aws/hooks/dms.html} | 499 +-
.../providers/amazon/aws/hooks/dynamodb.html} | 246 +-
.../airflow/providers/amazon/aws/hooks/ec2.html} | 471 +-
.../airflow/providers/amazon/aws/hooks/ecr.html} | 276 +-
.../airflow/providers/amazon/aws/hooks/ecs.html} | 492 +-
.../airflow/providers/amazon/aws/hooks/eks.html} | 881 +-
.../aws/hooks/elasticache_replication_group.html} | 515 +-
.../airflow/providers/amazon/aws/hooks/emr.html} | 772 +-
.../providers/amazon/aws/hooks/glacier.html} | 261 +-
.../airflow/providers/amazon/aws/hooks/glue.html} | 563 +-
.../providers/amazon/aws/hooks/glue_catalog.html} | 386 +-
.../providers/amazon/aws/hooks/glue_crawler.html} | 497 +-
.../providers/amazon/aws/hooks/kinesis.html} | 290 +-
.../amazon/aws/hooks/lambda_function.html} | 370 +-
.../airflow/providers/amazon/aws/hooks/logs.html} | 278 +-
.../providers/amazon/aws/hooks/quicksight.html} | 346 +-
.../airflow/providers/amazon/aws/hooks/rds.html} | 593 +-
.../amazon/aws/hooks/redshift_cluster.html} | 480 +-
.../providers/amazon/aws/hooks/redshift_data.html} | 282 +-
.../providers/amazon/aws/hooks/redshift_sql.html} | 322 +-
.../airflow/providers/amazon/aws/hooks/s3.html | 1943 +++
.../providers/amazon/aws/hooks/sagemaker.html | 2141 +++
.../amazon/aws/hooks/secrets_manager.html} | 245 +-
.../airflow/providers/amazon/aws/hooks/ses.html} | 279 +-
.../airflow/providers/amazon/aws/hooks/sns.html} | 271 +-
.../airflow/providers/amazon/aws/hooks/sqs.html} | 259 +-
.../airflow/providers/amazon/aws/hooks/ssm.html} | 237 +-
.../providers/amazon/aws/hooks/step_function.html} | 257 +-
.../airflow/providers/amazon/aws/hooks/sts.html} | 284 +-
.../providers/amazon/aws/links/base_aws.html} | 271 +-
.../airflow/providers/amazon/aws/links/batch.html} | 221 +-
.../airflow/providers/amazon/aws/links/emr.html} | 274 +-
.../airflow/providers/amazon/aws/links/glue.html} | 266 +-
.../airflow/providers/amazon/aws/links/logs.html} | 279 +-
.../amazon/aws/log/cloudwatch_task_handler.html} | 317 +-
.../providers/amazon/aws/log/s3_task_handler.html} | 475 +-
.../providers/amazon/aws/operators/appflow.html} | 731 +-
.../providers/amazon/aws/operators/athena.html} | 350 +-
.../providers/amazon/aws/operators/batch.html} | 600 +-
.../amazon/aws/operators/cloud_formation.html} | 291 +-
.../providers/amazon/aws/operators/datasync.html} | 667 +-
.../providers/amazon/aws/operators/dms.html} | 528 +-
.../providers/amazon/aws/operators/ec2.html} | 311 +-
.../providers/amazon/aws/operators/ecs.html | 1481 ++
.../providers/amazon/aws/operators/eks.html | 1544 ++
.../providers/amazon/aws/operators/emr.html | 1840 ++
.../providers/amazon/aws/operators/glacier.html} | 282 +-
.../providers/amazon/aws/operators/glue.html} | 454 +-
.../amazon/aws/operators/glue_crawler.html} | 264 +-
.../amazon/aws/operators/lambda_function.html} | 474 +-
.../amazon/aws/operators/quicksight.html} | 275 +-
.../providers/amazon/aws/operators/rds.html | 1562 ++
.../amazon/aws/operators/redshift_cluster.html} | 790 +-
.../amazon/aws/operators/redshift_data.html} | 453 +-
.../amazon/aws/operators/redshift_sql.html} | 233 +-
.../airflow/providers/amazon/aws/operators/s3.html | 1583 ++
.../providers/amazon/aws/operators/sagemaker.html | 1925 +++
.../providers/amazon/aws/operators/sns.html} | 260 +-
.../providers/amazon/aws/operators/sqs.html} | 272 +-
.../amazon/aws/operators/step_function.html} | 307 +-
.../amazon/aws/secrets/secrets_manager.html} | 577 +-
.../amazon/aws/secrets/systems_manager.html} | 377 +-
.../providers/amazon/aws/sensors/athena.html} | 267 +-
.../providers/amazon/aws/sensors/batch.html} | 490 +-
.../amazon/aws/sensors/cloud_formation.html} | 302 +-
.../airflow/providers/amazon/aws/sensors/dms.html} | 312 +-
.../airflow/providers/amazon/aws/sensors/ec2.html} | 249 +-
.../airflow/providers/amazon/aws/sensors/ecs.html} | 466 +-
.../airflow/providers/amazon/aws/sensors/eks.html} | 534 +-
.../airflow/providers/amazon/aws/sensors/emr.html} | 761 +-
.../providers/amazon/aws/sensors/glacier.html} | 296 +-
.../providers/amazon/aws/sensors/glue.html} | 268 +-
.../aws/sensors/glue_catalog_partition.html} | 271 +-
.../amazon/aws/sensors/glue_crawler.html} | 252 +-
.../amazon/aws/sensors/lambda_function.html} | 262 +-
.../providers/amazon/aws/sensors/quicksight.html} | 265 +-
.../airflow/providers/amazon/aws/sensors/rds.html} | 386 +-
.../amazon/aws/sensors/redshift_cluster.html} | 251 +-
.../airflow/providers/amazon/aws/sensors/s3.html} | 526 +-
.../providers/amazon/aws/sensors/sagemaker.html} | 602 +-
.../airflow/providers/amazon/aws/sensors/sqs.html} | 505 +-
.../amazon/aws/sensors/step_function.html} | 273 +-
.../amazon/aws/transfers/dynamodb_to_s3.html} | 353 +-
.../amazon/aws/transfers/exasol_to_s3.html} | 303 +-
.../providers/amazon/aws/transfers/ftp_to_s3.html} | 345 +-
.../providers/amazon/aws/transfers/gcs_to_s3.html} | 474 +-
.../amazon/aws/transfers/glacier_to_gcs.html} | 309 +-
.../amazon/aws/transfers/google_api_to_s3.html} | 471 +-
.../amazon/aws/transfers/hive_to_dynamodb.html} | 303 +-
.../aws/transfers/imap_attachment_to_s3.html} | 308 +-
.../amazon/aws/transfers/local_to_s3.html} | 284 +-
.../amazon/aws/transfers/mongo_to_s3.html} | 350 +-
.../amazon/aws/transfers/redshift_to_s3.html} | 353 +-
.../providers/amazon/aws/transfers/s3_to_ftp.html} | 256 +-
.../amazon/aws/transfers/s3_to_redshift.html} | 444 +-
.../amazon/aws/transfers/s3_to_sftp.html} | 272 +-
.../providers/amazon/aws/transfers/s3_to_sql.html} | 321 +-
.../amazon/aws/transfers/salesforce_to_s3.html} | 326 +-
.../amazon/aws/transfers/sftp_to_s3.html} | 272 +-
.../providers/amazon/aws/transfers/sql_to_s3.html} | 469 +-
.../airflow/providers/amazon/aws/utils.html} | 279 +-
.../amazon/aws/utils/connection_wrapper.html} | 720 +-
.../providers/amazon/aws/utils/eks_get_token.html} | 247 +-
.../providers/amazon/aws/utils/emailer.html} | 231 +-
.../airflow/providers/amazon/aws/utils/rds.html} | 265 +-
.../providers/amazon/aws/utils/redshift.html} | 289 +-
.../providers/amazon/aws/utils/sagemaker.html} | 267 +-
.../airflow/providers/amazon/aws/utils/tags.html} | 277 +-
.../providers/amazon/aws/utils/waiter.html} | 258 +-
.../providers/amazon/aws/waiters/base_waiter.html} | 273 +-
.../7.2.1/_modules/index.html} | 404 +-
.../providers/amazon/aws/example_athena.html} | 379 +-
.../providers/amazon/aws/example_batch.html} | 551 +-
.../amazon/aws/example_cloudformation.html} | 296 +-
.../providers/amazon/aws/example_datasync.html} | 524 +-
.../system/providers/amazon/aws/example_dms.html} | 713 +-
.../amazon/aws/example_dynamodb_to_s3.html} | 355 +-
.../system/providers/amazon/aws/example_ec2.html} | 350 +-
.../system/providers/amazon/aws/example_ecs.html} | 421 +-
.../providers/amazon/aws/example_ecs_fargate.html} | 340 +-
.../aws/example_eks_with_fargate_in_one_step.html} | 338 +-
.../aws/example_eks_with_fargate_profile.html} | 373 +-
.../example_eks_with_nodegroup_in_one_step.html} | 326 +-
.../amazon/aws/example_eks_with_nodegroups.html} | 365 +-
.../system/providers/amazon/aws/example_emr.html} | 392 +-
.../providers/amazon/aws/example_emr_eks.html} | 581 +-
.../aws/example_emr_notebook_execution.html} | 320 +-
.../amazon/aws/example_emr_serverless.html} | 344 +-
.../system/providers/amazon/aws/example_glue.html} | 406 +-
.../aws/example_google_api_youtube_to_s3.html} | 484 +-
.../providers/amazon/aws/example_lambda.html} | 333 +-
.../providers/amazon/aws/example_local_to_s3.html} | 279 +-
.../providers/amazon/aws/example_quicksight.html} | 508 +-
.../providers/amazon/aws/example_rds_event.html} | 324 +-
.../providers/amazon/aws/example_rds_export.html} | 381 +-
.../amazon/aws/example_rds_instance.html} | 299 +-
.../amazon/aws/example_rds_snapshot.html} | 343 +-
.../providers/amazon/aws/example_redshift.html} | 582 +-
.../amazon/aws/example_redshift_s3_transfers.html} | 558 +-
.../system/providers/amazon/aws/example_s3.html} | 555 +-
.../providers/amazon/aws/example_s3_to_sql.html} | 561 +-
.../providers/amazon/aws/example_sagemaker.html | 1529 ++
.../amazon/aws/example_sagemaker_endpoint.html} | 582 +-
.../system/providers/amazon/aws/example_sns.html} | 263 +-
.../providers/amazon/aws/example_sql_to_s3.html} | 499 +-
.../system/providers/amazon/aws/example_sqs.html} | 288 +-
.../amazon/aws/example_step_functions.html} | 317 +-
.../tests/system/providers/amazon/aws/utils.html} | 593 +-
.../system/providers/amazon/aws/utils/ec2.html} | 357 +-
.../providers/amazon/aws/exceptions/index.rst.txt | 40 +
.../amazon/aws/hooks/appflow/index.rst.txt | 71 +
.../amazon/aws/hooks/athena/index.rst.txt | 159 +
.../amazon/aws/hooks/base_aws/index.rst.txt | 312 +
.../amazon/aws/hooks/batch_client/index.rst.txt | 409 +
.../amazon/aws/hooks/batch_waiters/index.rst.txt | 177 +
.../amazon/aws/hooks/cloud_formation/index.rst.txt | 70 +
.../amazon/aws/hooks/datasync/index.rst.txt | 199 +
.../providers/amazon/aws/hooks/dms/index.rst.txt | 149 +
.../amazon/aws/hooks/dynamodb/index.rst.txt | 54 +
.../providers/amazon/aws/hooks/ec2/index.rst.txt | 130 +
.../providers/amazon/aws/hooks/ecr/index.rst.txt | 94 +
.../providers/amazon/aws/hooks/ecs/index.rst.txt | 267 +
.../providers/amazon/aws/hooks/eks/index.rst.txt | 405 +
.../elasticache_replication_group/index.rst.txt | 139 +
.../providers/amazon/aws/hooks/emr/index.rst.txt | 293 +
.../amazon/aws/hooks/glacier/index.rst.txt | 66 +
.../providers/amazon/aws/hooks/glue/index.rst.txt | 166 +
.../amazon/aws/hooks/glue_catalog/index.rst.txt | 143 +
.../amazon/aws/hooks/glue_crawler/index.rst.txt | 114 +
.../providers/amazon/aws/hooks/index.rst.txt | 50 +
.../amazon/aws/hooks/kinesis/index.rst.txt | 50 +
.../amazon/aws/hooks/lambda_function/index.rst.txt | 100 +
.../providers/amazon/aws/hooks/logs/index.rst.txt | 60 +
.../amazon/aws/hooks/quicksight/index.rst.txt | 87 +
.../providers/amazon/aws/hooks/rds/index.rst.txt | 195 +
.../aws/hooks/redshift_cluster/index.rst.txt | 125 +
.../amazon/aws/hooks/redshift_data/index.rst.txt | 35 +
.../amazon/aws/hooks/redshift_sql/index.rst.txt | 91 +
.../providers/amazon/aws/hooks/s3/index.rst.txt | 532 +
.../amazon/aws/hooks/sagemaker/index.rst.txt | 619 +
.../amazon/aws/hooks/secrets_manager/index.rst.txt | 54 +
.../providers/amazon/aws/hooks/ses/index.rst.txt | 63 +
.../providers/amazon/aws/hooks/sns/index.rst.txt | 59 +
.../providers/amazon/aws/hooks/sqs/index.rst.txt | 65 +
.../providers/amazon/aws/hooks/ssm/index.rst.txt | 45 +
.../amazon/aws/hooks/step_function/index.rst.txt | 57 +
.../providers/amazon/aws/hooks/sts/index.rst.txt | 41 +
.../airflow/providers/amazon/aws/index.rst.txt | 32 +
.../amazon/aws/links/base_aws/index.rst.txt | 81 +
.../providers/amazon/aws/links/batch/index.rst.txt | 84 +
.../providers/amazon/aws/links/emr/index.rst.txt | 62 +
.../providers/amazon/aws/links/glue/index.rst.txt | 40 +
.../providers/amazon/aws/links/index.rst.txt | 19 +
.../providers/amazon/aws/links/logs/index.rst.txt | 48 +
.../aws/log/cloudwatch_task_handler/index.rst.txt | 69 +
.../airflow/providers/amazon/aws/log/index.rst.txt | 16 +
.../amazon/aws/log/s3_task_handler/index.rst.txt | 87 +
.../amazon/aws/operators/appflow/index.rst.txt | 216 +
.../amazon/aws/operators/athena/index.rst.txt | 81 +
.../amazon/aws/operators/aws_lambda/index.rst.txt | 11 +
.../amazon/aws/operators/batch/index.rst.txt | 188 +
.../aws/operators/cloud_formation/index.rst.txt | 111 +
.../amazon/aws/operators/datasync/index.rst.txt | 143 +
.../amazon/aws/operators/dms/index.rst.txt | 240 +
.../amazon/aws/operators/ec2/index.rst.txt | 102 +
.../amazon/aws/operators/ecs/index.rst.txt | 287 +
.../amazon/aws/operators/eks/index.rst.txt | 438 +
.../amazon/aws/operators/emr/index.rst.txt | 547 +
.../amazon/aws/operators/glacier/index.rst.txt | 82 +
.../amazon/aws/operators/glue/index.rst.txt | 80 +
.../aws/operators/glue_crawler/index.rst.txt | 60 +
.../providers/amazon/aws/operators/index.rst.txt | 39 +
.../aws/operators/lambda_function/index.rst.txt | 112 +
.../amazon/aws/operators/quicksight/index.rst.txt | 79 +
.../amazon/aws/operators/rds/index.rst.txt | 340 +
.../aws/operators/redshift_cluster/index.rst.txt | 300 +
.../aws/operators/redshift_data/index.rst.txt | 81 +
.../aws/operators/redshift_sql/index.rst.txt | 55 +
.../amazon/aws/operators/s3/index.rst.txt | 577 +
.../amazon/aws/operators/sagemaker/index.rst.txt | 662 +
.../amazon/aws/operators/sns/index.rst.txt | 66 +
.../amazon/aws/operators/sqs/index.rst.txt | 68 +
.../aws/operators/step_function/index.rst.txt | 105 +
.../providers/amazon/aws/secrets/index.rst.txt | 16 +
.../aws/secrets/secrets_manager/index.rst.txt | 131 +
.../aws/secrets/systems_manager/index.rst.txt | 101 +
.../amazon/aws/sensors/athena/index.rst.txt | 81 +
.../amazon/aws/sensors/batch/index.rst.txt | 160 +
.../aws/sensors/cloud_formation/index.rst.txt | 99 +
.../providers/amazon/aws/sensors/dms/index.rst.txt | 86 +
.../providers/amazon/aws/sensors/ec2/index.rst.txt | 64 +
.../providers/amazon/aws/sensors/ecs/index.rst.txt | 138 +
.../providers/amazon/aws/sensors/eks/index.rst.txt | 228 +
.../providers/amazon/aws/sensors/emr/index.rst.txt | 418 +
.../amazon/aws/sensors/glacier/index.rst.txt | 80 +
.../amazon/aws/sensors/glue/index.rst.txt | 49 +
.../sensors/glue_catalog_partition/index.rst.txt | 66 +
.../amazon/aws/sensors/glue_crawler/index.rst.txt | 53 +
.../providers/amazon/aws/sensors/index.rst.txt | 34 +
.../aws/sensors/lambda_function/index.rst.txt | 55 +
.../amazon/aws/sensors/quicksight/index.rst.txt | 58 +
.../providers/amazon/aws/sensors/rds/index.rst.txt | 98 +
.../aws/sensors/redshift_cluster/index.rst.txt | 52 +
.../providers/amazon/aws/sensors/s3/index.rst.txt | 143 +
.../amazon/aws/sensors/sagemaker/index.rst.txt | 374 +
.../providers/amazon/aws/sensors/sqs/index.rst.txt | 103 +
.../amazon/aws/sensors/step_function/index.rst.txt | 83 +
.../aws/transfers/dynamodb_to_s3/index.rst.txt | 85 +
.../aws/transfers/exasol_to_s3/index.rst.txt | 76 +
.../amazon/aws/transfers/ftp_to_s3/index.rst.txt | 69 +
.../amazon/aws/transfers/gcs_to_s3/index.rst.txt | 99 +
.../aws/transfers/glacier_to_gcs/index.rst.txt | 68 +
.../aws/transfers/google_api_to_s3/index.rst.txt | 108 +
.../aws/transfers/hive_to_dynamodb/index.rst.txt | 78 +
.../transfers/imap_attachment_to_s3/index.rst.txt | 59 +
.../providers/amazon/aws/transfers/index.rst.txt | 32 +
.../amazon/aws/transfers/local_to_s3/index.rst.txt | 73 +
.../amazon/aws/transfers/mongo_to_s3/index.rst.txt | 80 +
.../aws/transfers/redshift_to_s3/index.rst.txt | 95 +
.../amazon/aws/transfers/s3_to_ftp/index.rst.txt | 54 +
.../aws/transfers/s3_to_redshift/index.rst.txt | 92 +
.../amazon/aws/transfers/s3_to_sftp/index.rst.txt | 60 +
.../amazon/aws/transfers/s3_to_sql/index.rst.txt | 80 +
.../aws/transfers/salesforce_to_s3/index.rst.txt | 76 +
.../amazon/aws/transfers/sftp_to_s3/index.rst.txt | 64 +
.../amazon/aws/transfers/sql_to_s3/index.rst.txt | 111 +
.../aws/utils/connection_wrapper/index.rst.txt | 163 +
.../amazon/aws/utils/eks_get_token/index.rst.txt | 43 +
.../amazon/aws/utils/emailer/index.rst.txt | 29 +
.../providers/amazon/aws/utils/index.rst.txt | 60 +
.../providers/amazon/aws/utils/rds/index.rst.txt | 38 +
.../amazon/aws/utils/redshift/index.rst.txt | 41 +
.../amazon/aws/utils/sagemaker/index.rst.txt | 41 +
.../providers/amazon/aws/utils/tags/index.rst.txt | 31 +
.../amazon/aws/utils/waiter/index.rst.txt | 54 +
.../amazon/aws/waiters/base_waiter/index.rst.txt | 29 +
.../providers/amazon/aws/waiters/index.rst.txt | 15 +
.../_api/airflow/providers/amazon/index.rst.txt | 15 +
.../amazon/aws/example_athena/index.rst.txt | 81 +
.../amazon/aws/example_batch/index.rst.txt | 98 +
.../aws/example_cloudformation/index.rst.txt | 30 +
.../amazon/aws/example_datasync/index.rst.txt | 88 +
.../providers/amazon/aws/example_dms/index.rst.txt | 119 +
.../aws/example_dynamodb_to_s3/index.rst.txt | 79 +
.../providers/amazon/aws/example_ec2/index.rst.txt | 62 +
.../providers/amazon/aws/example_ecs/index.rst.txt | 62 +
.../amazon/aws/example_ecs_fargate/index.rst.txt | 82 +
.../index.rst.txt | 41 +
.../example_eks_with_fargate_profile/index.rst.txt | 45 +
.../index.rst.txt | 36 +
.../aws/example_eks_with_nodegroups/index.rst.txt | 36 +
.../providers/amazon/aws/example_emr/index.rst.txt | 87 +
.../amazon/aws/example_emr_eks/index.rst.txt | 117 +
.../example_emr_notebook_execution/index.rst.txt | 36 +
.../aws/example_emr_serverless/index.rst.txt | 31 +
.../amazon/aws/example_glue/index.rst.txt | 110 +
.../example_google_api_youtube_to_s3/index.rst.txt | 127 +
.../amazon/aws/example_lambda/index.rst.txt | 81 +
.../amazon/aws/example_local_to_s3/index.rst.txt | 66 +
.../amazon/aws/example_quicksight/index.rst.txt | 98 +
.../amazon/aws/example_rds_event/index.rst.txt | 54 +
.../amazon/aws/example_rds_export/index.rst.txt | 62 +
.../amazon/aws/example_rds_instance/index.rst.txt | 36 +
.../amazon/aws/example_rds_snapshot/index.rst.txt | 26 +
.../amazon/aws/example_redshift/index.rst.txt | 87 +
.../example_redshift_s3_transfers/index.rst.txt | 126 +
.../providers/amazon/aws/example_s3/index.rst.txt | 67 +
.../amazon/aws/example_s3_to_sql/index.rst.txt | 114 +
.../amazon/aws/example_sagemaker/index.rst.txt | 138 +
.../aws/example_sagemaker_endpoint/index.rst.txt | 101 +
.../providers/amazon/aws/example_sns/index.rst.txt | 54 +
.../amazon/aws/example_sql_to_s3/index.rst.txt | 102 +
.../providers/amazon/aws/example_sqs/index.rst.txt | 54 +
.../aws/example_step_functions/index.rst.txt | 65 +
.../system/providers/amazon/aws/index.rst.txt | 59 +
.../providers/amazon/aws/utils/ec2/index.rst.txt | 65 +
.../providers/amazon/aws/utils/index.rst.txt | 203 +
.../tests/system/providers/amazon/index.rst.txt | 15 +
.../7.2.1/_sources/commits.rst.txt | 1111 ++
.../7.2.1/_sources/connections/aws.rst.txt | 792 +
.../7.2.1/_sources/connections/emr.rst.txt | 43 +
.../7.2.1/_sources/connections/index.rst.txt | 28 +
.../7.2.1/_sources/connections/redshift.rst.txt | 91 +
.../7.2.1/_sources/example-dags.rst.txt | 24 +
.../7.2.1/_sources/index.rst.txt | 145 +
.../installing-providers-from-sources.rst.txt | 18 +
.../logging/cloud-watch-task-handlers.rst.txt | 38 +
.../7.2.1/_sources/logging/index.rst.txt | 25 +
.../7.2.1/_sources/logging/s3-task-handler.rst.txt | 140 +
.../7.2.1/_sources/operators/appflow.rst.txt | 146 +
.../7.2.1/_sources/operators/athena.rst.txt | 75 +
.../7.2.1/_sources/operators/batch.rst.txt | 111 +
.../_sources/operators/cloudformation.rst.txt | 99 +
.../7.2.1/_sources/operators/datasync.rst.txt | 114 +
.../7.2.1/_sources/operators/dms.rst.txt | 133 +
.../7.2.1/_sources/operators/ec2.rst.txt | 81 +
.../7.2.1/_sources/operators/ecs.rst.txt | 262 +
.../7.2.1/_sources/operators/eks.rst.txt | 247 +
.../7.2.1/_sources/operators/emr.rst.txt | 196 +
.../7.2.1/_sources/operators/emr_eks.rst.txt | 124 +
.../_sources/operators/emr_serverless.rst.txt | 113 +
.../7.2.1/_sources/operators/glacier.rst.txt | 83 +
.../7.2.1/_sources/operators/glue.rst.txt | 107 +
.../7.2.1/_sources/operators/index.rst.txt | 29 +
.../7.2.1/_sources/operators/lambda.rst.txt | 85 +
.../7.2.1/_sources/operators/quicksight.rst.txt | 69 +
.../7.2.1/_sources/operators/rds.rst.txt | 252 +
.../_sources/operators/redshift_cluster.rst.txt | 139 +
.../7.2.1/_sources/operators/redshift_data.rst.txt | 55 +
.../7.2.1/_sources/operators/redshift_sql.rst.txt | 64 +
.../7.2.1/_sources/operators/s3.rst.txt | 271 +
.../7.2.1/_sources/operators/sagemaker.rst.txt | 316 +
.../7.2.1/_sources/operators/sns.rst.txt | 55 +
.../7.2.1/_sources/operators/sqs.rst.txt | 74 +
.../_sources/operators/step_functions.rst.txt | 82 +
.../operators/transfer/dynamodb_to_s3.rst.txt | 70 +
.../_sources/operators/transfer/ftp_to_s3.rst.txt | 53 +
.../_sources/operators/transfer/gcs_to_s3.rst.txt | 52 +
.../operators/transfer/glacier_to_gcs.rst.txt | 55 +
.../operators/transfer/google_api_to_s3.rst.txt | 81 +
.../operators/transfer/hive_to_dynamodb.rst.txt | 57 +
.../transfer/imap_attachment_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/index.rst.txt | 28 +
.../operators/transfer/local_to_s3.rst.txt | 54 +
.../operators/transfer/mongo_to_s3.rst.txt | 59 +
.../operators/transfer/redshift_to_s3.rst.txt | 59 +
.../_sources/operators/transfer/s3_to_ftp.rst.txt | 54 +
.../operators/transfer/s3_to_redshift.rst.txt | 67 +
.../_sources/operators/transfer/s3_to_sftp.rst.txt | 55 +
.../_sources/operators/transfer/s3_to_sql.rst.txt | 65 +
.../operators/transfer/salesforce_to_s3.rst.txt | 51 +
.../_sources/operators/transfer/sftp_to_s3.rst.txt | 54 +
.../_sources/operators/transfer/sql_to_s3.rst.txt | 56 +
.../secrets-backends/aws-secrets-manager.rst.txt | 137 +
.../aws-ssm-parameter-store.rst.txt | 103 +
.../7.2.1/_sources/secrets-backends/index.rst.txt | 27 +
.../7.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../7.2.1/_static/_gen/css/main.min.css | 7 +
.../7.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../7.2.1/_static/basic.css | 899 +
.../7.2.1/_static/check-solid.svg | 4 +
.../7.2.1/_static/clipboard.min.js | 7 +
.../7.2.1/_static/copy-button.svg | 5 +
.../7.2.1/_static/copybutton.css | 94 +
.../7.2.1/_static/copybutton.js | 248 +
.../7.2.1/_static/copybutton_funcs.js | 73 +
.../7.2.1/_static/doctools.js | 156 +
.../7.2.1/_static/documentation_options.js | 14 +
.../7.2.1/_static/file.png | Bin 0 -> 286 bytes
.../7.2.1/_static/graphviz.css | 19 +
.../7.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../7.2.1/_static/jquery.js | 2 +
.../7.2.1/_static/js/globaltoc.js | 24 +
.../7.2.1/_static/language_data.js | 199 +
.../7.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../7.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../7.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../7.2.1/_static/pygments.css | 74 +
.../7.2.1/_static/searchtools.js | 566 +
.../7.2.1/_static/sphinx_highlight.js | 144 +
.../7.2.1/_static/underscore-1.13.1.js | 2042 +++
.../7.2.1/_static/underscore.js | 6 +
.../7.2.1/commits.html | 4623 +++++
.../7.2.1/connections/aws.html} | 760 +-
.../7.2.1/connections/emr.html} | 180 +-
.../7.2.1/connections/index.html} | 169 +-
.../7.2.1/connections/redshift.html} | 221 +-
.../7.2.1/example-dags.html} | 211 +-
.../7.2.1/genindex.html | 6356 +++++++
.../7.2.1/index.html | 2050 +++
.../7.2.1/installing-providers-from-sources.html} | 259 +-
.../7.2.1/logging/cloud-watch-task-handlers.html} | 177 +-
.../7.2.1/logging/index.html} | 168 +-
.../7.2.1/logging/s3-task-handler.html} | 216 +-
.../7.2.1/objects.inv | Bin 0 -> 22275 bytes
.../7.2.1/operators/appflow.html} | 265 +-
.../7.2.1/operators/athena.html} | 233 +-
.../7.2.1/operators/batch.html} | 227 +-
.../7.2.1/operators/cloudformation.html} | 206 +-
.../7.2.1/operators/datasync.html} | 241 +-
.../7.2.1/operators/dms.html} | 247 +-
.../7.2.1/operators/ec2.html} | 189 +-
.../7.2.1/operators/ecs.html} | 462 +-
.../7.2.1/operators/eks.html} | 468 +-
.../7.2.1/operators/emr.html} | 399 +-
.../7.2.1/operators/emr_eks.html} | 241 +-
.../7.2.1/operators/emr_serverless.html} | 224 +-
.../7.2.1/operators/glacier.html} | 187 +-
.../7.2.1/operators/glue.html} | 221 +-
.../7.2.1/operators/google_api_to_s3_transfer.html | 1 +
.../7.2.1/operators/imap_attachment_to_s3.html | 1 +
.../7.2.1/operators/index.html} | 192 +-
.../7.2.1/operators/lambda.html} | 198 +-
.../7.2.1/operators/quicksight.html} | 229 +-
.../7.2.1/operators/rds.html} | 441 +-
.../7.2.1/operators/redshift_cluster.html} | 323 +-
.../7.2.1/operators/redshift_data.html} | 218 +-
.../7.2.1/operators/redshift_sql.html} | 217 +-
.../7.2.1/operators/s3.html} | 470 +-
.../7.2.1/operators/s3_to_redshift.html | 1 +
.../7.2.1/operators/sagemaker.html} | 495 +-
.../7.2.1/operators/salesforce_to_s3.html | 1 +
.../7.2.1/operators/sns.html} | 205 +-
.../7.2.1/operators/sqs.html} | 197 +-
.../7.2.1/operators/sqs_publish.html | 1 +
.../7.2.1/operators/step_functions.html} | 186 +-
.../7.2.1/operators/transfer/dynamodb_to_s3.html} | 284 +-
.../7.2.1/operators/transfer/ftp_to_s3.html} | 249 +-
.../7.2.1/operators/transfer/gcs_to_s3.html} | 248 +-
.../7.2.1/operators/transfer/glacier_to_gcs.html} | 258 +-
.../operators/transfer/google_api_to_s3.html} | 308 +-
.../operators/transfer/hive_to_dynamodb.html} | 253 +-
.../operators/transfer/imap_attachment_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/index.html} | 227 +-
.../7.2.1/operators/transfer/local_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/mongo_to_s3.html} | 258 +-
.../7.2.1/operators/transfer/redshift_to_s3.html} | 255 +-
.../7.2.1/operators/transfer/s3_to_ftp.html} | 254 +-
.../7.2.1/operators/transfer/s3_to_redshift.html} | 271 +-
.../7.2.1/operators/transfer/s3_to_sftp.html} | 250 +-
.../7.2.1/operators/transfer/s3_to_sql.html} | 286 +-
.../operators/transfer/salesforce_to_s3.html} | 250 +-
.../7.2.1/operators/transfer/sftp_to_s3.html} | 249 +-
.../7.2.1/operators/transfer/sql_to_s3.html} | 253 +-
.../7.2.1/py-modindex.html} | 1390 +-
.../7.2.1/search.html} | 255 +-
.../7.2.1/searchindex.js | 1 +
.../secrets-backends/aws-secrets-manager.html} | 201 +-
.../secrets-backends/aws-ssm-parameter-store.html} | 163 +-
.../7.2.1/secrets-backends/index.html} | 166 +-
.../apache-airflow-providers-amazon/stable.txt | 2 +-
.../4.3.0/.buildinfo | 4 +
.../providers/apache/beam/hooks/beam}/index.html | 375 +-
.../providers/apache/beam/hooks/index.html} | 205 +-
.../_api/airflow/providers/apache/beam/index.html} | 208 +-
.../apache/beam/operators/beam}/index.html | 617 +-
.../providers/apache/beam/operators/index.html} | 205 +-
.../providers/apache/beam/example_beam/index.html} | 228 +-
.../beam/example_beam_java_flink/index.html} | 228 +-
.../beam/example_beam_java_spark/index.html} | 228 +-
.../providers/apache/beam/example_go/index.html} | 228 +-
.../apache/beam/example_go_dataflow/index.html} | 228 +-
.../apache/beam/example_java_dataflow/index.html} | 228 +-
.../apache/beam/example_python/index.html} | 228 +-
.../beam/example_python_dataflow/index.html} | 228 +-
.../tests/system/providers/apache/beam/index.html} | 213 +-
.../system/providers/apache/beam/utils}/index.html | 351 +-
.../airflow/providers/apache/beam/hooks/beam.html} | 628 +-
.../providers/apache/beam/operators/beam.html | 1593 ++
.../4.3.0/_modules/index.html} | 192 +-
.../providers/apache/beam/example_beam.html} | 230 +-
.../apache/beam/example_beam_java_flink.html} | 229 +-
.../apache/beam/example_beam_java_spark.html} | 229 +-
.../system/providers/apache/beam/example_go.html} | 272 +-
.../apache/beam/example_go_dataflow.html} | 244 +-
.../apache/beam/example_java_dataflow.html} | 234 +-
.../providers/apache/beam/example_python.html} | 288 +-
.../apache/beam/example_python_dataflow.html} | 247 +-
.../tests/system/providers/apache/beam/utils.html} | 273 +-
.../providers/apache/beam/hooks/beam/index.rst.txt | 189 +
.../providers/apache/beam/hooks/index.rst.txt | 15 +
.../airflow/providers/apache/beam/index.rst.txt | 16 +
.../apache/beam/operators/beam/index.rst.txt | 286 +
.../providers/apache/beam/operators/index.rst.txt | 15 +
.../apache/beam/example_beam/index.rst.txt | 22 +
.../beam/example_beam_java_flink/index.rst.txt | 22 +
.../beam/example_beam_java_spark/index.rst.txt | 22 +
.../providers/apache/beam/example_go/index.rst.txt | 22 +
.../apache/beam/example_go_dataflow/index.rst.txt | 22 +
.../beam/example_java_dataflow/index.rst.txt | 22 +
.../apache/beam/example_python/index.rst.txt | 22 +
.../beam/example_python_dataflow/index.rst.txt | 22 +
.../system/providers/apache/beam/index.rst.txt | 23 +
.../providers/apache/beam/utils/index.rst.txt | 122 +
.../4.3.0/_sources/commits.rst.txt | 250 +
.../4.3.0/_sources/index.rst.txt | 119 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.3.0/_sources/operators.rst.txt | 164 +
.../4.3.0/_static/_gen/css/main-custom.min.css | 1 +
.../4.3.0/_static/_gen/css/main.min.css | 7 +
.../4.3.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.3.0/_static/basic.css | 899 +
.../4.3.0/_static/check-solid.svg | 4 +
.../4.3.0/_static/clipboard.min.js | 7 +
.../4.3.0/_static/copy-button.svg | 5 +
.../4.3.0/_static/copybutton.css | 94 +
.../4.3.0/_static/copybutton.js | 248 +
.../4.3.0/_static/copybutton_funcs.js | 73 +
.../4.3.0/_static/doctools.js | 156 +
.../4.3.0/_static/documentation_options.js | 14 +
.../4.3.0/_static/file.png | Bin 0 -> 286 bytes
.../4.3.0/_static/graphviz.css | 19 +
.../4.3.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.3.0/_static/jquery.js | 2 +
.../4.3.0/_static/js/globaltoc.js | 24 +
.../4.3.0/_static/language_data.js | 199 +
.../4.3.0/_static/minus.png | Bin 0 -> 90 bytes
.../4.3.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.3.0/_static/plus.png | Bin 0 -> 90 bytes
.../4.3.0/_static/pygments.css | 74 +
.../4.3.0/_static/searchtools.js | 566 +
.../4.3.0/_static/sphinx_highlight.js | 144 +
.../4.3.0/_static/underscore-1.13.1.js | 2042 +++
.../4.3.0/_static/underscore.js | 6 +
.../4.3.0/commits.html} | 810 +-
.../4.3.0/genindex.html} | 677 +-
.../4.3.0/index.html} | 570 +-
.../4.3.0/installing-providers-from-sources.html} | 259 +-
.../4.3.0/objects.inv | Bin 0 -> 1580 bytes
.../4.3.0/operators.html} | 506 +-
.../4.3.0/py-modindex.html} | 332 +-
.../4.3.0/search.html} | 247 +-
.../4.3.0/searchindex.js | 1 +
.../stable.txt | 2 +-
.../flink/operators/flink_kubernetes/index.html | 2 +-
.../flink/sensors/flink_kubernetes/index.html | 2 +-
.../5.1.3/.buildinfo | 4 +
.../providers/apache/hive/hooks/hive}/index.html | 947 +-
.../providers/apache/hive/hooks/index.html} | 203 +-
.../_api/airflow/providers/apache/hive/index.html} | 235 +-
.../providers/apache/hive/macros/hive}/index.html | 157 +-
.../providers/apache/hive/macros/index.html} | 203 +-
.../apache/hive/operators/hive}/index.html | 193 +-
.../apache/hive/operators/hive_stats}/index.html | 133 +-
.../providers/apache/hive/operators/index.html} | 204 +-
.../providers/apache/hive/plugins/hive}/index.html | 108 +-
.../providers/apache/hive/plugins/index.html} | 203 +-
.../apache/hive/sensors/hive_partition}/index.html | 109 +-
.../providers/apache/hive/sensors/index.html} | 205 +-
.../hive/sensors/metastore_partition}/index.html | 111 +-
.../hive/sensors/named_hive_partition}/index.html | 125 +-
.../hive/transfers/hive_to_mysql}/index.html | 132 +-
.../hive/transfers/hive_to_samba}/index.html | 112 +-
.../providers/apache/hive/transfers/index.html} | 208 +-
.../hive/transfers/mssql_to_hive}/index.html | 158 +-
.../hive/transfers/mysql_to_hive}/index.html | 163 +-
.../apache/hive/transfers/s3_to_hive}/index.html | 179 +-
.../hive/transfers/vertica_to_hive}/index.html | 158 +-
.../apache/hive/example_twitter_dag}/index.html | 196 +-
.../tests/system/providers/apache/hive/index.html} | 203 +-
.../airflow/providers/apache/hive/hooks/hive.html | 1868 ++
.../providers/apache/hive/macros/hive.html} | 288 +-
.../providers/apache/hive/operators/hive.html} | 445 +-
.../apache/hive/operators/hive_stats.html} | 454 +-
.../providers/apache/hive/plugins/hive.html} | 255 +-
.../apache/hive/sensors/hive_partition.html} | 244 +-
.../apache/hive/sensors/metastore_partition.html} | 253 +-
.../apache/hive/sensors/named_hive_partition.html} | 286 +-
.../apache/hive/transfers/hive_to_mysql.html} | 306 +-
.../apache/hive/transfers/hive_to_samba.html} | 240 +-
.../apache/hive/transfers/mssql_to_hive.html} | 312 +-
.../apache/hive/transfers/mysql_to_hive.html} | 342 +-
.../apache/hive/transfers/s3_to_hive.html} | 514 +-
.../apache/hive/transfers/vertica_to_hive.html} | 315 +-
.../5.1.3/_modules/index.html} | 194 +-
.../apache/hive/example_twitter_dag.html} | 345 +-
.../providers/apache/hive/hooks/hive/index.rst.txt | 446 +
.../providers/apache/hive/hooks/index.rst.txt | 15 +
.../airflow/providers/apache/hive/index.rst.txt | 20 +
.../apache/hive/macros/hive/index.rst.txt | 58 +
.../providers/apache/hive/macros/index.rst.txt | 15 +
.../apache/hive/operators/hive/index.rst.txt | 108 +
.../apache/hive/operators/hive_stats/index.rst.txt | 73 +
.../providers/apache/hive/operators/index.rst.txt | 16 +
.../apache/hive/plugins/hive/index.rst.txt | 35 +
.../providers/apache/hive/plugins/index.rst.txt | 15 +
.../hive/sensors/hive_partition/index.rst.txt | 55 +
.../providers/apache/hive/sensors/index.rst.txt | 17 +
.../hive/sensors/metastore_partition/index.rst.txt | 54 +
.../sensors/named_hive_partition/index.rst.txt | 63 +
.../hive/transfers/hive_to_mysql/index.rst.txt | 81 +
.../hive/transfers/hive_to_samba/index.rst.txt | 62 +
.../providers/apache/hive/transfers/index.rst.txt | 20 +
.../hive/transfers/mssql_to_hive/index.rst.txt | 91 +
.../hive/transfers/mysql_to_hive/index.rst.txt | 96 +
.../apache/hive/transfers/s3_to_hive/index.rst.txt | 102 +
.../hive/transfers/vertica_to_hive/index.rst.txt | 91 +
.../apache/hive/example_twitter_dag/index.rst.txt | 80 +
.../system/providers/apache/hive/index.rst.txt | 15 +
.../5.1.3/_sources/commits.rst.txt | 464 +
.../5.1.3/_sources/connections/hive_cli.rst.txt | 91 +
.../_sources/connections/hive_metastore.rst.txt | 69 +
.../5.1.3/_sources/connections/hiveserver2.rst.txt | 78 +
.../5.1.3/_sources/connections/index.rst.txt | 25 +
.../5.1.3/_sources/index.rst.txt | 133 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.1.3/_sources/macros.rst.txt | 26 +
.../5.1.3/_sources/operators.rst.txt | 40 +
.../5.1.3/_static/_gen/css/main-custom.min.css | 1 +
.../5.1.3/_static/_gen/css/main.min.css | 7 +
.../5.1.3/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.1.3/_static/basic.css | 899 +
.../5.1.3/_static/check-solid.svg | 4 +
.../5.1.3/_static/clipboard.min.js | 7 +
.../5.1.3/_static/copy-button.svg | 5 +
.../5.1.3/_static/copybutton.css | 94 +
.../5.1.3/_static/copybutton.js | 248 +
.../5.1.3/_static/copybutton_funcs.js | 73 +
.../5.1.3/_static/doctools.js | 156 +
.../5.1.3/_static/documentation_options.js | 14 +
.../5.1.3/_static/file.png | Bin 0 -> 286 bytes
.../5.1.3/_static/graphviz.css | 19 +
.../5.1.3/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.1.3/_static/jquery.js | 2 +
.../5.1.3/_static/js/globaltoc.js | 24 +
.../5.1.3/_static/language_data.js | 199 +
.../5.1.3/_static/minus.png | Bin 0 -> 90 bytes
.../5.1.3/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.1.3/_static/plus.png | Bin 0 -> 90 bytes
.../5.1.3/_static/pygments.css | 74 +
.../5.1.3/_static/searchtools.js | 566 +
.../5.1.3/_static/sphinx_highlight.js | 144 +
.../5.1.3/_static/underscore-1.13.1.js | 2042 +++
.../5.1.3/_static/underscore.js | 6 +
.../5.1.3/commits.html | 2085 +++
.../5.1.3/connections/hive_cli.html} | 199 +-
.../5.1.3/connections/hive_metastore.html} | 182 +-
.../5.1.3/connections/hiveserver2.html} | 188 +-
.../5.1.3/connections/index.html} | 159 +-
.../5.1.3/genindex.html} | 944 +-
.../5.1.3/index.html} | 712 +-
.../5.1.3/installing-providers-from-sources.html} | 249 +-
.../5.1.3/macros.html} | 251 +-
.../5.1.3/objects.inv | Bin 0 -> 2081 bytes
.../5.1.3/operators.html} | 218 +-
.../5.1.3/py-modindex.html} | 370 +-
.../5.1.3/search.html} | 245 +-
.../5.1.3/searchindex.js | 1 +
.../stable.txt | 2 +-
.../providers/apache/livy/hooks/livy/index.html | 2 +-
.../3.1.1/.buildinfo | 4 +
.../providers/apache/sqoop/hooks/index.html} | 191 +-
.../providers/apache/sqoop/hooks/sqoop}/index.html | 268 +-
.../airflow/providers/apache/sqoop/index.html} | 194 +-
.../providers/apache/sqoop/operators/index.html} | 191 +-
.../apache/sqoop/operators/sqoop}/index.html | 185 +-
.../providers/apache/sqoop/hooks/sqoop.html} | 654 +-
.../providers/apache/sqoop/operators/sqoop.html} | 517 +-
.../3.1.1/_modules/index.html} | 169 +-
.../providers/apache/sqoop/hooks/index.rst.txt | 15 +
.../apache/sqoop/hooks/sqoop/index.rst.txt | 154 +
.../airflow/providers/apache/sqoop/index.rst.txt | 16 +
.../providers/apache/sqoop/operators/index.rst.txt | 15 +
.../apache/sqoop/operators/sqoop/index.rst.txt | 109 +
.../3.1.1/_sources/commits.rst.txt | 241 +
.../3.1.1/_sources/index.rst.txt | 78 +
.../installing-providers-from-sources.rst.txt | 18 +
.../3.1.1/_sources/operators.rst.txt | 38 +
.../3.1.1/_static/_gen/css/main-custom.min.css | 1 +
.../3.1.1/_static/_gen/css/main.min.css | 7 +
.../3.1.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../3.1.1/_static/basic.css | 899 +
.../3.1.1/_static/check-solid.svg | 4 +
.../3.1.1/_static/clipboard.min.js | 7 +
.../3.1.1/_static/copy-button.svg | 5 +
.../3.1.1/_static/copybutton.css | 94 +
.../3.1.1/_static/copybutton.js | 248 +
.../3.1.1/_static/copybutton_funcs.js | 73 +
.../3.1.1/_static/doctools.js | 156 +
.../3.1.1/_static/documentation_options.js | 14 +
.../3.1.1/_static/file.png | Bin 0 -> 286 bytes
.../3.1.1/_static/graphviz.css | 19 +
.../3.1.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../3.1.1/_static/jquery.js | 2 +
.../3.1.1/_static/js/globaltoc.js | 24 +
.../3.1.1/_static/language_data.js | 199 +
.../3.1.1/_static/minus.png | Bin 0 -> 90 bytes
.../3.1.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../3.1.1/_static/plus.png | Bin 0 -> 90 bytes
.../3.1.1/_static/pygments.css | 74 +
.../3.1.1/_static/searchtools.js | 566 +
.../3.1.1/_static/sphinx_highlight.js | 144 +
.../3.1.1/_static/underscore-1.13.1.js | 2042 +++
.../3.1.1/_static/underscore.js | 6 +
.../3.1.1/commits.html} | 774 +-
.../3.1.1/genindex.html} | 385 +-
.../3.1.1/index.html} | 401 +-
.../3.1.1/installing-providers-from-sources.html} | 249 +-
.../3.1.1/objects.inv | Bin 0 -> 680 bytes
.../3.1.1/operators.html} | 201 +-
.../3.1.1/py-modindex.html} | 258 +-
.../3.1.1/search.html} | 233 +-
.../3.1.1/searchindex.js | 1 +
.../stable.txt | 2 +-
.../5.2.1/.buildinfo | 4 +
.../cncf/kubernetes/decorators/index.html} | 201 +-
.../kubernetes/decorators/kubernetes/index.html} | 238 +-
.../providers/cncf/kubernetes/hooks/index.html} | 201 +-
.../cncf/kubernetes/hooks/kubernetes}/index.html | 564 +-
.../airflow/providers/cncf/kubernetes/index.html} | 234 +-
.../cncf/kubernetes/operators/index.html} | 202 +-
.../operators/kubernetes_pod}/index.html | 621 +-
.../operators/spark_kubernetes}/index.html | 109 +-
.../python_kubernetes_script}/index.html | 140 +-
.../providers/cncf/kubernetes/sensors/index.html} | 201 +-
.../sensors/spark_kubernetes}/index.html | 102 +-
.../providers/cncf/kubernetes/triggers/index.html} | 201 +-
.../kubernetes/triggers/kubernetes_pod}/index.html | 200 +-
.../providers/cncf/kubernetes/utils/index.html} | 202 +-
.../cncf/kubernetes/utils/pod_manager}/index.html | 518 +-
.../cncf/kubernetes/utils/xcom_sidecar}/index.html | 153 +-
.../cncf/kubernetes/example_kubernetes}/index.html | 254 +-
.../example_kubernetes_async}/index.html | 223 +-
.../example_kubernetes_decorator/index.html} | 251 +-
.../example_spark_kubernetes}/index.html | 142 +-
.../system/providers/cncf/kubernetes/index.html} | 204 +-
.../cncf/kubernetes/decorators/kubernetes.html} | 339 +-
.../cncf/kubernetes/hooks/kubernetes.html} | 804 +-
.../cncf/kubernetes/operators/kubernetes_pod.html | 1686 ++
.../kubernetes/operators/spark_kubernetes.html} | 242 +-
.../cncf/kubernetes/python_kubernetes_script.html} | 298 +-
.../cncf/kubernetes/sensors/spark_kubernetes.html} | 303 +-
.../cncf/kubernetes/triggers/kubernetes_pod.html} | 493 +-
.../cncf/kubernetes/utils/pod_manager.html} | 644 +-
.../cncf/kubernetes/utils/xcom_sidecar.html} | 225 +-
.../5.2.1/_modules/index.html} | 190 +-
.../cncf/kubernetes/example_kubernetes.html} | 355 +-
.../cncf/kubernetes/example_kubernetes_async.html} | 359 +-
.../kubernetes/example_kubernetes_decorator.html} | 234 +-
.../cncf/kubernetes/example_spark_kubernetes.html} | 248 +-
.../cncf/kubernetes/decorators/index.rst.txt | 15 +
.../kubernetes/decorators/kubernetes/index.rst.txt | 33 +
.../providers/cncf/kubernetes/hooks/index.rst.txt | 15 +
.../cncf/kubernetes/hooks/kubernetes/index.rst.txt | 232 +
.../providers/cncf/kubernetes/index.rst.txt | 29 +
.../cncf/kubernetes/operators/index.rst.txt | 16 +
.../operators/kubernetes_pod/index.rst.txt | 253 +
.../operators/spark_kubernetes/index.rst.txt | 63 +
.../python_kubernetes_script/index.rst.txt | 43 +
.../cncf/kubernetes/sensors/index.rst.txt | 15 +
.../sensors/spark_kubernetes/index.rst.txt | 60 +
.../cncf/kubernetes/triggers/index.rst.txt | 15 +
.../triggers/kubernetes_pod/index.rst.txt | 94 +
.../providers/cncf/kubernetes/utils/index.rst.txt | 16 +
.../kubernetes/utils/pod_manager/index.rst.txt | 196 +
.../kubernetes/utils/xcom_sidecar/index.rst.txt | 71 +
.../kubernetes/example_kubernetes/index.rst.txt | 79 +
.../example_kubernetes_async/index.rst.txt | 79 +
.../example_kubernetes_decorator/index.rst.txt | 34 +
.../example_spark_kubernetes/index.rst.txt | 37 +
.../system/providers/cncf/kubernetes/index.rst.txt | 18 +
.../5.2.1/_sources/commits.rst.txt | 622 +
.../5.2.1/_sources/connections/kubernetes.rst.txt | 84 +
.../5.2.1/_sources/index.rst.txt | 96 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.2.1/_sources/operators.rst.txt | 175 +
.../5.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../5.2.1/_static/_gen/css/main.min.css | 7 +
.../5.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.2.1/_static/basic.css | 899 +
.../5.2.1/_static/check-solid.svg | 4 +
.../5.2.1/_static/clipboard.min.js | 7 +
.../5.2.1/_static/copy-button.svg | 5 +
.../5.2.1/_static/copybutton.css | 94 +
.../5.2.1/_static/copybutton.js | 248 +
.../5.2.1/_static/copybutton_funcs.js | 73 +
.../5.2.1/_static/doctools.js | 156 +
.../5.2.1/_static/documentation_options.js | 14 +
.../5.2.1/_static/file.png | Bin 0 -> 286 bytes
.../5.2.1/_static/graphviz.css | 19 +
.../5.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.2.1/_static/jquery.js | 2 +
.../5.2.1/_static/js/globaltoc.js | 24 +
.../5.2.1/_static/language_data.js | 199 +
.../5.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pygments.css | 74 +
.../5.2.1/_static/searchtools.js | 566 +
.../5.2.1/_static/sphinx_highlight.js | 144 +
.../5.2.1/_static/underscore-1.13.1.js | 2042 +++
.../5.2.1/_static/underscore.js | 6 +
.../5.2.1/commits.html | 2635 +++
.../5.2.1/connections/index.html | 1 +
.../5.2.1/connections/kubernetes.html} | 195 +-
.../5.2.1/genindex.html} | 1046 +-
.../5.2.1/index.html | 1677 ++
.../5.2.1/installing-providers-from-sources.html} | 247 +-
.../5.2.1/objects.inv | Bin 0 -> 2514 bytes
.../5.2.1/operators.html} | 482 +-
.../5.2.1/py-modindex.html} | 358 +-
.../5.2.1/search.html} | 243 +-
.../5.2.1/searchindex.js | 1 +
.../stable.txt | 2 +-
.../providers/dbt/cloud/hooks/dbt/index.html | 2 +-
.../providers/dingding/hooks/dingding/index.html | 2 +-
.../discord/hooks/discord_webhook/index.html | 2 +-
.../discord/operators/discord_webhook/index.html | 2 +-
.../3.5.1/.buildinfo | 4 +
.../providers/docker/decorators/docker}/index.html | 108 +-
.../providers/docker/decorators/index.html} | 195 +-
.../providers/docker/hooks/docker}/index.html | 196 +-
.../airflow/providers/docker/hooks/index.html} | 195 +-
.../_api/airflow/providers/docker/index.html} | 203 +-
.../providers/docker/operators/docker}/index.html | 315 +-
.../docker/operators/docker_swarm}/index.html | 162 +-
.../airflow/providers/docker/operators/index.html} | 196 +-
.../providers/docker/example_docker}/index.html | 141 +-
.../docker/example_docker_copy_data}/index.html | 154 +-
.../docker/example_docker_swarm}/index.html | 137 +-
.../_api/tests/system/providers/docker/index.html} | 197 +-
.../providers/docker/decorators/docker.html} | 409 +-
.../airflow/providers/docker/hooks/docker.html} | 525 +-
.../providers/docker/operators/docker.html} | 775 +-
.../providers/docker/operators/docker_swarm.html} | 449 +-
.../3.5.1/_modules/index.html} | 178 +-
.../system/providers/docker/example_docker.html} | 284 +-
.../docker/example_docker_copy_data.html} | 319 +-
.../providers/docker/example_docker_swarm.html} | 273 +-
.../docker/decorators/docker/index.rst.txt | 29 +
.../providers/docker/decorators/index.rst.txt | 15 +
.../providers/docker/hooks/docker/index.rst.txt | 102 +
.../airflow/providers/docker/hooks/index.rst.txt | 15 +
.../_api/airflow/providers/docker/index.rst.txt | 17 +
.../docker/operators/docker/index.rst.txt | 212 +
.../docker/operators/docker_swarm/index.rst.txt | 105 +
.../providers/docker/operators/index.rst.txt | 16 +
.../providers/docker/example_docker/index.rst.txt | 26 +
.../docker/example_docker_copy_data/index.rst.txt | 53 +
.../docker/example_docker_swarm/index.rst.txt | 26 +
.../tests/system/providers/docker/index.rst.txt | 17 +
.../3.5.1/_sources/commits.rst.txt | 442 +
.../3.5.1/_sources/connections/docker.rst.txt | 70 +
.../3.5.1/_sources/decorators/docker.rst.txt | 130 +
.../3.5.1/_sources/index.rst.txt | 88 +
.../installing-providers-from-sources.rst.txt | 18 +
.../3.5.1/_static/_gen/css/main-custom.min.css | 1 +
.../3.5.1/_static/_gen/css/main.min.css | 7 +
.../3.5.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../3.5.1/_static/basic.css | 899 +
.../3.5.1/_static/check-solid.svg | 4 +
.../3.5.1/_static/clipboard.min.js | 7 +
.../3.5.1/_static/copy-button.svg | 5 +
.../3.5.1/_static/copybutton.css | 94 +
.../3.5.1/_static/copybutton.js | 248 +
.../3.5.1/_static/copybutton_funcs.js | 73 +
.../3.5.1/_static/doctools.js | 156 +
.../3.5.1/_static/documentation_options.js | 14 +
.../3.5.1/_static/file.png | Bin 0 -> 286 bytes
.../3.5.1/_static/graphviz.css | 19 +
.../3.5.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../3.5.1/_static/jquery.js | 2 +
.../3.5.1/_static/js/globaltoc.js | 24 +
.../3.5.1/_static/language_data.js | 199 +
.../3.5.1/_static/minus.png | Bin 0 -> 90 bytes
.../3.5.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../3.5.1/_static/plus.png | Bin 0 -> 90 bytes
.../3.5.1/_static/pygments.css | 74 +
.../3.5.1/_static/searchtools.js | 566 +
.../3.5.1/_static/sphinx_highlight.js | 144 +
.../3.5.1/_static/underscore-1.13.1.js | 2042 +++
.../3.5.1/_static/underscore.js | 6 +
.../3.5.1/commits.html | 2009 +++
.../3.5.1/connections/docker.html} | 176 +-
.../3.5.1/decorators/docker.html} | 274 +-
.../3.5.1/genindex.html} | 530 +-
.../3.5.1/index.html} | 681 +-
.../3.5.1/installing-providers-from-sources.html} | 253 +-
.../3.5.1/objects.inv | Bin 0 -> 1107 bytes
.../3.5.1/py-modindex.html} | 307 +-
.../3.5.1/search.html} | 237 +-
.../3.5.1/searchindex.js | 1 +
.../apache-airflow-providers-docker/stable.txt | 2 +-
.../8.10.0/.buildinfo | 4 +
.../providers/google/ads/hooks/ads}/index.html | 224 +-
.../airflow/providers/google/ads/hooks/index.html} | 213 +-
.../_api/airflow/providers/google/ads/index.html} | 218 +-
.../providers/google/ads/operators/ads}/index.html | 143 +-
.../providers/google/ads/operators/index.html} | 213 +-
.../google/ads/transfers/ads_to_gcs}/index.html | 145 +-
.../providers/google/ads/transfers/index.html} | 213 +-
.../google/cloud/hooks/automl}/index.html | 671 +-
.../google/cloud/hooks/bigquery/index.html | 2898 ++++
.../google/cloud/hooks/bigquery_dts}/index.html | 345 +-
.../google/cloud/hooks/bigtable}/index.html | 305 +-
.../google/cloud/hooks/cloud_build}/index.html | 619 +-
.../google/cloud/hooks/cloud_composer}/index.html | 555 +-
.../cloud/hooks/cloud_memorystore}/index.html | 960 +-
.../google/cloud/hooks/cloud_sql}/index.html | 1007 +-
.../cloud_storage_transfer_service/index.html | 1775 ++
.../google/cloud/hooks/compute}/index.html | 716 +-
.../google/cloud/hooks/compute_ssh}/index.html | 173 +-
.../google/cloud/hooks/datacatalog/index.html | 1558 ++
.../google/cloud/hooks/dataflow}/index.html | 906 +-
.../google/cloud/hooks/dataform}/index.html | 583 +-
.../google/cloud/hooks/datafusion}/index.html | 614 +-
.../google/cloud/hooks/dataplex}/index.html | 321 +-
.../google/cloud/hooks/dataprep}/index.html | 352 +-
.../google/cloud/hooks/dataproc/index.html | 2103 +++
.../cloud/hooks/dataproc_metastore}/index.html | 656 +-
.../google/cloud/hooks/datastore}/index.html | 409 +-
.../providers/google/cloud/hooks/dlp/index.html | 1780 ++
.../google/cloud/hooks/functions}/index.html | 291 +-
.../providers/google/cloud/hooks/gcs}/index.html | 982 +-
.../providers/google/cloud/hooks/gdm}/index.html | 147 +-
.../providers/google/cloud/hooks}/index.html | 218 +-
.../providers/google/cloud/hooks/kms}/index.html | 211 +-
.../cloud/hooks/kubernetes_engine}/index.html | 357 +-
.../google/cloud/hooks/life_sciences}/index.html | 180 +-
.../google/cloud/hooks/looker}/index.html | 382 +-
.../google/cloud/hooks/mlengine}/index.html | 511 +-
.../cloud/hooks/natural_language}/index.html | 281 +-
.../google/cloud/hooks/os_login}/index.html | 152 +-
.../google/cloud/hooks/pubsub}/index.html | 556 +-
.../google/cloud/hooks/secret_manager}/index.html | 155 +-
.../google/cloud/hooks/spanner}/index.html | 351 +-
.../google/cloud/hooks/speech_to_text}/index.html | 157 +-
.../google/cloud/hooks/stackdriver}/index.html | 545 +-
.../providers/google/cloud/hooks/tasks}/index.html | 637 +-
.../google/cloud/hooks/text_to_speech}/index.html | 168 +-
.../google/cloud/hooks/translate}/index.html | 175 +-
.../cloud/hooks/vertex_ai/auto_ml/index.html | 1670 ++
.../vertex_ai/batch_prediction_job}/index.html | 435 +-
.../cloud/hooks/vertex_ai/custom_job/index.html | 2205 +++
.../cloud/hooks/vertex_ai/dataset}/index.html | 573 +-
.../hooks/vertex_ai/endpoint_service}/index.html | 568 +-
.../hyperparameter_tuning_job}/index.html | 583 +-
.../google/cloud/hooks/vertex_ai/index.html} | 228 +-
.../hooks/vertex_ai/model_service}/index.html | 348 +-
.../cloud/hooks/video_intelligence}/index.html | 163 +-
.../google/cloud/hooks/vision}/index.html | 629 +-
.../google/cloud/hooks/workflows}/index.html | 514 +-
.../airflow/providers/google/cloud}/index.html | 701 +-
.../google/cloud/links/automl}/index.html | 394 +-
.../providers/google/cloud/links/base}/index.html | 166 +-
.../google/cloud/links/bigquery}/index.html | 234 +-
.../google/cloud/links/bigquery_dts}/index.html | 163 +-
.../google/cloud/links/bigtable}/index.html | 283 +-
.../google/cloud/links/cloud_build}/index.html | 337 +-
.../google/cloud/links/cloud_functions}/index.html | 234 +-
.../cloud/links/cloud_memorystore}/index.html | 338 +-
.../google/cloud/links/cloud_sql}/index.html | 234 +-
.../cloud/links/cloud_storage_transfer}/index.html | 306 +-
.../google/cloud/links/cloud_tasks}/index.html | 226 +-
.../google/cloud/links/compute}/index.html | 284 +-
.../cloud/links/data_loss_prevention/index.html | 1526 ++
.../google/cloud/links/datacatalog}/index.html | 284 +-
.../google/cloud/links/dataflow}/index.html | 163 +-
.../google/cloud/links/dataform}/index.html | 284 +-
.../google/cloud/links/datafusion}/index.html | 334 +-
.../google/cloud/links/dataplex}/index.html | 284 +-
.../google/cloud/links/dataprep}/index.html | 233 +-
.../google/cloud/links/dataproc}/index.html | 302 +-
.../google/cloud/links/datastore}/index.html | 243 +-
.../providers/google/cloud/links}/index.html | 170 +-
.../cloud/links/kubernetes_engine}/index.html | 233 +-
.../google/cloud/links/life_sciences}/index.html | 162 +-
.../google/cloud/links/mlengine}/index.html | 394 +-
.../google/cloud/links/pubsub}/index.html | 234 +-
.../google/cloud/links/spanner}/index.html | 234 +-
.../google/cloud/links/stackdriver}/index.html | 234 +-
.../google/cloud/links/vertex_ai/index.html | 1580 ++
.../google/cloud/links/workflows}/index.html | 284 +-
.../google/cloud/log/gcs_task_handler}/index.html | 230 +-
.../airflow/providers/google/cloud/log/index.html} | 214 +-
.../cloud/log/stackdriver_task_handler}/index.html | 316 +-
.../google/cloud/operators/automl/index.html | 1848 ++
.../google/cloud/operators/bigquery/index.html | 3052 ++++
.../cloud/operators/bigquery_dts}/index.html | 306 +-
.../google/cloud/operators/bigtable}/index.html | 706 +-
.../google/cloud/operators/cloud_build/index.html | 1753 ++
.../cloud/operators/cloud_composer}/index.html | 975 +-
.../cloud/operators/cloud_memorystore/index.html | 2227 +++
.../google/cloud/operators/cloud_sql/index.html | 1704 ++
.../cloud_storage_transfer_service/index.html | 1688 ++
.../google/cloud/operators/compute/index.html | 1887 +++
.../google/cloud/operators/datacatalog/index.html | 2481 +++
.../google/cloud/operators/dataflow/index.html | 1882 +++
.../google/cloud/operators/dataform/index.html | 1739 ++
.../google/cloud/operators/datafusion/index.html | 1632 ++
.../google/cloud/operators/dataplex}/index.html | 679 +-
.../google/cloud/operators/dataprep}/index.html | 555 +-
.../google/cloud/operators/dataproc/index.html | 2658 +++
.../cloud/operators/dataproc_metastore/index.html | 1836 ++
.../google/cloud/operators/datastore}/index.html | 1076 +-
.../google/cloud/operators/dlp/index.html | 3113 ++++
.../google/cloud/operators/functions}/index.html | 611 +-
.../google/cloud/operators/gcs/index.html | 1619 ++
.../providers/google/cloud/operators}/index.html | 214 +-
.../cloud/operators/kubernetes_engine}/index.html | 372 +-
.../cloud/operators/life_sciences}/index.html | 136 +-
.../google/cloud/operators/looker}/index.html | 146 +-
.../google/cloud/operators/mlengine/index.html | 1882 +++
.../cloud/operators/natural_language}/index.html | 345 +-
.../google/cloud/operators/pubsub/index.html | 1539 ++
.../google/cloud/operators/spanner}/index.html | 677 +-
.../cloud/operators/speech_to_text}/index.html | 143 +-
.../google/cloud/operators/stackdriver/index.html | 1746 ++
.../google/cloud/operators/tasks/index.html | 1856 ++
.../cloud/operators/text_to_speech}/index.html | 166 +-
.../google/cloud/operators/translate}/index.html | 154 +-
.../cloud/operators/translate_speech}/index.html | 187 +-
.../cloud/operators/vertex_ai/auto_ml}/index.html | 639 +-
.../vertex_ai/batch_prediction_job}/index.html | 698 +-
.../operators/vertex_ai/custom_job/index.html | 2009 +++
.../cloud/operators/vertex_ai/dataset}/index.html | 738 +-
.../vertex_ai/endpoint_service}/index.html | 1059 +-
.../hyperparameter_tuning_job}/index.html | 661 +-
.../google/cloud/operators/vertex_ai/index.html} | 221 +-
.../operators/vertex_ai/model_service}/index.html | 614 +-
.../cloud/operators/video_intelligence}/index.html | 290 +-
.../google/cloud/operators/vision/index.html | 2139 +++
.../google/cloud/operators/workflows/index.html | 1469 ++
.../providers/google/cloud/secrets/index.html} | 213 +-
.../cloud/secrets/secret_manager}/index.html | 264 +-
.../google/cloud/sensors/bigquery}/index.html | 276 +-
.../google/cloud/sensors/bigquery_dts}/index.html | 139 +-
.../google/cloud/sensors/bigtable}/index.html | 133 +-
.../cloud/sensors/cloud_composer}/index.html | 142 +-
.../cloud_storage_transfer_service}/index.html | 133 +-
.../google/cloud/sensors/dataflow}/index.html | 337 +-
.../google/cloud/sensors/dataform}/index.html | 138 +-
.../google/cloud/sensors/datafusion}/index.html | 138 +-
.../google/cloud/sensors/dataplex}/index.html | 185 +-
.../google/cloud/sensors/dataprep}/index.html | 119 +-
.../google/cloud/sensors/dataproc}/index.html | 210 +-
.../providers/google/cloud/sensors/gcs}/index.html | 643 +-
.../providers/google/cloud/sensors}/index.html | 157 +-
.../google/cloud/sensors/looker}/index.html | 131 +-
.../google/cloud/sensors/pubsub}/index.html | 186 +-
.../google/cloud/sensors/tasks}/index.html | 128 +-
.../google/cloud/sensors/workflows}/index.html | 128 +-
.../google/cloud/transfers/adls_to_gcs}/index.html | 206 +-
.../transfers/azure_fileshare_to_gcs}/index.html | 147 +-
.../transfers/bigquery_to_bigquery}/index.html | 182 +-
.../cloud/transfers/bigquery_to_gcs}/index.html | 195 +-
.../cloud/transfers/bigquery_to_mssql}/index.html | 180 +-
.../cloud/transfers/bigquery_to_mysql}/index.html | 179 +-
.../cloud/transfers/calendar_to_gcs}/index.html | 182 +-
.../cloud/transfers/cassandra_to_gcs}/index.html | 346 +-
.../transfers/facebook_ads_to_gcs}/index.html | 201 +-
.../cloud/transfers/gcs_to_bigquery}/index.html | 297 +-
.../google/cloud/transfers/gcs_to_gcs}/index.html | 290 +-
.../cloud/transfers/gcs_to_local}/index.html | 149 +-
.../google/cloud/transfers/gcs_to_sftp}/index.html | 219 +-
.../cloud/transfers/gdrive_to_gcs}/index.html | 139 +-
.../cloud/transfers/gdrive_to_local}/index.html | 136 +-
.../providers/google/cloud/transfers}/index.html | 168 +-
.../cloud/transfers/local_to_gcs}/index.html | 138 +-
.../cloud/transfers/mssql_to_gcs}/index.html | 169 +-
.../cloud/transfers/mysql_to_gcs}/index.html | 159 +-
.../cloud/transfers/oracle_to_gcs}/index.html | 157 +-
.../cloud/transfers/postgres_to_gcs}/index.html | 152 +-
.../cloud/transfers/presto_to_gcs}/index.html | 145 +-
.../google/cloud/transfers/s3_to_gcs}/index.html | 198 +-
.../cloud/transfers/salesforce_to_gcs}/index.html | 156 +-
.../google/cloud/transfers/sftp_to_gcs}/index.html | 194 +-
.../cloud/transfers/sheets_to_gcs}/index.html | 139 +-
.../google/cloud/transfers/sql_to_gcs}/index.html | 224 +-
.../cloud/transfers/trino_to_gcs}/index.html | 145 +-
.../google/cloud/triggers/bigquery}/index.html | 547 +-
.../google/cloud/triggers/bigquery_dts}/index.html | 148 +-
.../google/cloud/triggers/cloud_build}/index.html | 141 +-
.../cloud/triggers/cloud_composer}/index.html | 145 +-
.../google/cloud/triggers/dataflow}/index.html | 171 +-
.../google/cloud/triggers/datafusion}/index.html | 145 +-
.../google/cloud/triggers/dataproc}/index.html | 322 +-
.../google/cloud/triggers/gcs}/index.html | 185 +-
.../providers/google/cloud/triggers}/index.html | 151 +-
.../cloud/triggers/kubernetes_engine}/index.html | 185 +-
.../google/cloud/triggers/mlengine}/index.html | 130 +-
.../google/cloud/utils/bigquery/index.html} | 249 +-
.../cloud/utils/bigquery_get_data/index.html} | 247 +-
.../cloud/utils/credentials_provider}/index.html | 260 +-
.../google/cloud/utils/dataform}/index.html | 161 +-
.../google/cloud/utils/field_sanitizer}/index.html | 209 +-
.../google/cloud/utils/field_validator}/index.html | 328 +-
.../google/cloud/utils/helpers/index.html} | 249 +-
.../providers/google/cloud/utils}/index.html | 150 +-
.../utils/mlengine_operator_utils}/index.html | 287 +-
.../utils/mlengine_prediction_summary}/index.html | 216 +-
.../common/auth_backend/google_openid}/index.html | 184 +-
.../google/common/auth_backend/index.html} | 213 +-
.../providers/google/common/consts}/index.html | 141 +-
.../google/common/hooks/base_google}/index.html | 704 +-
.../google/common/hooks/discovery_api}/index.html | 170 +-
.../providers/google/common/hooks/index.html} | 214 +-
.../airflow/providers/google/common/index.html} | 235 +-
.../providers/google/common/links/index.html} | 213 +-
.../google/common/links/storage}/index.html | 234 +-
.../common/utils/id_token_credentials}/index.html | 218 +-
.../providers/google/common/utils/index.html} | 213 +-
.../providers/google/config_templates/index.html} | 210 +-
.../google/firebase/hooks/firestore}/index.html | 179 +-
.../providers/google/firebase/hooks/index.html} | 213 +-
.../airflow/providers/google/firebase/index.html} | 214 +-
.../firebase/operators/firestore}/index.html | 137 +-
.../google/firebase/operators/index.html} | 213 +-
.../providers/google/go_module_utils}/index.html | 210 +-
.../_api/airflow/providers/google}/index.html | 818 +-
.../providers/google/leveldb/hooks/index.html} | 213 +-
.../google/leveldb/hooks/leveldb}/index.html | 280 +-
.../airflow/providers/google/leveldb/index.html} | 214 +-
.../providers/google/leveldb/operators/index.html} | 213 +-
.../google/leveldb/operators/leveldb}/index.html | 155 +-
.../marketing_platform/hooks/analytics}/index.html | 233 +-
.../hooks/campaign_manager}/index.html | 312 +-
.../hooks/display_video}/index.html | 278 +-
.../google/marketing_platform/hooks/index.html} | 216 +-
.../hooks/search_ads}/index.html | 155 +-
.../google/marketing_platform/index.html} | 231 +-
.../operators/analytics}/index.html | 628 +-
.../operators/campaign_manager}/index.html | 685 +-
.../operators/display_video}/index.html | 760 +-
.../marketing_platform/operators/index.html} | 216 +-
.../operators/search_ads}/index.html | 215 +-
.../sensors/campaign_manager}/index.html | 136 +-
.../sensors/display_video}/index.html | 179 +-
.../google/marketing_platform/sensors/index.html} | 215 +-
.../sensors/search_ads}/index.html | 134 +-
.../google/suite/hooks/calendar}/index.html | 217 +-
.../providers/google/suite/hooks/drive}/index.html | 259 +-
.../providers/google/suite/hooks/index.html} | 215 +-
.../google/suite/hooks/sheets}/index.html | 411 +-
.../airflow/providers/google/suite/index.html} | 232 +-
.../providers/google/suite/operators/index.html} | 213 +-
.../google/suite/operators/sheets}/index.html | 134 +-
.../google/suite/sensors/drive}/index.html | 133 +-
.../providers/google/suite/sensors/index.html} | 213 +-
.../suite/transfers/gcs_to_gdrive}/index.html | 199 +-
.../suite/transfers/gcs_to_sheets}/index.html | 136 +-
.../providers/google/suite/transfers/index.html} | 216 +-
.../suite/transfers/local_to_drive}/index.html | 151 +-
.../suite/transfers/sql_to_sheets}/index.html | 169 +-
.../providers/google/ads/example_ads}/index.html | 222 +-
.../tests/system/providers/google/ads/index.html} | 211 +-
.../automl/example_automl_dataset}/index.html | 389 +-
.../cloud/automl/example_automl_model}/index.html | 423 +-
.../example_automl_nl_text_extraction}/index.html | 265 +-
.../index.html | 296 +-
.../providers/google/cloud/automl/index.html} | 226 +-
.../google/cloud/automl/resources/index.html} | 214 +-
.../example_azure_fileshare_to_gcs}/index.html | 236 +-
.../providers/google/cloud/azure/index.html} | 213 +-
.../bigquery/example_bigquery_dataset}/index.html | 225 +-
.../bigquery/example_bigquery_dts}/index.html | 272 +-
.../example_bigquery_operations}/index.html | 237 +-
.../index.html | 232 +-
.../bigquery/example_bigquery_queries}/index.html | 258 +-
.../example_bigquery_queries_async}/index.html | 287 +-
.../bigquery/example_bigquery_sensors}/index.html | 258 +-
.../bigquery/example_bigquery_tables}/index.html | 251 +-
.../example_bigquery_to_bigquery}/index.html | 237 +-
.../bigquery/example_bigquery_to_gcs}/index.html | 244 +-
.../example_bigquery_to_gcs_async}/index.html | 244 +-
.../bigquery/example_bigquery_to_mssql}/index.html | 244 +-
.../bigquery/example_bigquery_transfer}/index.html | 244 +-
.../providers/google/cloud/bigquery}/index.html | 225 +-
.../google/cloud/bigquery/resources/index.html} | 214 +-
.../cloud/bigtable/example_bigtable}/index.html | 416 +-
.../providers/google/cloud/bigtable/index.html} | 213 +-
.../cloud_build/example_cloud_build}/index.html | 289 +-
.../example_cloud_build_async}/index.html | 289 +-
.../example_cloud_build_trigger}/index.html | 253 +-
.../providers/google/cloud/cloud_build/index.html} | 218 +-
.../google/cloud/cloud_build/resources/index.html} | 214 +-
.../cloud_functions/example_functions}/index.html | 394 +-
.../google/cloud/cloud_functions/index.html} | 213 +-
.../index.html | 253 +-
.../example_cloud_memorystore_redis}/index.html | 279 +-
.../google/cloud/cloud_memorystore/index.html} | 214 +-
.../cloud/cloud_sql/example_cloud_sql}/index.html | 393 +-
.../providers/google/cloud/cloud_sql/index.html} | 213 +-
.../composer/example_cloud_composer}/index.html | 250 +-
.../example_cloud_composer_deferrable}/index.html | 266 +-
.../providers/google/cloud/composer/index.html} | 214 +-
.../cloud/compute/example_compute}/index.html | 289 +-
.../cloud/compute/example_compute_igm}/index.html | 382 +-
.../cloud/compute/example_compute_ssh}/index.html | 252 +-
.../providers/google/cloud/compute/index.html} | 215 +-
.../example_dlp_deidentify_content}/index.html | 265 +-
.../example_dlp_info_types}/index.html | 387 +-
.../example_dlp_inspect_template}/index.html | 244 +-
.../example_dlp_job}/index.html | 237 +-
.../example_dlp_job_trigger}/index.html | 239 +-
.../google/cloud/data_loss_prevention/index.html} | 227 +-
.../data_loss_prevention/resources/index.html} | 214 +-
.../example_dataflow_native_java}/index.html | 265 +-
.../example_dataflow_native_python}/index.html | 272 +-
.../index.html | 288 +-
.../dataflow/example_dataflow_template}/index.html | 273 +-
.../providers/google/cloud/dataflow/index.html} | 226 +-
.../google/cloud/dataflow/resources/index.html} | 214 +-
.../cloud/dataform/example_dataform}/index.html | 246 +-
.../providers/google/cloud/dataform/index.html} | 213 +-
.../datafusion/example_datafusion}/index.html | 272 +-
.../example_datafusion_async}/index.html | 272 +-
.../providers/google/cloud/datafusion/index.html} | 214 +-
.../cloud/dataplex/example_dataplex}/index.html | 316 +-
.../providers/google/cloud/dataplex/index.html} | 219 +-
.../google/cloud/dataplex/resources/index.html} | 215 +-
.../resources/spark_example_pi/index.html} | 232 +-
.../cloud/dataprep/example_dataprep}/index.html | 258 +-
.../providers/google/cloud/dataprep/index.html} | 213 +-
.../dataproc/example_dataproc_batch}/index.html | 258 +-
.../example_dataproc_batch_deferrable}/index.html | 238 +-
.../example_dataproc_batch_persistent}/index.html | 274 +-
.../index.html | 296 +-
.../example_dataproc_cluster_generator}/index.html | 273 +-
.../dataproc/example_dataproc_gke}/index.html | 251 +-
.../dataproc/example_dataproc_hadoop}/index.html | 309 +-
.../dataproc/example_dataproc_hive}/index.html | 274 +-
.../dataproc/example_dataproc_pig}/index.html | 258 +-
.../dataproc/example_dataproc_pyspark}/index.html | 279 +-
.../dataproc/example_dataproc_spark}/index.html | 258 +-
.../example_dataproc_spark_async}/index.html | 258 +-
.../example_dataproc_spark_deferrable}/index.html | 259 +-
.../example_dataproc_spark_sql}/index.html | 258 +-
.../dataproc/example_dataproc_sparkr}/index.html | 279 +-
.../dataproc/example_dataproc_update}/index.html | 281 +-
.../dataproc/example_dataproc_workflow}/index.html | 274 +-
.../providers/google/cloud/dataproc}/index.html | 232 +-
.../dataproc/resources/hello_world}/index.html | 212 +-
.../google/cloud/dataproc/resources/index.html} | 215 +-
.../example_dataproc_metastore}/index.html | 388 +-
.../example_dataproc_metastore_backup}/index.html | 259 +-
.../google/cloud/dataproc_metastore/index.html} | 214 +-
.../datastore/example_datastore_commit}/index.html | 239 +-
.../example_datastore_export_import}/index.html | 232 +-
.../datastore/example_datastore_query}/index.html | 239 +-
.../example_datastore_rollback}/index.html | 232 +-
.../providers/google/cloud/datastore/index.html} | 216 +-
.../cloud/gcs/example_calendar_to_gcs}/index.html | 254 +-
.../google/cloud/gcs/example_firestore}/index.html | 318 +-
.../google/cloud/gcs/example_gcs_acl}/index.html | 274 +-
.../cloud/gcs/example_gcs_copy_delete}/index.html | 245 +-
.../cloud/gcs/example_gcs_sensor}/index.html | 282 +-
.../cloud/gcs/example_gcs_to_bigquery}/index.html | 239 +-
.../gcs/example_gcs_to_bigquery_async}/index.html | 286 +-
.../cloud/gcs/example_gcs_to_gcs}/index.html | 240 +-
.../cloud/gcs/example_gcs_to_gdrive}/index.html | 260 +-
.../cloud/gcs/example_gcs_to_sheets}/index.html | 245 +-
.../cloud/gcs/example_gcs_transform}/index.html | 244 +-
.../gcs/example_gcs_transform_timespan}/index.html | 265 +-
.../gcs/example_gcs_upload_download}/index.html | 244 +-
.../cloud/gcs/example_gdrive_to_gcs}/index.html | 250 +-
.../cloud/gcs/example_mssql_to_gcs}/index.html | 254 +-
.../cloud/gcs/example_mysql_to_gcs}/index.html | 254 +-
.../cloud/gcs/example_oracle_to_gcs}/index.html | 236 +-
.../google/cloud/gcs/example_s3_to_gcs}/index.html | 304 +-
.../cloud/gcs/example_sftp_to_gcs}/index.html | 286 +-
.../google/cloud/gcs/example_sheets}/index.html | 243 +-
.../cloud/gcs/example_sheets_to_gcs}/index.html | 238 +-
.../cloud/gcs/example_trino_to_gcs}/index.html | 278 +-
.../system/providers/google/cloud/gcs}/index.html | 238 +-
.../google/cloud/gcs/resources/index.html} | 216 +-
.../gcs/resources/transform_script}/index.html | 212 +-
.../gcs/resources/transform_timespan}/index.html | 226 +-
.../system/providers/google/cloud}/index.html | 517 +-
.../example_kubernetes_engine}/index.html | 237 +-
.../example_kubernetes_engine_async}/index.html | 253 +-
.../google/cloud/kubernetes_engine/index.html} | 214 +-
.../example_life_sciences}/index.html | 264 +-
.../google/cloud/life_sciences/index.html} | 216 +-
.../cloud/life_sciences/resources/index.html} | 214 +-
.../cloud/ml_engine/example_mlengine}/index.html | 444 +-
.../ml_engine/example_mlengine_async}/index.html | 444 +-
.../providers/google/cloud/ml_engine/index.html} | 214 +-
.../example_natural_language}/index.html | 246 +-
.../google/cloud/natural_language/index.html} | 213 +-
.../google/cloud/pubsub/example_pubsub}/index.html | 251 +-
.../providers/google/cloud/pubsub/index.html} | 213 +-
.../cloud/spanner/example_spanner}/index.html | 258 +-
.../providers/google/cloud/spanner/index.html} | 213 +-
.../example_speech_to_text}/index.html | 264 +-
.../google/cloud/speech_to_text/index.html} | 213 +-
.../example_sql_to_sheets}/index.html | 231 +-
.../google/cloud/sql_to_sheets/index.html} | 213 +-
.../stackdriver/example_stackdriver}/index.html | 272 +-
.../providers/google/cloud/stackdriver/index.html} | 213 +-
.../index.html | 310 +-
.../google/cloud/storage_transfer/index.html} | 216 +-
.../cloud/storage_transfer/resources/index.html} | 214 +-
.../google/cloud/tasks/example_queue}/index.html | 243 +-
.../google/cloud/tasks/example_tasks}/index.html | 298 +-
.../providers/google/cloud/tasks/index.html} | 214 +-
.../example_text_to_speech}/index.html | 250 +-
.../google/cloud/text_to_speech/index.html} | 213 +-
.../transfers/example_gcs_to_sftp}/index.html | 295 +-
.../transfers/example_gdrive_to_local}/index.html | 246 +-
.../providers/google/cloud/transfers/index.html} | 217 +-
.../google/cloud/transfers/resources/index.html} | 214 +-
.../cloud/translate/example_translate}/index.html | 212 +-
.../providers/google/cloud/translate/index.html} | 213 +-
.../example_translate_speech}/index.html | 292 +-
.../google/cloud/translate_speech/index.html} | 213 +-
.../index.html | 380 +-
.../index.html | 359 +-
.../index.html | 232 +-
.../index.html | 359 +-
.../index.html | 302 +-
.../index.html | 286 +-
.../index.html | 401 +-
.../example_vertex_ai_custom_container}/index.html | 422 +-
.../example_vertex_ai_custom_job}/index.html | 373 +-
.../index.html | 443 +-
.../example_vertex_ai_dataset}/index.html | 387 +-
.../example_vertex_ai_endpoint}/index.html | 302 +-
.../index.html | 366 +-
.../example_vertex_ai_list_custom_jobs}/index.html | 232 +-
.../example_vertex_ai_model_service}/index.html | 394 +-
.../providers/google/cloud/vertex_ai}/index.html | 227 +-
.../google/cloud/vertex_ai/resources/index.html} | 214 +-
.../example_video_intelligence}/index.html | 249 +-
.../google/cloud/video_intelligence/index.html} | 213 +-
.../example_vision_annotate_image}/index.html | 271 +-
.../example_vision_autogenerated}/index.html | 386 +-
.../vision/example_vision_explicit}/index.html | 372 +-
.../providers/google/cloud/vision/index.html} | 215 +-
.../cloud/workflows/example_workflows}/index.html | 310 +-
.../providers/google/cloud/workflows/index.html} | 213 +-
.../system/providers/google/conftest}/index.html | 157 +-
.../example_datacatalog_entries}/index.html | 201 +-
.../example_datacatalog_search_catalog}/index.html | 253 +-
.../example_datacatalog_tag_templates}/index.html | 201 +-
.../example_datacatalog_tags}/index.html | 253 +-
.../providers/google/datacatalog/index.html} | 214 +-
.../system/providers/google/firebase/index.html} | 210 +-
.../_api/tests/system/providers/google}/index.html | 601 +-
.../google/leveldb/example_leveldb}/index.html | 216 +-
.../system/providers/google/leveldb/index.html} | 211 +-
.../example_analytics}/index.html | 195 +-
.../example_campaign_manager}/index.html | 230 +-
.../example_search_ads}/index.html | 181 +-
.../google/marketing_platform/index.html} | 213 +-
.../suite/example_local_to_drive}/index.html | 190 +-
.../system/providers/google/suite/index.html} | 214 +-
.../providers/google/suite/resources/index.html} | 212 +-
.../system/providers/google/workplace/index.html} | 210 +-
.../8.10.0/_modules/airflow/providers/google.html} | 275 +-
.../airflow/providers/google/ads/hooks/ads.html} | 497 +-
.../providers/google/ads/operators/ads.html} | 307 +-
.../google/ads/transfers/ads_to_gcs.html} | 322 +-
.../providers/google/cloud/hooks/automl.html} | 872 +-
.../providers/google/cloud/hooks/bigquery.html | 4074 +++++
.../google/cloud/hooks/bigquery_dts.html} | 576 +-
.../providers/google/cloud/hooks/bigtable.html} | 541 +-
.../providers/google/cloud/hooks/cloud_build.html} | 866 +-
.../google/cloud/hooks/cloud_composer.html} | 658 +-
.../google/cloud/hooks/cloud_memorystore.html | 1722 ++
.../providers/google/cloud/hooks/cloud_sql.html | 1783 ++
.../hooks/cloud_storage_transfer_service.html} | 725 +-
.../providers/google/cloud/hooks/compute.html | 1659 ++
.../providers/google/cloud/hooks/compute_ssh.html} | 562 +-
.../providers/google/cloud/hooks/datacatalog.html | 1991 +++
.../providers/google/cloud/hooks/dataflow.html | 2092 +++
.../providers/google/cloud/hooks/dataform.html} | 888 +-
.../providers/google/cloud/hooks/datafusion.html} | 824 +-
.../providers/google/cloud/hooks/dataplex.html} | 605 +-
.../providers/google/cloud/hooks/dataprep.html} | 443 +-
.../providers/google/cloud/hooks/dataproc.html | 2545 +++
.../google/cloud/hooks/dataproc_metastore.html} | 881 +-
.../providers/google/cloud/hooks/datastore.html} | 581 +-
.../airflow/providers/google/cloud/hooks/dlp.html | 2261 +++
.../providers/google/cloud/hooks/functions.html} | 517 +-
.../airflow/providers/google/cloud/hooks/gcs.html | 2028 +++
.../airflow/providers/google/cloud/hooks/gdm.html} | 293 +-
.../airflow/providers/google/cloud/hooks/kms.html} | 355 +-
.../google/cloud/hooks/kubernetes_engine.html} | 569 +-
.../google/cloud/hooks/life_sciences.html} | 345 +-
.../providers/google/cloud/hooks/looker.html} | 494 +-
.../providers/google/cloud/hooks/mlengine.html} | 821 +-
.../google/cloud/hooks/natural_language.html} | 531 +-
.../providers/google/cloud/hooks/os_login.html} | 278 +-
.../providers/google/cloud/hooks/pubsub.html} | 805 +-
.../google/cloud/hooks/secret_manager.html} | 263 +-
.../providers/google/cloud/hooks/spanner.html} | 601 +-
.../google/cloud/hooks/speech_to_text.html} | 275 +-
.../providers/google/cloud/hooks/stackdriver.html} | 822 +-
.../providers/google/cloud/hooks/tasks.html} | 836 +-
.../google/cloud/hooks/text_to_speech.html} | 309 +-
.../providers/google/cloud/hooks/translate.html} | 289 +-
.../google/cloud/hooks/vertex_ai/auto_ml.html | 2135 +++
.../hooks/vertex_ai/batch_prediction_job.html} | 670 +-
.../google/cloud/hooks/vertex_ai/custom_job.html | 2878 ++++
.../google/cloud/hooks/vertex_ai/dataset.html} | 781 +-
.../cloud/hooks/vertex_ai/endpoint_service.html} | 696 +-
.../vertex_ai/hyperparameter_tuning_job.html} | 738 +-
.../cloud/hooks/vertex_ai/model_service.html} | 401 +-
.../google/cloud/hooks/video_intelligence.html} | 317 +-
.../providers/google/cloud/hooks/vision.html | 1496 ++
.../providers/google/cloud/hooks/workflows.html} | 590 +-
.../providers/google/cloud/links/automl.html} | 354 +-
.../providers/google/cloud/links/base.html} | 224 +-
.../providers/google/cloud/links/bigquery.html} | 253 +-
.../google/cloud/links/bigquery_dts.html} | 226 +-
.../providers/google/cloud/links/bigtable.html} | 289 +-
.../providers/google/cloud/links/cloud_build.html} | 317 +-
.../google/cloud/links/cloud_functions.html} | 254 +-
.../google/cloud/links/cloud_memorystore.html} | 312 +-
.../providers/google/cloud/links/cloud_sql.html} | 250 +-
.../cloud/links/cloud_storage_transfer.html} | 318 +-
.../providers/google/cloud/links/cloud_tasks.html} | 257 +-
.../providers/google/cloud/links/compute.html} | 303 +-
.../google/cloud/links/data_loss_prevention.html} | 597 +-
.../providers/google/cloud/links/datacatalog.html} | 305 +-
.../providers/google/cloud/links/dataflow.html} | 226 +-
.../providers/google/cloud/links/dataform.html} | 318 +-
.../providers/google/cloud/links/datafusion.html} | 321 +-
.../providers/google/cloud/links/dataplex.html} | 295 +-
.../providers/google/cloud/links/dataprep.html} | 237 +-
.../providers/google/cloud/links/dataproc.html} | 309 +-
.../providers/google/cloud/links/datastore.html} | 245 +-
.../google/cloud/links/kubernetes_engine.html} | 258 +-
.../google/cloud/links/life_sciences.html} | 223 +-
.../providers/google/cloud/links/mlengine.html} | 331 +-
.../providers/google/cloud/links/pubsub.html} | 247 +-
.../providers/google/cloud/links/spanner.html} | 250 +-
.../providers/google/cloud/links/stackdriver.html} | 245 +-
.../providers/google/cloud/links/vertex_ai.html} | 600 +-
.../providers/google/cloud/links/workflows.html} | 296 +-
.../google/cloud/log/gcs_task_handler.html} | 478 +-
.../cloud/log/stackdriver_task_handler.html} | 630 +-
.../providers/google/cloud/operators/automl.html | 2073 +++
.../providers/google/cloud/operators/bigquery.html | 3600 ++++
.../google/cloud/operators/bigquery_dts.html} | 652 +-
.../google/cloud/operators/bigtable.html} | 833 +-
.../google/cloud/operators/cloud_build.html | 1908 +++
.../google/cloud/operators/cloud_composer.html | 1540 ++
.../google/cloud/operators/cloud_memorystore.html | 2529 +++
.../google/cloud/operators/cloud_sql.html | 1933 +++
.../operators/cloud_storage_transfer_service.html | 1934 +++
.../providers/google/cloud/operators/compute.html | 2512 +++
.../google/cloud/operators/datacatalog.html | 3022 ++++
.../providers/google/cloud/operators/dataflow.html | 2201 +++
.../providers/google/cloud/operators/dataform.html | 2063 +++
.../google/cloud/operators/datafusion.html | 1870 ++
.../providers/google/cloud/operators/dataplex.html | 1493 ++
.../google/cloud/operators/dataprep.html} | 552 +-
.../providers/google/cloud/operators/dataproc.html | 3407 ++++
.../google/cloud/operators/dataproc_metastore.html | 1929 +++
.../google/cloud/operators/datastore.html | 1529 ++
.../providers/google/cloud/operators/dlp.html | 3717 ++++
.../google/cloud/operators/functions.html} | 730 +-
.../providers/google/cloud/operators/gcs.html | 1853 ++
.../google/cloud/operators/kubernetes_engine.html} | 768 +-
.../google/cloud/operators/life_sciences.html} | 277 +-
.../providers/google/cloud/operators/looker.html} | 300 +-
.../providers/google/cloud/operators/mlengine.html | 2332 +++
.../google/cloud/operators/natural_language.html} | 576 +-
.../providers/google/cloud/operators/pubsub.html | 1676 ++
.../providers/google/cloud/operators/spanner.html} | 833 +-
.../google/cloud/operators/speech_to_text.html} | 316 +-
.../google/cloud/operators/stackdriver.html | 1830 ++
.../providers/google/cloud/operators/tasks.html | 2020 +++
.../google/cloud/operators/text_to_speech.html} | 343 +-
.../google/cloud/operators/translate.html} | 325 +-
.../google/cloud/operators/translate_speech.html} | 380 +-
.../google/cloud/operators/vertex_ai/auto_ml.html | 1494 ++
.../operators/vertex_ai/batch_prediction_job.html} | 827 +-
.../cloud/operators/vertex_ai/custom_job.html | 2243 +++
.../google/cloud/operators/vertex_ai/dataset.html | 1435 ++
.../operators/vertex_ai/endpoint_service.html | 1505 ++
.../vertex_ai/hyperparameter_tuning_job.html} | 821 +-
.../cloud/operators/vertex_ai/model_service.html} | 698 +-
.../cloud/operators/video_intelligence.html} | 554 +-
.../providers/google/cloud/operators/vision.html | 2355 +++
.../google/cloud/operators/workflows.html | 1563 ++
.../google/cloud/secrets/secret_manager.html} | 469 +-
.../providers/google/cloud/sensors/bigquery.html} | 522 +-
.../google/cloud/sensors/bigquery_dts.html} | 334 +-
.../providers/google/cloud/sensors/bigtable.html} | 310 +-
.../google/cloud/sensors/cloud_composer.html} | 299 +-
.../sensors/cloud_storage_transfer_service.html} | 308 +-
.../providers/google/cloud/sensors/dataflow.html} | 640 +-
.../providers/google/cloud/sensors/dataform.html} | 306 +-
.../google/cloud/sensors/datafusion.html} | 327 +-
.../providers/google/cloud/sensors/dataplex.html} | 317 +-
.../providers/google/cloud/sensors/dataprep.html} | 227 +-
.../providers/google/cloud/sensors/dataproc.html} | 461 +-
.../providers/google/cloud/sensors/gcs.html} | 711 +-
.../providers/google/cloud/sensors/looker.html} | 261 +-
.../providers/google/cloud/sensors/pubsub.html} | 363 +-
.../providers/google/cloud/sensors/tasks.html} | 263 +-
.../providers/google/cloud/sensors/workflows.html} | 313 +-
.../google/cloud/transfers/adls_to_gcs.html} | 363 +-
.../cloud/transfers/azure_fileshare_to_gcs.html} | 367 +-
.../cloud/transfers/bigquery_to_bigquery.html} | 344 +-
.../google/cloud/transfers/bigquery_to_gcs.html} | 525 +-
.../google/cloud/transfers/bigquery_to_mssql.html} | 346 +-
.../google/cloud/transfers/bigquery_to_mysql.html} | 339 +-
.../google/cloud/transfers/calendar_to_gcs.html} | 476 +-
.../google/cloud/transfers/cassandra_to_gcs.html} | 641 +-
.../cloud/transfers/facebook_ads_to_gcs.html} | 477 +-
.../google/cloud/transfers/gcs_to_bigquery.html | 1562 ++
.../google/cloud/transfers/gcs_to_gcs.html} | 720 +-
.../google/cloud/transfers/gcs_to_local.html} | 327 +-
.../google/cloud/transfers/gcs_to_sftp.html} | 484 +-
.../google/cloud/transfers/gdrive_to_gcs.html} | 303 +-
.../google/cloud/transfers/gdrive_to_local.html} | 274 +-
.../google/cloud/transfers/local_to_gcs.html} | 317 +-
.../google/cloud/transfers/mssql_to_gcs.html} | 268 +-
.../google/cloud/transfers/mysql_to_gcs.html} | 323 +-
.../google/cloud/transfers/oracle_to_gcs.html} | 314 +-
.../google/cloud/transfers/postgres_to_gcs.html} | 351 +-
.../google/cloud/transfers/presto_to_gcs.html} | 483 +-
.../google/cloud/transfers/s3_to_gcs.html} | 493 +-
.../google/cloud/transfers/salesforce_to_gcs.html} | 310 +-
.../google/cloud/transfers/sftp_to_gcs.html} | 464 +-
.../google/cloud/transfers/sheets_to_gcs.html} | 336 +-
.../google/cloud/transfers/sql_to_gcs.html} | 722 +-
.../google/cloud/transfers/trino_to_gcs.html} | 483 +-
.../providers/google/cloud/triggers/bigquery.html} | 774 +-
.../google/cloud/triggers/bigquery_dts.html} | 353 +-
.../google/cloud/triggers/cloud_build.html} | 321 +-
.../google/cloud/triggers/cloud_composer.html} | 263 +-
.../providers/google/cloud/triggers/dataflow.html} | 341 +-
.../google/cloud/triggers/datafusion.html} | 327 +-
.../providers/google/cloud/triggers/dataproc.html} | 559 +-
.../providers/google/cloud/triggers/gcs.html} | 294 +-
.../google/cloud/triggers/kubernetes_engine.html} | 312 +-
.../providers/google/cloud/triggers/mlengine.html} | 315 +-
.../providers/google/cloud/utils/bigquery.html} | 273 +-
.../google/cloud/utils/bigquery_get_data.html} | 230 +-
.../google/cloud/utils/credentials_provider.html} | 620 +-
.../providers/google/cloud/utils/dataform.html} | 398 +-
.../google/cloud/utils/field_sanitizer.html} | 355 +-
.../google/cloud/utils/field_validator.html} | 708 +-
.../providers/google/cloud/utils/helpers.html} | 260 +-
.../cloud/utils/mlengine_operator_utils.html} | 537 +-
.../cloud/utils/mlengine_prediction_summary.html} | 406 +-
.../google/common/auth_backend/google_openid.html} | 324 +-
.../airflow/providers/google/common/consts.html} | 262 +-
.../providers/google/common/hooks/base_google.html | 1457 ++
.../google/common/hooks/discovery_api.html} | 351 +-
.../providers/google/common/links/storage.html} | 236 +-
.../google/common/utils/id_token_credentials.html} | 481 +-
.../google/firebase/hooks/firestore.html} | 338 +-
.../google/firebase/operators/firestore.html} | 267 +-
.../airflow/providers/google/go_module_utils.html} | 284 +-
.../providers/google/leveldb/hooks/leveldb.html} | 344 +-
.../google/leveldb/operators/leveldb.html} | 268 +-
.../marketing_platform/hooks/analytics.html} | 479 +-
.../hooks/campaign_manager.html} | 556 +-
.../marketing_platform/hooks/display_video.html} | 487 +-
.../marketing_platform/hooks/search_ads.html} | 264 +-
.../marketing_platform/operators/analytics.html} | 755 +-
.../operators/campaign_manager.html} | 844 +-
.../operators/display_video.html | 1517 ++
.../marketing_platform/operators/search_ads.html} | 510 +-
.../sensors/campaign_manager.html} | 275 +-
.../marketing_platform/sensors/display_video.html} | 346 +-
.../marketing_platform/sensors/search_ads.html} | 265 +-
.../providers/google/suite/hooks/calendar.html} | 483 +-
.../providers/google/suite/hooks/drive.html} | 499 +-
.../providers/google/suite/hooks/sheets.html} | 646 +-
.../providers/google/suite/operators/sheets.html} | 252 +-
.../providers/google/suite/sensors/drive.html} | 261 +-
.../google/suite/transfers/gcs_to_gdrive.html} | 359 +-
.../google/suite/transfers/gcs_to_sheets.html} | 283 +-
.../google/suite/transfers/local_to_drive.html} | 325 +-
.../google/suite/transfers/sql_to_sheets.html} | 323 +-
.../8.10.0/_modules/index.html} | 517 +-
.../system/providers/google/ads/example_ads.html} | 318 +-
.../cloud/automl/example_automl_dataset.html} | 374 +-
.../google/cloud/automl/example_automl_model.html} | 458 +-
.../automl/example_automl_nl_text_extraction.html} | 301 +-
.../example_automl_vision_classification.html} | 332 +-
.../azure/example_azure_fileshare_to_gcs.html} | 263 +-
.../cloud/bigquery/example_bigquery_dataset.html} | 270 +-
.../cloud/bigquery/example_bigquery_dts.html} | 364 +-
.../bigquery/example_bigquery_operations.html} | 282 +-
.../example_bigquery_operations_location.html} | 262 +-
.../cloud/bigquery/example_bigquery_queries.html} | 431 +-
.../bigquery/example_bigquery_queries_async.html} | 444 +-
.../cloud/bigquery/example_bigquery_sensors.html} | 315 +-
.../cloud/bigquery/example_bigquery_tables.html} | 407 +-
.../bigquery/example_bigquery_to_bigquery.html} | 285 +-
.../cloud/bigquery/example_bigquery_to_gcs.html} | 281 +-
.../bigquery/example_bigquery_to_gcs_async.html} | 280 +-
.../cloud/bigquery/example_bigquery_to_mssql.html} | 273 +-
.../cloud/bigquery/example_bigquery_transfer.html} | 299 +-
.../google/cloud/bigtable/example_bigtable.html} | 396 +-
.../cloud/cloud_build/example_cloud_build.html} | 418 +-
.../cloud_build/example_cloud_build_async.html} | 393 +-
.../cloud_build/example_cloud_build_trigger.html} | 335 +-
.../cloud/cloud_functions/example_functions.html} | 331 +-
.../example_cloud_memorystore_memcached.html} | 326 +-
.../example_cloud_memorystore_redis.html} | 476 +-
.../google/cloud/cloud_sql/example_cloud_sql.html} | 484 +-
.../cloud/composer/example_cloud_composer.html} | 309 +-
.../example_cloud_composer_deferrable.html} | 299 +-
.../google/cloud/compute/example_compute.html} | 459 +-
.../google/cloud/compute/example_compute_igm.html} | 456 +-
.../google/cloud/compute/example_compute_ssh.html} | 302 +-
.../example_dlp_deidentify_content.html} | 341 +-
.../example_dlp_info_types.html} | 335 +-
.../example_dlp_inspect_template.html} | 299 +-
.../data_loss_prevention/example_dlp_job.html} | 274 +-
.../example_dlp_job_trigger.html} | 279 +-
.../dataflow/example_dataflow_native_java.html} | 289 +-
.../dataflow/example_dataflow_native_python.html} | 296 +-
.../example_dataflow_native_python_async.html} | 401 +-
.../cloud/dataflow/example_dataflow_template.html} | 271 +-
.../google/cloud/dataform/example_dataform.html} | 480 +-
.../cloud/datafusion/example_datafusion.html} | 503 +-
.../datafusion/example_datafusion_async.html} | 483 +-
.../google/cloud/dataplex/example_dataplex.html} | 387 +-
.../dataplex/resources/spark_example_pi.html} | 278 +-
.../google/cloud/dataprep/example_dataprep.html} | 348 +-
.../cloud/dataproc/example_dataproc_batch.html} | 355 +-
.../example_dataproc_batch_deferrable.html} | 263 +-
.../example_dataproc_batch_persistent.html} | 296 +-
.../example_dataproc_cluster_deferrable.html} | 297 +-
.../example_dataproc_cluster_generator.html} | 296 +-
.../cloud/dataproc/example_dataproc_gke.html} | 297 +-
.../cloud/dataproc/example_dataproc_hadoop.html} | 315 +-
.../cloud/dataproc/example_dataproc_hive.html} | 288 +-
.../cloud/dataproc/example_dataproc_pig.html} | 282 +-
.../cloud/dataproc/example_dataproc_pyspark.html} | 312 +-
.../cloud/dataproc/example_dataproc_spark.html} | 284 +-
.../dataproc/example_dataproc_spark_async.html} | 292 +-
.../example_dataproc_spark_deferrable.html} | 285 +-
.../dataproc/example_dataproc_spark_sql.html} | 280 +-
.../cloud/dataproc/example_dataproc_sparkr.html} | 306 +-
.../cloud/dataproc/example_dataproc_update.html} | 290 +-
.../cloud/dataproc/example_dataproc_workflow.html} | 277 +-
.../cloud/dataproc/resources/hello_world.html} | 260 +-
.../example_dataproc_metastore.html} | 400 +-
.../example_dataproc_metastore_backup.html} | 309 +-
.../cloud/datastore/example_datastore_commit.html} | 272 +-
.../example_datastore_export_import.html} | 287 +-
.../cloud/datastore/example_datastore_query.html} | 312 +-
.../datastore/example_datastore_rollback.html} | 295 +-
.../google/cloud/gcs/example_calendar_to_gcs.html} | 306 +-
.../google/cloud/gcs/example_firestore.html} | 343 +-
.../google/cloud/gcs/example_gcs_acl.html} | 295 +-
.../google/cloud/gcs/example_gcs_copy_delete.html} | 304 +-
.../google/cloud/gcs/example_gcs_sensor.html} | 342 +-
.../google/cloud/gcs/example_gcs_to_bigquery.html} | 264 +-
.../cloud/gcs/example_gcs_to_bigquery_async.html} | 356 +-
.../google/cloud/gcs/example_gcs_to_gcs.html} | 419 +-
.../google/cloud/gcs/example_gcs_to_gdrive.html} | 302 +-
.../google/cloud/gcs/example_gcs_to_sheets.html} | 259 +-
.../google/cloud/gcs/example_gcs_transform.html} | 275 +-
.../cloud/gcs/example_gcs_transform_timespan.html} | 294 +-
.../cloud/gcs/example_gcs_upload_download.html} | 275 +-
.../google/cloud/gcs/example_gdrive_to_gcs.html} | 284 +-
.../google/cloud/gcs/example_mssql_to_gcs.html} | 262 +-
.../google/cloud/gcs/example_mysql_to_gcs.html} | 310 +-
.../google/cloud/gcs/example_oracle_to_gcs.html} | 302 +-
.../google/cloud/gcs/example_s3_to_gcs.html} | 275 +-
.../google/cloud/gcs/example_sftp_to_gcs.html} | 303 +-
.../google/cloud/gcs/example_sheets.html} | 284 +-
.../google/cloud/gcs/example_sheets_to_gcs.html} | 304 +-
.../google/cloud/gcs/example_trino_to_gcs.html} | 388 +-
.../cloud/gcs/resources/transform_script.html} | 263 +-
.../cloud/gcs/resources/transform_timespan.html} | 273 +-
.../example_kubernetes_engine.html} | 292 +-
.../example_kubernetes_engine_async.html} | 290 +-
.../life_sciences/example_life_sciences.html} | 315 +-
.../google/cloud/ml_engine/example_mlengine.html} | 657 +-
.../cloud/ml_engine/example_mlengine_async.html} | 658 +-
.../example_natural_language.html} | 297 +-
.../google/cloud/pubsub/example_pubsub.html} | 331 +-
.../google/cloud/spanner/example_spanner.html} | 344 +-
.../speech_to_text/example_speech_to_text.html} | 271 +-
.../sql_to_sheets/example_sql_to_sheets.html} | 287 +-
.../cloud/stackdriver/example_stackdriver.html} | 439 +-
...xample_cloud_storage_transfer_service_gcp.html} | 383 +-
.../google/cloud/tasks/example_queue.html} | 372 +-
.../google/cloud/tasks/example_tasks.html} | 367 +-
.../text_to_speech/example_text_to_speech.html} | 262 +-
.../cloud/transfers/example_gcs_to_sftp.html} | 354 +-
.../cloud/transfers/example_gdrive_to_local.html} | 291 +-
.../google/cloud/translate/example_translate.html} | 303 +-
.../example_translate_speech.html} | 294 +-
...le_vertex_ai_auto_ml_forecasting_training.html} | 368 +-
.../example_vertex_ai_auto_ml_image_training.html} | 358 +-
.../example_vertex_ai_auto_ml_list_training.html} | 294 +-
...xample_vertex_ai_auto_ml_tabular_training.html} | 362 +-
.../example_vertex_ai_auto_ml_text_training.html} | 356 +-
.../example_vertex_ai_auto_ml_video_training.html} | 352 +-
.../example_vertex_ai_batch_prediction_job.html} | 407 +-
.../example_vertex_ai_custom_container.html} | 356 +-
.../vertex_ai/example_vertex_ai_custom_job.html} | 377 +-
...ample_vertex_ai_custom_job_python_package.html} | 393 +-
.../vertex_ai/example_vertex_ai_dataset.html} | 640 +-
.../vertex_ai/example_vertex_ai_endpoint.html} | 458 +-
...ample_vertex_ai_hyperparameter_tuning_job.html} | 331 +-
.../example_vertex_ai_list_custom_jobs.html} | 292 +-
.../example_vertex_ai_model_service.html} | 419 +-
.../example_video_intelligence.html} | 341 +-
.../vision/example_vision_annotate_image.html} | 374 +-
.../vision/example_vision_autogenerated.html} | 451 +-
.../cloud/vision/example_vision_explicit.html} | 460 +-
.../google/cloud/workflows/example_workflows.html} | 445 +-
.../tests/system/providers/google/conftest.html} | 261 +-
.../datacatalog/example_datacatalog_entries.html} | 487 +-
.../example_datacatalog_search_catalog.html} | 508 +-
.../example_datacatalog_tag_templates.html} | 470 +-
.../datacatalog/example_datacatalog_tags.html} | 520 +-
.../providers/google/leveldb/example_leveldb.html} | 246 +-
.../marketing_platform/example_analytics.html} | 291 +-
.../example_campaign_manager.html} | 478 +-
.../marketing_platform/example_search_ads.html} | 263 +-
.../google/suite/example_local_to_drive.html} | 259 +-
.../providers/google/ads/hooks/ads/index.rst.txt | 113 +
.../providers/google/ads/hooks/index.rst.txt | 15 +
.../airflow/providers/google/ads/index.rst.txt | 17 +
.../google/ads/operators/ads/index.rst.txt | 73 +
.../providers/google/ads/operators/index.rst.txt | 15 +
.../google/ads/transfers/ads_to_gcs/index.rst.txt | 69 +
.../providers/google/ads/transfers/index.rst.txt | 15 +
.../google/cloud/hooks/automl/index.rst.txt | 329 +
.../google/cloud/hooks/bigquery/index.rst.txt | 1294 ++
.../google/cloud/hooks/bigquery_dts/index.rst.txt | 166 +
.../google/cloud/hooks/bigtable/index.rst.txt | 157 +
.../google/cloud/hooks/cloud_build/index.rst.txt | 277 +
.../cloud/hooks/cloud_composer/index.rst.txt | 214 +
.../cloud/hooks/cloud_memorystore/index.rst.txt | 406 +
.../google/cloud/hooks/cloud_sql/index.rst.txt | 446 +
.../cloud_storage_transfer_service/index.rst.txt | 530 +
.../google/cloud/hooks/compute/index.rst.txt | 383 +
.../google/cloud/hooks/compute_ssh/index.rst.txt | 74 +
.../google/cloud/hooks/datacatalog/index.rst.txt | 513 +
.../google/cloud/hooks/dataflow/index.rst.txt | 438 +
.../google/cloud/hooks/dataform/index.rst.txt | 232 +
.../google/cloud/hooks/datafusion/index.rst.txt | 275 +
.../google/cloud/hooks/dataplex/index.rst.txt | 169 +
.../google/cloud/hooks/dataprep/index.rst.txt | 153 +
.../google/cloud/hooks/dataproc/index.rst.txt | 845 +
.../cloud/hooks/dataproc_metastore/index.rst.txt | 331 +
.../google/cloud/hooks/datastore/index.rst.txt | 185 +
.../providers/google/cloud/hooks/dlp/index.rst.txt | 658 +
.../google/cloud/hooks/functions/index.rst.txt | 115 +
.../providers/google/cloud/hooks/gcs/index.rst.txt | 468 +
.../providers/google/cloud/hooks/gdm/index.rst.txt | 50 +
.../providers/google/cloud/hooks/index.rst.txt | 65 +
.../providers/google/cloud/hooks/kms/index.rst.txt | 86 +
.../cloud/hooks/kubernetes_engine/index.rst.txt | 164 +
.../google/cloud/hooks/life_sciences/index.rst.txt | 78 +
.../google/cloud/hooks/looker/index.rst.txt | 133 +
.../google/cloud/hooks/mlengine/index.rst.txt | 243 +
.../cloud/hooks/natural_language/index.rst.txt | 140 +
.../google/cloud/hooks/os_login/index.rst.txt | 59 +
.../google/cloud/hooks/pubsub/index.rst.txt | 246 +
.../cloud/hooks/secret_manager/index.rst.txt | 65 +
.../google/cloud/hooks/spanner/index.rst.txt | 159 +
.../cloud/hooks/speech_to_text/index.rst.txt | 65 +
.../google/cloud/hooks/stackdriver/index.rst.txt | 227 +
.../google/cloud/hooks/tasks/index.rst.txt | 296 +
.../cloud/hooks/text_to_speech/index.rst.txt | 72 +
.../google/cloud/hooks/translate/index.rst.txt | 77 +
.../cloud/hooks/vertex_ai/auto_ml/index.rst.txt | 716 +
.../vertex_ai/batch_prediction_job/index.rst.txt | 202 +
.../cloud/hooks/vertex_ai/custom_job/index.rst.txt | 1119 ++
.../cloud/hooks/vertex_ai/dataset/index.rst.txt | 193 +
.../hooks/vertex_ai/endpoint_service/index.rst.txt | 195 +
.../hyperparameter_tuning_job/index.rst.txt | 205 +
.../google/cloud/hooks/vertex_ai/index.rst.txt | 21 +
.../hooks/vertex_ai/model_service/index.rst.txt | 118 +
.../cloud/hooks/video_intelligence/index.rst.txt | 76 +
.../google/cloud/hooks/vision/index.rst.txt | 244 +
.../google/cloud/hooks/workflows/index.rst.txt | 189 +
.../airflow/providers/google/cloud/index.rst.txt | 23 +
.../google/cloud/links/automl/index.rst.txt | 191 +
.../google/cloud/links/base/index.rst.txt | 66 +
.../google/cloud/links/bigquery/index.rst.txt | 98 +
.../google/cloud/links/bigquery_dts/index.rst.txt | 67 +
.../google/cloud/links/bigtable/index.rst.txt | 124 +
.../google/cloud/links/cloud_build/index.rst.txt | 155 +
.../cloud/links/cloud_functions/index.rst.txt | 98 +
.../cloud/links/cloud_memorystore/index.rst.txt | 160 +
.../google/cloud/links/cloud_sql/index.rst.txt | 98 +
.../links/cloud_storage_transfer/index.rst.txt | 139 +
.../google/cloud/links/cloud_tasks/index.rst.txt | 105 +
.../google/cloud/links/compute/index.rst.txt | 129 +
.../cloud/links/data_loss_prevention/index.rst.txt | 377 +
.../google/cloud/links/datacatalog/index.rst.txt | 129 +
.../google/cloud/links/dataflow/index.rst.txt | 67 +
.../google/cloud/links/dataform/index.rst.txt | 129 +
.../google/cloud/links/datafusion/index.rst.txt | 167 +
.../google/cloud/links/dataplex/index.rst.txt | 130 +
.../google/cloud/links/dataprep/index.rst.txt | 93 +
.../google/cloud/links/dataproc/index.rst.txt | 133 +
.../google/cloud/links/datastore/index.rst.txt | 99 +
.../providers/google/cloud/links/index.rst.txt | 43 +
.../cloud/links/kubernetes_engine/index.rst.txt | 93 +
.../google/cloud/links/life_sciences/index.rst.txt | 62 +
.../google/cloud/links/mlengine/index.rst.txt | 191 +
.../google/cloud/links/pubsub/index.rst.txt | 98 +
.../google/cloud/links/spanner/index.rst.txt | 98 +
.../google/cloud/links/stackdriver/index.rst.txt | 98 +
.../google/cloud/links/vertex_ai/index.rst.txt | 410 +
.../google/cloud/links/workflows/index.rst.txt | 129 +
.../cloud/log/gcs_task_handler/index.rst.txt | 105 +
.../providers/google/cloud/log/index.rst.txt | 16 +
.../log/stackdriver_task_handler/index.rst.txt | 176 +
.../google/cloud/operators/automl/index.rst.txt | 716 +
.../google/cloud/operators/bigquery/index.rst.txt | 1585 ++
.../cloud/operators/bigquery_dts/index.rst.txt | 193 +
.../google/cloud/operators/bigtable/index.rst.txt | 378 +
.../cloud/operators/cloud_build/index.rst.txt | 634 +
.../cloud/operators/cloud_composer/index.rst.txt | 377 +
.../operators/cloud_memorystore/index.rst.txt | 995 ++
.../google/cloud/operators/cloud_sql/index.rst.txt | 597 +
.../cloud_storage_transfer_service/index.rst.txt | 594 +
.../google/cloud/operators/compute/index.rst.txt | 733 +
.../cloud/operators/datacatalog/index.rst.txt | 1205 ++
.../google/cloud/operators/dataflow/index.rst.txt | 845 +
.../google/cloud/operators/dataform/index.rst.txt | 605 +
.../cloud/operators/datafusion/index.rst.txt | 554 +
.../google/cloud/operators/dataplex/index.rst.txt | 331 +
.../google/cloud/operators/dataprep/index.rst.txt | 216 +
.../google/cloud/operators/dataproc/index.rst.txt | 1289 ++
.../operators/dataproc_metastore/index.rst.txt | 679 +
.../google/cloud/operators/datastore/index.rst.txt | 457 +
.../google/cloud/operators/dlp/index.rst.txt | 1659 ++
.../google/cloud/operators/functions/index.rst.txt | 259 +
.../google/cloud/operators/gcs/index.rst.txt | 574 +
.../providers/google/cloud/operators/index.rst.txt | 61 +
.../operators/kubernetes_engine/index.rst.txt | 240 +
.../cloud/operators/life_sciences/index.rst.txt | 69 +
.../google/cloud/operators/looker/index.rst.txt | 62 +
.../google/cloud/operators/mlengine/index.rst.txt | 768 +
.../cloud/operators/natural_language/index.rst.txt | 214 +
.../google/cloud/operators/pubsub/index.rst.txt | 571 +
.../google/cloud/operators/spanner/index.rst.txt | 336 +
.../cloud/operators/speech_to_text/index.rst.txt | 76 +
.../cloud/operators/stackdriver/index.rst.txt | 658 +
.../google/cloud/operators/tasks/index.rst.txt | 732 +
.../cloud/operators/text_to_speech/index.rst.txt | 80 +
.../google/cloud/operators/translate/index.rst.txt | 92 +
.../cloud/operators/translate_speech/index.rst.txt | 114 +
.../operators/vertex_ai/auto_ml/index.rst.txt | 215 +
.../vertex_ai/batch_prediction_job/index.rst.txt | 310 +
.../operators/vertex_ai/custom_job/index.rst.txt | 998 ++
.../operators/vertex_ai/dataset/index.rst.txt | 329 +
.../vertex_ai/endpoint_service/index.rst.txt | 388 +
.../hyperparameter_tuning_job/index.rst.txt | 275 +
.../google/cloud/operators/vertex_ai/index.rst.txt | 21 +
.../vertex_ai/model_service/index.rst.txt | 221 +
.../operators/video_intelligence/index.rst.txt | 182 +
.../google/cloud/operators/vision/index.rst.txt | 935 +
.../google/cloud/operators/workflows/index.rst.txt | 413 +
.../providers/google/cloud/secrets/index.rst.txt | 15 +
.../cloud/secrets/secret_manager/index.rst.txt | 123 +
.../google/cloud/sensors/bigquery/index.rst.txt | 152 +
.../cloud/sensors/bigquery_dts/index.rst.txt | 70 +
.../google/cloud/sensors/bigtable/index.rst.txt | 72 +
.../cloud/sensors/cloud_composer/index.rst.txt | 59 +
.../cloud_storage_transfer_service/index.rst.txt | 69 +
.../google/cloud/sensors/dataflow/index.rst.txt | 204 +
.../google/cloud/sensors/dataform/index.rst.txt | 65 +
.../google/cloud/sensors/datafusion/index.rst.txt | 66 +
.../google/cloud/sensors/dataplex/index.rst.txt | 92 +
.../google/cloud/sensors/dataprep/index.rst.txt | 44 +
.../google/cloud/sensors/dataproc/index.rst.txt | 101 +
.../google/cloud/sensors/gcs/index.rst.txt | 281 +
.../providers/google/cloud/sensors/index.rst.txt | 30 +
.../google/cloud/sensors/looker/index.rst.txt | 54 +
.../google/cloud/sensors/pubsub/index.rst.txt | 103 +
.../google/cloud/sensors/tasks/index.rst.txt | 55 +
.../google/cloud/sensors/workflows/index.rst.txt | 51 +
.../cloud/transfers/adls_to_gcs/index.rst.txt | 109 +
.../transfers/azure_fileshare_to_gcs/index.rst.txt | 68 +
.../transfers/bigquery_to_bigquery/index.rst.txt | 103 +
.../cloud/transfers/bigquery_to_gcs/index.rst.txt | 115 +
.../transfers/bigquery_to_mssql/index.rst.txt | 95 +
.../transfers/bigquery_to_mysql/index.rst.txt | 91 +
.../cloud/transfers/calendar_to_gcs/index.rst.txt | 85 +
.../cloud/transfers/cassandra_to_gcs/index.rst.txt | 191 +
.../transfers/facebook_ads_to_gcs/index.rst.txt | 101 +
.../cloud/transfers/gcs_to_bigquery/index.rst.txt | 202 +
.../cloud/transfers/gcs_to_gcs/index.rst.txt | 192 +
.../cloud/transfers/gcs_to_local/index.rst.txt | 79 +
.../cloud/transfers/gcs_to_sftp/index.rst.txt | 122 +
.../cloud/transfers/gdrive_to_gcs/index.rst.txt | 64 +
.../cloud/transfers/gdrive_to_local/index.rst.txt | 61 +
.../providers/google/cloud/transfers/index.rst.txt | 41 +
.../cloud/transfers/local_to_gcs/index.rst.txt | 66 +
.../cloud/transfers/mssql_to_gcs/index.rst.txt | 84 +
.../cloud/transfers/mysql_to_gcs/index.rst.txt | 79 +
.../cloud/transfers/oracle_to_gcs/index.rst.txt | 73 +
.../cloud/transfers/postgres_to_gcs/index.rst.txt | 68 +
.../cloud/transfers/presto_to_gcs/index.rst.txt | 55 +
.../google/cloud/transfers/s3_to_gcs/index.rst.txt | 102 +
.../transfers/salesforce_to_gcs/index.rst.txt | 70 +
.../cloud/transfers/sftp_to_gcs/index.rst.txt | 93 +
.../cloud/transfers/sheets_to_gcs/index.rst.txt | 64 +
.../cloud/transfers/sql_to_gcs/index.rst.txt | 130 +
.../cloud/transfers/trino_to_gcs/index.rst.txt | 55 +
.../google/cloud/triggers/bigquery/index.rst.txt | 171 +
.../cloud/triggers/bigquery_dts/index.rst.txt | 55 +
.../cloud/triggers/cloud_build/index.rst.txt | 53 +
.../cloud/triggers/cloud_composer/index.rst.txt | 51 +
.../google/cloud/triggers/dataflow/index.rst.txt | 73 +
.../google/cloud/triggers/datafusion/index.rst.txt | 57 +
.../google/cloud/triggers/dataproc/index.rst.txt | 171 +
.../google/cloud/triggers/gcs/index.rst.txt | 42 +
.../providers/google/cloud/triggers/index.rst.txt | 24 +
.../cloud/triggers/kubernetes_engine/index.rst.txt | 37 +
.../google/cloud/triggers/mlengine/index.rst.txt | 42 +
.../google/cloud/utils/bigquery/index.rst.txt | 25 +
.../cloud/utils/bigquery_get_data/index.rst.txt | 22 +
.../cloud/utils/credentials_provider/index.rst.txt | 103 +
.../google/cloud/utils/dataform/index.rst.txt | 59 +
.../cloud/utils/field_sanitizer/index.rst.txt | 126 +
.../cloud/utils/field_validator/index.rst.txt | 197 +
.../google/cloud/utils/helpers/index.rst.txt | 29 +
.../providers/google/cloud/utils/index.rst.txt | 23 +
.../utils/mlengine_operator_utils/index.rst.txt | 169 +
.../mlengine_prediction_summary/index.rst.txt | 150 +
.../auth_backend/google_openid/index.rst.txt | 63 +
.../google/common/auth_backend/index.rst.txt | 15 +
.../providers/google/common/consts/index.rst.txt | 18 +
.../google/common/hooks/base_google/index.rst.txt | 335 +
.../common/hooks/discovery_api/index.rst.txt | 70 +
.../providers/google/common/hooks/index.rst.txt | 16 +
.../airflow/providers/google/common/index.rst.txt | 27 +
.../providers/google/common/links/index.rst.txt | 15 +
.../google/common/links/storage/index.rst.txt | 98 +
.../utils/id_token_credentials/index.rst.txt | 102 +
.../providers/google/common/utils/index.rst.txt | 15 +
.../google/config_templates/index.rst.txt | 6 +
.../google/firebase/hooks/firestore/index.rst.txt | 80 +
.../providers/google/firebase/hooks/index.rst.txt | 15 +
.../providers/google/firebase/index.rst.txt | 16 +
.../firebase/operators/firestore/index.rst.txt | 62 +
.../google/firebase/operators/index.rst.txt | 15 +
.../providers/google/go_module_utils/index.rst.txt | 43 +
.../_api/airflow/providers/google/index.rst.txt | 47 +
.../providers/google/leveldb/hooks/index.rst.txt | 15 +
.../google/leveldb/hooks/leveldb/index.rst.txt | 131 +
.../airflow/providers/google/leveldb/index.rst.txt | 16 +
.../google/leveldb/operators/index.rst.txt | 15 +
.../google/leveldb/operators/leveldb/index.rst.txt | 49 +
.../hooks/analytics/index.rst.txt | 88 +
.../hooks/campaign_manager/index.rst.txt | 141 +
.../hooks/display_video/index.rst.txt | 134 +
.../google/marketing_platform/hooks/index.rst.txt | 18 +
.../hooks/search_ads/index.rst.txt | 58 +
.../google/marketing_platform/index.rst.txt | 17 +
.../operators/analytics/index.rst.txt | 278 +
.../operators/campaign_manager/index.rst.txt | 336 +
.../operators/display_video/index.rst.txt | 393 +
.../marketing_platform/operators/index.rst.txt | 18 +
.../operators/search_ads/index.rst.txt | 131 +
.../sensors/campaign_manager/index.rst.txt | 67 +
.../sensors/display_video/index.rst.txt | 100 +
.../marketing_platform/sensors/index.rst.txt | 17 +
.../sensors/search_ads/index.rst.txt | 65 +
.../google/suite/hooks/calendar/index.rst.txt | 102 +
.../google/suite/hooks/drive/index.rst.txt | 110 +
.../providers/google/suite/hooks/index.rst.txt | 17 +
.../google/suite/hooks/sheets/index.rst.txt | 198 +
.../airflow/providers/google/suite/index.rst.txt | 18 +
.../providers/google/suite/operators/index.rst.txt | 15 +
.../google/suite/operators/sheets/index.rst.txt | 59 +
.../google/suite/sensors/drive/index.rst.txt | 64 +
.../providers/google/suite/sensors/index.rst.txt | 15 +
.../suite/transfers/gcs_to_gdrive/index.rst.txt | 104 +
.../suite/transfers/gcs_to_sheets/index.rst.txt | 61 +
.../providers/google/suite/transfers/index.rst.txt | 18 +
.../suite/transfers/local_to_drive/index.rst.txt | 77 +
.../suite/transfers/sql_to_sheets/index.rst.txt | 74 +
.../providers/google/ads/example_ads/index.rst.txt | 93 +
.../system/providers/google/ads/index.rst.txt | 15 +
.../automl/example_automl_dataset/index.rst.txt | 104 +
.../automl/example_automl_model/index.rst.txt | 124 +
.../index.rst.txt | 64 +
.../index.rst.txt | 64 +
.../providers/google/cloud/automl/index.rst.txt | 27 +
.../google/cloud/automl/resources/index.rst.txt | 6 +
.../example_azure_fileshare_to_gcs/index.rst.txt | 43 +
.../providers/google/cloud/azure/index.rst.txt | 15 +
.../example_bigquery_dataset/index.rst.txt | 35 +
.../bigquery/example_bigquery_dts/index.rst.txt | 69 +
.../example_bigquery_operations/index.rst.txt | 48 +
.../index.rst.txt | 40 +
.../example_bigquery_queries/index.rst.txt | 63 +
.../example_bigquery_queries_async/index.rst.txt | 79 +
.../example_bigquery_sensors/index.rst.txt | 61 +
.../bigquery/example_bigquery_tables/index.rst.txt | 56 +
.../example_bigquery_to_bigquery/index.rst.txt | 50 +
.../bigquery/example_bigquery_to_gcs/index.rst.txt | 53 +
.../example_bigquery_to_gcs_async/index.rst.txt | 53 +
.../example_bigquery_to_mssql/index.rst.txt | 53 +
.../example_bigquery_transfer/index.rst.txt | 53 +
.../providers/google/cloud/bigquery/index.rst.txt | 36 +
.../google/cloud/bigquery/resources/index.rst.txt | 6 +
.../cloud/bigtable/example_bigtable/index.rst.txt | 123 +
.../providers/google/cloud/bigtable/index.rst.txt | 15 +
.../cloud_build/example_cloud_build/index.rst.txt | 80 +
.../example_cloud_build_async/index.rst.txt | 80 +
.../example_cloud_build_trigger/index.rst.txt | 59 +
.../google/cloud/cloud_build/index.rst.txt | 26 +
.../cloud/cloud_build/resources/index.rst.txt | 6 +
.../example_functions/index.rst.txt | 112 +
.../google/cloud/cloud_functions/index.rst.txt | 15 +
.../index.rst.txt | 48 +
.../example_cloud_memorystore_redis/index.rst.txt | 72 +
.../google/cloud/cloud_memorystore/index.rst.txt | 16 +
.../cloud_sql/example_cloud_sql/index.rst.txt | 98 +
.../providers/google/cloud/cloud_sql/index.rst.txt | 15 +
.../composer/example_cloud_composer/index.rst.txt | 51 +
.../index.rst.txt | 51 +
.../providers/google/cloud/composer/index.rst.txt | 16 +
.../cloud/compute/example_compute/index.rst.txt | 73 +
.../compute/example_compute_igm/index.rst.txt | 96 +
.../compute/example_compute_ssh/index.rst.txt | 60 +
.../providers/google/cloud/compute/index.rst.txt | 17 +
.../example_dlp_deidentify_content/index.rst.txt | 63 +
.../example_dlp_info_types/index.rst.txt | 94 +
.../example_dlp_inspect_template/index.rst.txt | 51 +
.../example_dlp_job/index.rst.txt | 47 +
.../example_dlp_job_trigger/index.rst.txt | 43 +
.../cloud/data_loss_prevention/index.rst.txt | 28 +
.../data_loss_prevention/resources/index.rst.txt | 6 +
.../example_dataflow_native_java/index.rst.txt | 68 +
.../example_dataflow_native_python/index.rst.txt | 69 +
.../index.rst.txt | 69 +
.../example_dataflow_template/index.rst.txt | 70 +
.../providers/google/cloud/dataflow/index.rst.txt | 27 +
.../google/cloud/dataflow/resources/index.rst.txt | 6 +
.../cloud/dataform/example_dataform/index.rst.txt | 48 +
.../providers/google/cloud/dataform/index.rst.txt | 15 +
.../datafusion/example_datafusion/index.rst.txt | 71 +
.../example_datafusion_async/index.rst.txt | 71 +
.../google/cloud/datafusion/index.rst.txt | 16 +
.../cloud/dataplex/example_dataplex/index.rst.txt | 86 +
.../providers/google/cloud/dataplex/index.rst.txt | 24 +
.../google/cloud/dataplex/resources/index.rst.txt | 15 +
.../resources/spark_example_pi/index.rst.txt | 13 +
.../cloud/dataprep/example_dataprep/index.rst.txt | 60 +
.../providers/google/cloud/dataprep/index.rst.txt | 15 +
.../dataproc/example_dataproc_batch/index.rst.txt | 60 +
.../index.rst.txt | 49 +
.../index.rst.txt | 60 +
.../index.rst.txt | 65 +
.../index.rst.txt | 71 +
.../dataproc/example_dataproc_gke/index.rst.txt | 56 +
.../dataproc/example_dataproc_hadoop/index.rst.txt | 82 +
.../dataproc/example_dataproc_hive/index.rst.txt | 61 +
.../dataproc/example_dataproc_pig/index.rst.txt | 61 +
.../example_dataproc_pyspark/index.rst.txt | 74 +
.../dataproc/example_dataproc_spark/index.rst.txt | 61 +
.../example_dataproc_spark_async/index.rst.txt | 61 +
.../index.rst.txt | 62 +
.../example_dataproc_spark_sql/index.rst.txt | 61 +
.../dataproc/example_dataproc_sparkr/index.rst.txt | 74 +
.../dataproc/example_dataproc_update/index.rst.txt | 65 +
.../example_dataproc_workflow/index.rst.txt | 61 +
.../providers/google/cloud/dataproc/index.rst.txt | 40 +
.../dataproc/resources/hello_world/index.rst.txt | 21 +
.../google/cloud/dataproc/resources/index.rst.txt | 15 +
.../example_dataproc_metastore/index.rst.txt | 96 +
.../index.rst.txt | 62 +
.../google/cloud/dataproc_metastore/index.rst.txt | 16 +
.../example_datastore_commit/index.rst.txt | 44 +
.../example_datastore_export_import/index.rst.txt | 39 +
.../example_datastore_query/index.rst.txt | 44 +
.../example_datastore_rollback/index.rst.txt | 40 +
.../providers/google/cloud/datastore/index.rst.txt | 18 +
.../gcs/example_calendar_to_gcs/index.rst.txt | 43 +
.../cloud/gcs/example_firestore/index.rst.txt | 86 +
.../google/cloud/gcs/example_gcs_acl/index.rst.txt | 63 +
.../gcs/example_gcs_copy_delete/index.rst.txt | 53 +
.../cloud/gcs/example_gcs_sensor/index.rst.txt | 84 +
.../gcs/example_gcs_to_bigquery/index.rst.txt | 44 +
.../example_gcs_to_bigquery_async/index.rst.txt | 81 +
.../cloud/gcs/example_gcs_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_gcs_to_gdrive/index.rst.txt | 64 +
.../cloud/gcs/example_gcs_to_sheets/index.rst.txt | 42 +
.../cloud/gcs/example_gcs_transform/index.rst.txt | 52 +
.../example_gcs_transform_timespan/index.rst.txt | 66 +
.../gcs/example_gcs_upload_download/index.rst.txt | 53 +
.../cloud/gcs/example_gdrive_to_gcs/index.rst.txt | 53 +
.../cloud/gcs/example_mssql_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_mysql_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_oracle_to_gcs/index.rst.txt | 44 +
.../cloud/gcs/example_s3_to_gcs/index.rst.txt | 79 +
.../cloud/gcs/example_sftp_to_gcs/index.rst.txt | 81 +
.../google/cloud/gcs/example_sheets/index.rst.txt | 46 +
.../cloud/gcs/example_sheets_to_gcs/index.rst.txt | 38 +
.../cloud/gcs/example_trino_to_gcs/index.rst.txt | 84 +
.../providers/google/cloud/gcs/index.rst.txt | 45 +
.../google/cloud/gcs/resources/index.rst.txt | 16 +
.../gcs/resources/transform_script/index.rst.txt | 21 +
.../gcs/resources/transform_timespan/index.rst.txt | 29 +
.../system/providers/google/cloud/index.rst.txt | 53 +
.../example_kubernetes_engine/index.rst.txt | 48 +
.../example_kubernetes_engine_async/index.rst.txt | 48 +
.../google/cloud/kubernetes_engine/index.rst.txt | 16 +
.../example_life_sciences/index.rst.txt | 60 +
.../google/cloud/life_sciences/index.rst.txt | 24 +
.../cloud/life_sciences/resources/index.rst.txt | 6 +
.../cloud/ml_engine/example_mlengine/index.rst.txt | 133 +
.../ml_engine/example_mlengine_async/index.rst.txt | 133 +
.../providers/google/cloud/ml_engine/index.rst.txt | 16 +
.../example_natural_language/index.rst.txt | 67 +
.../google/cloud/natural_language/index.rst.txt | 15 +
.../cloud/pubsub/example_pubsub/index.rst.txt | 68 +
.../providers/google/cloud/pubsub/index.rst.txt | 15 +
.../cloud/spanner/example_spanner/index.rst.txt | 62 +
.../providers/google/cloud/spanner/index.rst.txt | 15 +
.../example_speech_to_text/index.rst.txt | 58 +
.../google/cloud/speech_to_text/index.rst.txt | 15 +
.../example_sql_to_sheets/index.rst.txt | 35 +
.../google/cloud/sql_to_sheets/index.rst.txt | 15 +
.../stackdriver/example_stackdriver/index.rst.txt | 67 +
.../google/cloud/stackdriver/index.rst.txt | 15 +
.../index.rst.txt | 76 +
.../google/cloud/storage_transfer/index.rst.txt | 24 +
.../cloud/storage_transfer/resources/index.rst.txt | 6 +
.../google/cloud/tasks/example_queue/index.rst.txt | 66 +
.../google/cloud/tasks/example_tasks/index.rst.txt | 82 +
.../providers/google/cloud/tasks/index.rst.txt | 16 +
.../example_text_to_speech/index.rst.txt | 51 +
.../google/cloud/text_to_speech/index.rst.txt | 15 +
.../transfers/example_gcs_to_sftp/index.rst.txt | 76 +
.../example_gdrive_to_local/index.rst.txt | 56 +
.../providers/google/cloud/transfers/index.rst.txt | 25 +
.../google/cloud/transfers/resources/index.rst.txt | 6 +
.../translate/example_translate/index.rst.txt | 28 +
.../providers/google/cloud/translate/index.rst.txt | 15 +
.../example_translate_speech/index.rst.txt | 77 +
.../google/cloud/translate_speech/index.rst.txt | 15 +
.../index.rst.txt | 93 +
.../index.rst.txt | 78 +
.../index.rst.txt | 40 +
.../index.rst.txt | 79 +
.../index.rst.txt | 78 +
.../index.rst.txt | 78 +
.../index.rst.txt | 105 +
.../index.rst.txt | 123 +
.../example_vertex_ai_custom_job/index.rst.txt | 90 +
.../index.rst.txt | 137 +
.../example_vertex_ai_dataset/index.rst.txt | 93 +
.../example_vertex_ai_endpoint/index.rst.txt | 78 +
.../index.rst.txt | 84 +
.../index.rst.txt | 40 +
.../example_vertex_ai_model_service/index.rst.txt | 101 +
.../providers/google/cloud/vertex_ai/index.rst.txt | 38 +
.../google/cloud/vertex_ai/resources/index.rst.txt | 6 +
.../example_video_intelligence/index.rst.txt | 59 +
.../google/cloud/video_intelligence/index.rst.txt | 15 +
.../example_vision_annotate_image/index.rst.txt | 66 +
.../example_vision_autogenerated/index.rst.txt | 92 +
.../vision/example_vision_explicit/index.rst.txt | 85 +
.../providers/google/cloud/vision/index.rst.txt | 17 +
.../workflows/example_workflows/index.rst.txt | 110 +
.../providers/google/cloud/workflows/index.rst.txt | 15 +
.../system/providers/google/conftest/index.rst.txt | 35 +
.../example_datacatalog_entries/index.rst.txt | 57 +
.../index.rst.txt | 70 +
.../index.rst.txt | 58 +
.../example_datacatalog_tags/index.rst.txt | 70 +
.../providers/google/datacatalog/index.rst.txt | 18 +
.../system/providers/google/firebase/index.rst.txt | 6 +
.../tests/system/providers/google/index.rst.txt | 31 +
.../google/leveldb/example_leveldb/index.rst.txt | 31 +
.../system/providers/google/leveldb/index.rst.txt | 15 +
.../example_analytics/index.rst.txt | 57 +
.../example_campaign_manager/index.rst.txt | 75 +
.../example_search_ads/index.rst.txt | 47 +
.../google/marketing_platform/index.rst.txt | 17 +
.../suite/example_local_to_drive/index.rst.txt | 57 +
.../system/providers/google/suite/index.rst.txt | 24 +
.../providers/google/suite/resources/index.rst.txt | 6 +
.../providers/google/workplace/index.rst.txt | 6 +
.../api-auth-backend/google-openid.rst.txt | 69 +
.../8.10.0/_sources/commits.rst.txt | 1361 ++
.../8.10.0/_sources/configurations-ref.rst.txt | 71 +
.../8.10.0/_sources/connections/gcp.rst.txt | 291 +
.../8.10.0/_sources/connections/gcp_looker.rst.txt | 75 +
.../8.10.0/_sources/connections/gcp_sql.rst.txt | 78 +
.../8.10.0/_sources/connections/gcp_ssh.rst.txt | 72 +
.../8.10.0/_sources/connections/index.rst.txt | 25 +
.../8.10.0/_sources/example-dags.rst.txt | 28 +
.../8.10.0/_sources/index.rst.txt | 199 +
.../installing-providers-from-sources.rst.txt | 18 +
.../8.10.0/_sources/logging/gcs.rst.txt | 78 +
.../8.10.0/_sources/logging/index.rst.txt | 25 +
.../8.10.0/_sources/logging/stackdriver.rst.txt | 79 +
.../8.10.0/_sources/operators/ads.rst.txt | 64 +
.../8.10.0/_sources/operators/cloud/automl.rst.txt | 192 +
.../_sources/operators/cloud/bigquery.rst.txt | 518 +
.../_sources/operators/cloud/bigquery_dts.rst.txt | 131 +
.../_sources/operators/cloud/bigtable.rst.txt | 197 +
.../_sources/operators/cloud/cloud_build.rst.txt | 426 +
.../operators/cloud/cloud_composer.rst.txt | 159 +
.../operators/cloud/cloud_memorystore.rst.txt | 275 +
.../cloud/cloud_memorystore_memcached.rst.txt | 154 +
.../_sources/operators/cloud/cloud_sql.rst.txt | 568 +
.../cloud/cloud_storage_transfer_service.rst.txt | 375 +
.../_sources/operators/cloud/compute.rst.txt | 580 +
.../_sources/operators/cloud/compute_ssh.rst.txt | 68 +
.../operators/cloud/data_loss_prevention.rst.txt | 338 +
.../_sources/operators/cloud/datacatalog.rst.txt | 580 +
.../_sources/operators/cloud/dataflow.rst.txt | 310 +
.../_sources/operators/cloud/dataform.rst.txt | 230 +
.../_sources/operators/cloud/datafusion.rst.txt | 264 +
.../_sources/operators/cloud/dataplex.rst.txt | 144 +
.../_sources/operators/cloud/dataprep.rst.txt | 174 +
.../_sources/operators/cloud/dataproc.rst.txt | 377 +
.../operators/cloud/dataproc_metastore.rst.txt | 196 +
.../_sources/operators/cloud/datastore.rst.txt | 196 +
.../_sources/operators/cloud/functions.rst.txt | 188 +
.../8.10.0/_sources/operators/cloud/gcs.rst.txt | 236 +
.../8.10.0/_sources/operators/cloud/index.rst.txt | 32 +
.../operators/cloud/kubernetes_engine.rst.txt | 159 +
.../_sources/operators/cloud/life_sciences.rst.txt | 74 +
.../8.10.0/_sources/operators/cloud/looker.rst.txt | 70 +
.../_sources/operators/cloud/mlengine.rst.txt | 237 +
.../operators/cloud/natural_language.rst.txt | 178 +
.../8.10.0/_sources/operators/cloud/pubsub.rst.txt | 141 +
.../_sources/operators/cloud/spanner.rst.txt | 276 +
.../operators/cloud/speech_to_text.rst.txt | 81 +
.../_sources/operators/cloud/stackdriver.rst.txt | 227 +
.../8.10.0/_sources/operators/cloud/tasks.rst.txt | 229 +
.../operators/cloud/text_to_speech.rst.txt | 81 +
.../_sources/operators/cloud/translate.rst.txt | 79 +
.../operators/cloud/translate_speech.rst.txt | 78 +
.../_sources/operators/cloud/vertex_ai.rst.txt | 423 +
.../operators/cloud/video_intelligence.rst.txt | 184 +
.../8.10.0/_sources/operators/cloud/vision.rst.txt | 1025 ++
.../_sources/operators/cloud/workflows.rst.txt | 181 +
.../_sources/operators/firebase/firestore.rst.txt | 61 +
.../8.10.0/_sources/operators/index.rst.txt | 32 +
.../_sources/operators/leveldb/leveldb.rst.txt | 52 +
.../operators/marketing_platform/analytics.rst.txt | 81 +
.../marketing_platform/campaign_manager.rst.txt | 161 +
.../marketing_platform/display_video.rst.txt | 222 +
.../operators/marketing_platform/index.rst.txt | 32 +
.../marketing_platform/search_ads.rst.txt | 90 +
.../8.10.0/_sources/operators/suite/sheets.rst.txt | 62 +
.../transfer/azure_fileshare_to_gcs.rst.txt | 54 +
.../transfer/bigquery_to_bigquery.rst.txt | 66 +
.../operators/transfer/bigquery_to_gcs.rst.txt | 69 +
.../operators/transfer/bigquery_to_mssql.rst.txt | 69 +
.../operators/transfer/bigquery_to_mysql.rst.txt | 67 +
.../operators/transfer/calendar_to_gcs.rst.txt | 47 +
.../operators/transfer/facebook_ads_to_gcs.rst.txt | 48 +
.../operators/transfer/gcs_to_bigquery.rst.txt | 77 +
.../_sources/operators/transfer/gcs_to_gcs.rst.txt | 252 +
.../operators/transfer/gcs_to_gdrive.rst.txt | 85 +
.../operators/transfer/gcs_to_local.rst.txt | 52 +
.../operators/transfer/gcs_to_sftp.rst.txt | 99 +
.../operators/transfer/gcs_to_sheets.rst.txt | 48 +
.../operators/transfer/gdrive_to_gcs.rst.txt | 66 +
.../operators/transfer/gdrive_to_local.rst.txt | 53 +
.../_sources/operators/transfer/index.rst.txt | 28 +
.../operators/transfer/local_to_drive.rst.txt | 45 +
.../operators/transfer/local_to_gcs.rst.txt | 53 +
.../operators/transfer/mssql_to_gcs.rst.txt | 50 +
.../operators/transfer/mysql_to_gcs.rst.txt | 53 +
.../operators/transfer/oracle_to_gcs.rst.txt | 53 +
.../operators/transfer/presto_to_gcs.rst.txt | 142 +
.../_sources/operators/transfer/s3_to_gcs.rst.txt | 48 +
.../operators/transfer/salesforce_to_gcs.rst.txt | 45 +
.../operators/transfer/sftp_to_gcs.rst.txt | 101 +
.../operators/transfer/sheets_to_gcs.rst.txt | 48 +
.../operators/transfer/sql_to_sheets.rst.txt | 45 +
.../operators/transfer/trino_to_gcs.rst.txt | 142 +
.../google-cloud-secret-manager-backend.rst.txt | 195 +
.../_sources/sensors/google-cloud-tasks.rst.txt | 39 +
.../8.10.0/_sources/sensors/index.rst.txt | 26 +
.../8.10.0/_static/_gen/css/main-custom.min.css | 1 +
.../8.10.0/_static/_gen/css/main.min.css | 7 +
.../8.10.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../8.10.0/_static/basic.css | 899 +
.../8.10.0/_static/check-solid.svg | 4 +
.../8.10.0/_static/clipboard.min.js | 7 +
.../8.10.0/_static/copy-button.svg | 5 +
.../8.10.0/_static/copybutton.css | 94 +
.../8.10.0/_static/copybutton.js | 248 +
.../8.10.0/_static/copybutton_funcs.js | 73 +
.../8.10.0/_static/doctools.js | 156 +
.../8.10.0/_static/documentation_options.js | 14 +
.../8.10.0/_static/file.png | Bin 0 -> 286 bytes
.../8.10.0/_static/graphviz.css | 19 +
.../8.10.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../8.10.0/_static/jquery.js | 2 +
.../8.10.0/_static/js/globaltoc.js | 24 +
.../8.10.0/_static/language_data.js | 199 +
.../8.10.0/_static/minus.png | Bin 0 -> 90 bytes
.../8.10.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../8.10.0/_static/plus.png | Bin 0 -> 90 bytes
.../8.10.0/_static/pygments.css | 74 +
.../8.10.0/_static/searchtools.js | 566 +
.../8.10.0/_static/sphinx_highlight.js | 144 +
.../8.10.0/_static/underscore-1.13.1.js | 2042 +++
.../8.10.0/_static/underscore.js | 6 +
.../8.10.0/api-auth-backend/google-openid.html} | 198 +-
.../8.10.0/api-auth-backend/index.html | 1 +
.../8.10.0/commits.html | 5583 ++++++
.../8.10.0/configurations-ref.html} | 212 +-
.../8.10.0/connections/gcp.html} | 318 +-
.../8.10.0/connections/gcp_looker.html} | 200 +-
.../8.10.0/connections/gcp_sql.html} | 204 +-
.../8.10.0/connections/gcp_ssh.html} | 206 +-
.../8.10.0/connections/index.html} | 168 +-
.../8.10.0/example-dags.html} | 214 +-
.../8.10.0/genindex.html | 16880 +++++++++++++++++++
.../8.10.0/index.html | 2493 +++
.../8.10.0/installing-providers-from-sources.html} | 257 +-
.../8.10.0/logging/gcs.html} | 206 +-
.../8.10.0/logging/index.html} | 166 +-
.../8.10.0/logging/stackdriver.html} | 203 +-
.../8.10.0/objects.inv | Bin 0 -> 57917 bytes
.../8.10.0/operators/ads.html} | 201 +-
.../8.10.0/operators/cloud/automl.html} | 530 +-
.../8.10.0/operators/cloud/bigquery.html | 1513 ++
.../8.10.0/operators/cloud/bigquery_dts.html} | 356 +-
.../8.10.0/operators/cloud/bigtable.html} | 533 +-
.../8.10.0/operators/cloud/cloud_build.html} | 748 +-
.../8.10.0/operators/cloud/cloud_composer.html} | 417 +-
.../8.10.0/operators/cloud/cloud_memorystore.html} | 579 +-
.../cloud/cloud_memorystore_memcached.html} | 402 +-
.../8.10.0/operators/cloud/cloud_sql.html | 1693 ++
.../cloud/cloud_storage_transfer_service.html} | 720 +-
.../8.10.0/operators/cloud/compute.html} | 1157 +-
.../8.10.0/operators/cloud/compute_ssh.html} | 266 +-
.../operators/cloud/data_loss_prevention.html} | 604 +-
.../8.10.0/operators/cloud/datacatalog.html | 1493 ++
.../8.10.0/operators/cloud/dataflow.html} | 688 +-
.../8.10.0/operators/cloud/dataform.html} | 637 +-
.../8.10.0/operators/cloud/datafusion.html} | 567 +-
.../8.10.0/operators/cloud/dataplex.html} | 394 +-
.../8.10.0/operators/cloud/dataprep.html} | 370 +-
.../8.10.0/operators/cloud/dataproc.html} | 1031 +-
.../operators/cloud/dataproc_metastore.html} | 554 +-
.../8.10.0/operators/cloud/datastore.html} | 498 +-
.../8.10.0/operators/cloud/functions.html} | 398 +-
.../8.10.0/operators/cloud/gcs.html} | 542 +-
.../8.10.0/operators/cloud/index.html} | 252 +-
.../8.10.0/operators/cloud/kubernetes_engine.html} | 382 +-
.../8.10.0/operators/cloud/life_sciences.html} | 251 +-
.../8.10.0/operators/cloud/looker.html} | 255 +-
.../8.10.0/operators/cloud/mlengine.html} | 657 +-
.../8.10.0/operators/cloud/natural_language.html} | 399 +-
.../8.10.0/operators/cloud/pubsub.html} | 370 +-
.../8.10.0/operators/cloud/spanner.html} | 620 +-
.../8.10.0/operators/cloud/speech_to_text.html} | 262 +-
.../8.10.0/operators/cloud/stackdriver.html} | 518 +-
.../8.10.0/operators/cloud/tasks.html} | 549 +-
.../8.10.0/operators/cloud/text_to_speech.html} | 268 +-
.../8.10.0/operators/cloud/translate.html} | 266 +-
.../8.10.0/operators/cloud/translate_speech.html} | 278 +-
.../8.10.0/operators/cloud/vertex_ai.html | 1527 ++
.../operators/cloud/video_intelligence.html} | 422 +-
.../8.10.0/operators/cloud/vision.html | 2064 +++
.../8.10.0/operators/cloud/workflows.html} | 435 +-
.../8.10.0/operators/firebase/firestore.html} | 232 +-
.../8.10.0/operators/index.html} | 171 +-
.../8.10.0/operators/leveldb/leveldb.html} | 228 +-
.../operators/marketing_platform/analytics.html} | 253 +-
.../marketing_platform/campaign_manager.html} | 462 +-
.../marketing_platform/display_video.html} | 400 +-
.../operators/marketing_platform/index.html} | 215 +-
.../operators/marketing_platform/search_ads.html} | 257 +-
.../8.10.0/operators/suite/sheets.html} | 241 +-
.../transfer/azure_fileshare_to_gcs.html} | 239 +-
.../operators/transfer/bigquery_to_bigquery.html} | 240 +-
.../operators/transfer/bigquery_to_gcs.html} | 243 +-
.../operators/transfer/bigquery_to_mssql.html} | 244 +-
.../operators/transfer/bigquery_to_mysql.html} | 243 +-
.../operators/transfer/calendar_to_gcs.html} | 234 +-
.../operators/transfer/facebook_ads_to_gcs.html} | 232 +-
.../operators/transfer/gcs_to_bigquery.html} | 307 +-
.../8.10.0/operators/transfer/gcs_to_gcs.html} | 571 +-
.../8.10.0/operators/transfer/gcs_to_gdrive.html} | 269 +-
.../8.10.0/operators/transfer/gcs_to_local.html} | 232 +-
.../8.10.0/operators/transfer/gcs_to_sftp.html} | 257 +-
.../8.10.0/operators/transfer/gcs_to_sheets.html} | 235 +-
.../8.10.0/operators/transfer/gdrive_to_gcs.html} | 244 +-
.../operators/transfer/gdrive_to_local.html} | 238 +-
.../8.10.0/operators/transfer/index.html} | 235 +-
.../8.10.0/operators/transfer/local_to_drive.html} | 226 +-
.../8.10.0/operators/transfer/local_to_gcs.html} | 238 +-
.../8.10.0/operators/transfer/mssql_to_gcs.html} | 243 +-
.../8.10.0/operators/transfer/mysql_to_gcs.html} | 239 +-
.../8.10.0/operators/transfer/oracle_to_gcs.html} | 239 +-
.../8.10.0/operators/transfer/presto_to_gcs.html} | 384 +-
.../8.10.0/operators/transfer/s3_to_gcs.html} | 220 +-
.../operators/transfer/salesforce_to_gcs.html} | 250 +-
.../8.10.0/operators/transfer/sftp_to_gcs.html} | 255 +-
.../8.10.0/operators/transfer/sheets_to_gcs.html} | 234 +-
.../8.10.0/operators/transfer/sql_to_sheets.html} | 226 +-
.../8.10.0/operators/transfer/trino_to_gcs.html} | 384 +-
.../8.10.0/py-modindex.html | 3174 ++++
.../8.10.0/search.html} | 253 +-
.../8.10.0/searchindex.js | 1 +
.../google-cloud-secret-manager-backend.html} | 318 +-
.../8.10.0/secrets-backends/index.html | 1 +
.../8.10.0/sensors/google-cloud-tasks.html} | 178 +-
.../8.10.0/sensors/index.html} | 165 +-
.../apache-airflow-providers-google/stable.txt | 2 +-
.../secrets-backends/hashicorp-vault.rst.txt | 2 +-
.../3.2.0/searchindex.js | 2 +-
.../3.2.0/secrets-backends/hashicorp-vault.html | 2 +-
.../apache-airflow-providers-http/4.2.0/.buildinfo | 4 +
.../airflow/providers/http/hooks/http}/index.html | 337 +-
.../_api/airflow/providers/http/hooks/index.html} | 201 +-
.../4.2.0/_api/airflow/providers/http/index.html} | 208 +-
.../providers/http/operators/http}/index.html | 156 +-
.../airflow/providers/http/operators/index.html} | 201 +-
.../providers/http/sensors/http}/index.html | 158 +-
.../airflow/providers/http/sensors/index.html} | 201 +-
.../system/providers/http/example_http}/index.html | 197 +-
.../_api/tests/system/providers/http/index.html} | 201 +-
.../airflow/providers/http/hooks/http.html} | 684 +-
.../airflow/providers/http/operators/http.html} | 352 +-
.../airflow/providers/http/sensors/http.html} | 374 +-
.../4.2.0/_modules/index.html} | 181 +-
.../tests/system/providers/http/example_http.html} | 336 +-
.../providers/http/hooks/http/index.rst.txt | 176 +
.../airflow/providers/http/hooks/index.rst.txt | 15 +
.../_api/airflow/providers/http/index.rst.txt | 17 +
.../providers/http/operators/http/index.rst.txt | 84 +
.../airflow/providers/http/operators/index.rst.txt | 15 +
.../providers/http/sensors/http/index.rst.txt | 81 +
.../airflow/providers/http/sensors/index.rst.txt | 15 +
.../providers/http/example_http/index.rst.txt | 59 +
.../_api/tests/system/providers/http/index.rst.txt | 15 +
.../4.2.0/_sources/commits.rst.txt | 306 +
.../4.2.0/_sources/connections/http.rst.txt | 68 +
.../4.2.0/_sources/index.rst.txt | 95 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.2.0/_sources/operators.rst.txt | 120 +
.../4.2.0/_static/_gen/css/main-custom.min.css | 1 +
.../4.2.0/_static/_gen/css/main.min.css | 7 +
.../4.2.0/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.2.0/_static/basic.css | 899 +
.../4.2.0/_static/check-solid.svg | 4 +
.../4.2.0/_static/clipboard.min.js | 7 +
.../4.2.0/_static/copy-button.svg | 5 +
.../4.2.0/_static/copybutton.css | 94 +
.../4.2.0/_static/copybutton.js | 248 +
.../4.2.0/_static/copybutton_funcs.js | 73 +
.../4.2.0/_static/doctools.js | 156 +
.../4.2.0/_static/documentation_options.js | 14 +
.../4.2.0/_static/file.png | Bin 0 -> 286 bytes
.../4.2.0/_static/graphviz.css | 19 +
.../4.2.0/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.2.0/_static/jquery.js | 2 +
.../4.2.0/_static/js/globaltoc.js | 24 +
.../4.2.0/_static/language_data.js | 199 +
.../4.2.0/_static/minus.png | Bin 0 -> 90 bytes
.../4.2.0/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.2.0/_static/plus.png | Bin 0 -> 90 bytes
.../4.2.0/_static/pygments.css | 74 +
.../4.2.0/_static/searchtools.js | 566 +
.../4.2.0/_static/sphinx_highlight.js | 144 +
.../4.2.0/_static/underscore-1.13.1.js | 2042 +++
.../4.2.0/_static/underscore.js | 6 +
.../4.2.0/commits.html} | 1018 +-
.../4.2.0/connections/http.html} | 181 +-
.../4.2.0/genindex.html} | 455 +-
.../4.2.0/index.html} | 488 +-
.../4.2.0/installing-providers-from-sources.html} | 247 +-
.../4.2.0/objects.inv | Bin 0 -> 985 bytes
.../4.2.0/operators.html} | 352 +-
.../4.2.0/py-modindex.html} | 298 +-
.../4.2.0/search.html} | 243 +-
.../4.2.0/searchindex.js | 1 +
.../apache-airflow-providers-http/stable.txt | 2 +-
.../5.2.1/.buildinfo | 4 +
.../microsoft/azure/hooks/adx}/index.html | 187 +-
.../microsoft/azure/hooks/asb}/index.html | 317 +-
.../microsoft/azure/hooks/base_azure}/index.html | 146 +-
.../microsoft/azure/hooks/batch}/index.html | 293 +-
.../azure/hooks/container_instance}/index.html | 262 +-
.../azure/hooks/container_registry}/index.html | 131 +-
.../azure/hooks/container_volume}/index.html | 151 +-
.../microsoft/azure/hooks/cosmos}/index.html | 318 +-
.../microsoft/azure/hooks/data_factory/index.html | 1917 +++
.../microsoft/azure/hooks/data_lake}/index.html | 619 +-
.../microsoft/azure/hooks/fileshare}/index.html | 515 +-
.../providers/microsoft/azure/hooks/index.html} | 224 +-
.../microsoft/azure/hooks/synapse}/index.html | 316 +-
.../microsoft/azure/hooks/wasb}/index.html | 536 +-
.../airflow/providers/microsoft/azure}/index.html | 252 +-
.../providers/microsoft/azure/log/index.html} | 205 +-
.../azure/log/wasb_task_handler}/index.html | 191 +-
.../microsoft/azure/operators/adls}/index.html | 191 +-
.../microsoft/azure/operators/adx}/index.html | 128 +-
.../microsoft/azure/operators/asb/index.html | 1499 ++
.../microsoft/azure/operators/batch}/index.html | 215 +-
.../operators/container_instances}/index.html | 271 +-
.../microsoft/azure/operators/cosmos}/index.html | 116 +-
.../azure/operators/data_factory}/index.html | 218 +-
.../microsoft/azure/operators/index.html} | 213 +-
.../microsoft/azure/operators/synapse}/index.html | 132 +-
.../azure/operators/wasb_delete_blob}/index.html | 117 +-
.../providers/microsoft/azure/secrets/index.html} | 205 +-
.../microsoft/azure/secrets/key_vault}/index.html | 222 +-
.../microsoft/azure/sensors/cosmos}/index.html | 116 +-
.../azure/sensors/data_factory}/index.html | 108 +-
.../providers/microsoft/azure/sensors/index.html} | 207 +-
.../microsoft/azure/sensors/wasb}/index.html | 144 +-
.../azure/transfers/azure_blob_to_gcs}/index.html | 128 +-
.../microsoft/azure/transfers/index.html} | 209 +-
.../azure/transfers/local_to_adls}/index.html | 159 +-
.../azure/transfers/local_to_wasb}/index.html | 170 +-
.../oracle_to_azure_data_lake}/index.html | 122 +-
.../azure/transfers/sftp_to_wasb}/index.html | 257 +-
.../providers/microsoft/azure/utils}/index.html | 126 +-
.../azure/example_adf_run_pipeline/index.html} | 234 +-
.../azure/example_adls_delete}/index.html | 223 +-
.../azure/example_azure_blob_to_gcs}/index.html | 181 +-
.../example_azure_container_instances}/index.html | 210 +-
.../azure/example_azure_cosmosdb}/index.html | 214 +-
.../azure/example_azure_service_bus}/index.html | 181 +-
.../azure/example_azure_synapse}/index.html | 223 +-
.../microsoft/azure/example_fileshare}/index.html | 186 +-
.../azure/example_local_to_adls}/index.html | 223 +-
.../azure/example_local_to_wasb}/index.html | 216 +-
.../azure/example_sftp_to_wasb}/index.html | 233 +-
.../system/providers/microsoft/azure/index.html} | 222 +-
.../providers/microsoft/azure/hooks/adx.html} | 476 +-
.../providers/microsoft/azure/hooks/asb.html} | 487 +-
.../microsoft/azure/hooks/base_azure.html} | 305 +-
.../providers/microsoft/azure/hooks/batch.html} | 616 +-
.../microsoft/azure/hooks/container_instance.html} | 332 +-
.../microsoft/azure/hooks/container_registry.html} | 234 +-
.../microsoft/azure/hooks/container_volume.html} | 293 +-
.../providers/microsoft/azure/hooks/cosmos.html} | 600 +-
.../microsoft/azure/hooks/data_factory.html | 1856 ++
.../microsoft/azure/hooks/data_lake.html} | 748 +-
.../microsoft/azure/hooks/fileshare.html} | 560 +-
.../providers/microsoft/azure/hooks/synapse.html} | 471 +-
.../providers/microsoft/azure/hooks/wasb.html} | 719 +-
.../microsoft/azure/log/wasb_task_handler.html} | 464 +-
.../providers/microsoft/azure/operators/adls.html} | 268 +-
.../providers/microsoft/azure/operators/adx.html} | 247 +-
.../providers/microsoft/azure/operators/asb.html | 1449 ++
.../microsoft/azure/operators/batch.html} | 565 +-
.../azure/operators/container_instances.html} | 616 +-
.../microsoft/azure/operators/cosmos.html} | 240 +-
.../microsoft/azure/operators/data_factory.html} | 477 +-
.../microsoft/azure/operators/synapse.html} | 292 +-
.../azure/operators/wasb_delete_blob.html} | 240 +-
.../microsoft/azure/secrets/key_vault.html} | 376 +-
.../providers/microsoft/azure/sensors/cosmos.html} | 239 +-
.../microsoft/azure/sensors/data_factory.html} | 248 +-
.../providers/microsoft/azure/sensors/wasb.html} | 266 +-
.../azure/transfers/azure_blob_to_gcs.html} | 318 +-
.../microsoft/azure/transfers/local_to_adls.html} | 301 +-
.../microsoft/azure/transfers/local_to_wasb.html} | 249 +-
.../transfers/oracle_to_azure_data_lake.html} | 299 +-
.../microsoft/azure/transfers/sftp_to_wasb.html} | 472 +-
.../airflow/providers/microsoft/azure/utils.html} | 296 +-
.../5.2.1/_modules/index.html} | 225 +-
.../microsoft/azure/example_adf_run_pipeline.html} | 260 +-
.../microsoft/azure/example_adls_delete.html} | 227 +-
.../azure/example_azure_blob_to_gcs.html} | 242 +-
.../azure/example_azure_container_instances.html} | 227 +-
.../microsoft/azure/example_azure_cosmosdb.html} | 243 +-
.../azure/example_azure_service_bus.html} | 369 +-
.../microsoft/azure/example_azure_synapse.html} | 241 +-
.../microsoft/azure/example_fileshare.html} | 235 +-
.../microsoft/azure/example_local_to_adls.html} | 227 +-
.../microsoft/azure/example_local_to_wasb.html} | 223 +-
.../microsoft/azure/example_sftp_to_wasb.html} | 255 +-
.../microsoft/azure/hooks/adx/index.rst.txt | 115 +
.../microsoft/azure/hooks/asb/index.rst.txt | 164 +
.../microsoft/azure/hooks/base_azure/index.rst.txt | 70 +
.../microsoft/azure/hooks/batch/index.rst.txt | 169 +
.../azure/hooks/container_instance/index.rst.txt | 123 +
.../azure/hooks/container_registry/index.rst.txt | 66 +
.../azure/hooks/container_volume/index.rst.txt | 72 +
.../microsoft/azure/hooks/cosmos/index.rst.txt | 166 +
.../azure/hooks/data_factory/index.rst.txt | 572 +
.../microsoft/azure/hooks/data_lake/index.rst.txt | 300 +
.../microsoft/azure/hooks/fileshare/index.rst.txt | 210 +
.../providers/microsoft/azure/hooks/index.rst.txt | 27 +
.../microsoft/azure/hooks/synapse/index.rst.txt | 171 +
.../microsoft/azure/hooks/wasb/index.rst.txt | 227 +
.../providers/microsoft/azure/index.rst.txt | 29 +
.../providers/microsoft/azure/log/index.rst.txt | 15 +
.../azure/log/wasb_task_handler/index.rst.txt | 85 +
.../microsoft/azure/operators/adls/index.rst.txt | 98 +
.../microsoft/azure/operators/adx/index.rst.txt | 67 +
.../microsoft/azure/operators/asb/index.rst.txt | 427 +
.../microsoft/azure/operators/batch/index.rst.txt | 125 +
.../operators/container_instances/index.rst.txt | 152 +
.../microsoft/azure/operators/cosmos/index.rst.txt | 52 +
.../azure/operators/data_factory/index.rst.txt | 118 +
.../microsoft/azure/operators/index.rst.txt | 23 +
.../azure/operators/synapse/index.rst.txt | 70 +
.../azure/operators/wasb_delete_blob/index.rst.txt | 49 +
.../microsoft/azure/secrets/index.rst.txt | 15 +
.../azure/secrets/key_vault/index.rst.txt | 108 +
.../microsoft/azure/sensors/cosmos/index.rst.txt | 54 +
.../azure/sensors/data_factory/index.rst.txt | 47 +
.../microsoft/azure/sensors/index.rst.txt | 17 +
.../microsoft/azure/sensors/wasb/index.rst.txt | 68 +
.../transfers/azure_blob_to_gcs/index.rst.txt | 65 +
.../microsoft/azure/transfers/index.rst.txt | 19 +
.../azure/transfers/local_to_adls/index.rst.txt | 77 +
.../azure/transfers/local_to_wasb/index.rst.txt | 46 +
.../oracle_to_azure_data_lake/index.rst.txt | 62 +
.../azure/transfers/sftp_to_wasb/index.rst.txt | 132 +
.../providers/microsoft/azure/utils/index.rst.txt | 24 +
.../azure/example_adf_run_pipeline/index.rst.txt | 26 +
.../azure/example_adls_delete/index.rst.txt | 34 +
.../azure/example_azure_blob_to_gcs/index.rst.txt | 46 +
.../index.rst.txt | 31 +
.../azure/example_azure_cosmosdb/index.rst.txt | 37 +
.../azure/example_azure_service_bus/index.rst.txt | 49 +
.../azure/example_azure_synapse/index.rst.txt | 33 +
.../azure/example_fileshare/index.rst.txt | 65 +
.../azure/example_local_to_adls/index.rst.txt | 34 +
.../azure/example_local_to_wasb/index.rst.txt | 30 +
.../azure/example_sftp_to_wasb/index.rst.txt | 87 +
.../system/providers/microsoft/azure/index.rst.txt | 25 +
.../5.2.1/_sources/commits.rst.txt | 572 +
.../5.2.1/_sources/connections/acr.rst.txt | 62 +
.../5.2.1/_sources/connections/adf.rst.txt | 93 +
.../5.2.1/_sources/connections/adl.rst.txt | 70 +
.../5.2.1/_sources/connections/adls_v2.rst.txt | 68 +
.../5.2.1/_sources/connections/adx.rst.txt | 91 +
.../5.2.1/_sources/connections/asb.rst.txt | 50 +
.../5.2.1/_sources/connections/azure.rst.txt | 83 +
.../5.2.1/_sources/connections/azure_batch.rst.txt | 61 +
.../connections/azure_container_volume.rst.txt | 75 +
.../_sources/connections/azure_cosmos.rst.txt | 66 +
.../_sources/connections/azure_fileshare.rst.txt | 80 +
.../_sources/connections/azure_synapse.rst.txt | 69 +
.../5.2.1/_sources/connections/index.rst.txt | 25 +
.../5.2.1/_sources/connections/wasb.rst.txt | 84 +
.../5.2.1/_sources/index.rst.txt | 141 +
.../installing-providers-from-sources.rst.txt | 18 +
.../5.2.1/_sources/logging/index.rst.txt | 55 +
.../_sources/operators/adf_run_pipeline.rst.txt | 53 +
.../5.2.1/_sources/operators/adls.rst.txt | 50 +
.../5.2.1/_sources/operators/asb.rst.txt | 214 +
.../_sources/operators/azure_blob_to_gcs.rst.txt | 60 +
.../5.2.1/_sources/operators/azure_synapse.rst.txt | 49 +
.../5.2.1/_sources/operators/index.rst.txt | 28 +
.../5.2.1/_sources/operators/local_to_adls.rst.txt | 53 +
.../5.2.1/_sources/operators/sftp_to_wasb.rst.txt | 61 +
.../secrets-backends/azure-key-vault.rst.txt | 73 +
.../5.2.1/_static/_gen/css/main-custom.min.css | 1 +
.../5.2.1/_static/_gen/css/main.min.css | 7 +
.../5.2.1/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../5.2.1/_static/basic.css | 899 +
.../5.2.1/_static/check-solid.svg | 4 +
.../5.2.1/_static/clipboard.min.js | 7 +
.../5.2.1/_static/copy-button.svg | 5 +
.../5.2.1/_static/copybutton.css | 94 +
.../5.2.1/_static/copybutton.js | 248 +
.../5.2.1/_static/copybutton_funcs.js | 73 +
.../5.2.1/_static/doctools.js | 156 +
.../5.2.1/_static/documentation_options.js | 14 +
.../5.2.1/_static/file.png | Bin 0 -> 286 bytes
.../5.2.1/_static/graphviz.css | 19 +
.../5.2.1/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../5.2.1/_static/jquery.js | 2 +
.../5.2.1/_static/js/globaltoc.js | 24 +
.../5.2.1/_static/language_data.js | 199 +
.../5.2.1/_static/minus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pin_32.png | Bin 0 -> 1201 bytes
.../5.2.1/_static/plus.png | Bin 0 -> 90 bytes
.../5.2.1/_static/pygments.css | 74 +
.../5.2.1/_static/searchtools.js | 566 +
.../5.2.1/_static/sphinx_highlight.js | 144 +
.../5.2.1/_static/underscore-1.13.1.js | 2042 +++
.../5.2.1/_static/underscore.js | 6 +
.../5.2.1/commits.html | 2459 +++
.../5.2.1/connections/acr.html} | 184 +-
.../5.2.1/connections/adf.html} | 211 +-
.../5.2.1/connections/adl.html} | 189 +-
.../5.2.1/connections/adls_v2.html} | 188 +-
.../5.2.1/connections/adx.html} | 205 +-
.../5.2.1/connections/asb.html} | 179 +-
.../5.2.1/connections/azure.html} | 204 +-
.../5.2.1/connections/azure_batch.html} | 183 +-
.../5.2.1/connections/azure_container_volume.html} | 189 +-
.../5.2.1/connections/azure_cosmos.html} | 185 +-
.../5.2.1/connections/azure_fileshare.html} | 200 +-
.../5.2.1/connections/azure_synapse.html} | 194 +-
.../5.2.1/connections/index.html} | 171 +-
.../5.2.1/connections/wasb.html} | 196 +-
.../5.2.1/genindex.html | 2552 +++
.../5.2.1/index.html} | 970 +-
.../5.2.1/installing-providers-from-sources.html} | 251 +-
.../5.2.1/logging.html | 1 +
.../5.2.1/logging/index.html} | 187 +-
.../5.2.1/objects.inv | Bin 0 -> 6576 bytes
.../5.2.1/operators/adf_run_pipeline.html} | 196 +-
.../5.2.1/operators/adls.html} | 172 +-
.../5.2.1/operators/asb.html} | 363 +-
.../5.2.1/operators/azure_blob_to_gcs.html} | 204 +-
.../5.2.1/operators/azure_synapse.html} | 180 +-
.../5.2.1/operators/index.html} | 175 +-
.../5.2.1/operators/local_to_adls.html} | 180 +-
.../5.2.1/operators/sftp_to_wasb.html} | 192 +-
.../5.2.1/py-modindex.html} | 509 +-
.../5.2.1/search.html} | 247 +-
.../5.2.1/searchindex.js | 1 +
.../5.2.1/secrets-backends/azure-key-vault.html} | 192 +-
.../5.2.1/secrets-backends/index.html | 1 +
.../stable.txt | 2 +-
.../providers/microsoft/psrp/hooks/psrp.html | 3 +-
.../apache-airflow-providers-sftp/4.2.3/.buildinfo | 4 +
.../_api/airflow/providers/sftp/hooks/index.html} | 191 +-
.../airflow/providers/sftp/hooks/sftp}/index.html | 449 +-
.../4.2.3/_api/airflow/providers/sftp/index.html} | 198 +-
.../airflow/providers/sftp/operators/index.html} | 191 +-
.../providers/sftp/operators/sftp}/index.html | 156 +-
.../airflow/providers/sftp/sensors/index.html} | 191 +-
.../providers/sftp/sensors/sftp}/index.html | 91 +-
.../airflow/providers/sftp/hooks/sftp.html} | 676 +-
.../airflow/providers/sftp/operators/sftp.html} | 512 +-
.../airflow/providers/sftp/sensors/sftp.html} | 296 +-
.../4.2.3/_modules/index.html} | 170 +-
.../airflow/providers/sftp/hooks/index.rst.txt | 15 +
.../providers/sftp/hooks/sftp/index.rst.txt | 229 +
.../_api/airflow/providers/sftp/index.rst.txt | 17 +
.../airflow/providers/sftp/operators/index.rst.txt | 15 +
.../providers/sftp/operators/sftp/index.rst.txt | 96 +
.../airflow/providers/sftp/sensors/index.rst.txt | 15 +
.../providers/sftp/sensors/sftp/index.rst.txt | 47 +
.../4.2.3/_sources/commits.rst.txt | 379 +
.../4.2.3/_sources/connections/sftp.rst.txt | 109 +
.../4.2.3/_sources/index.rst.txt | 108 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.2.3/_static/_gen/css/main-custom.min.css | 1 +
.../4.2.3/_static/_gen/css/main.min.css | 7 +
.../4.2.3/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.2.3/_static/basic.css | 899 +
.../4.2.3/_static/check-solid.svg | 4 +
.../4.2.3/_static/clipboard.min.js | 7 +
.../4.2.3/_static/copy-button.svg | 5 +
.../4.2.3/_static/copybutton.css | 94 +
.../4.2.3/_static/copybutton.js | 248 +
.../4.2.3/_static/copybutton_funcs.js | 73 +
.../4.2.3/_static/doctools.js | 156 +
.../4.2.3/_static/documentation_options.js | 14 +
.../4.2.3/_static/file.png | Bin 0 -> 286 bytes
.../4.2.3/_static/graphviz.css | 19 +
.../4.2.3/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.2.3/_static/jquery.js | 2 +
.../4.2.3/_static/js/globaltoc.js | 24 +
.../4.2.3/_static/language_data.js | 199 +
.../4.2.3/_static/minus.png | Bin 0 -> 90 bytes
.../4.2.3/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.2.3/_static/plus.png | Bin 0 -> 90 bytes
.../4.2.3/_static/pygments.css | 74 +
.../4.2.3/_static/searchtools.js | 566 +
.../4.2.3/_static/sphinx_highlight.js | 144 +
.../4.2.3/_static/underscore-1.13.1.js | 2042 +++
.../4.2.3/_static/underscore.js | 6 +
.../4.2.3/commits.html | 1793 ++
.../4.2.3/connections/sftp.html} | 121 +-
.../4.2.3/genindex.html} | 433 +-
.../4.2.3/index.html} | 606 +-
.../4.2.3/installing-providers-from-sources.html} | 249 +-
.../4.2.3/objects.inv | Bin 0 -> 845 bytes
.../4.2.3/py-modindex.html} | 268 +-
.../4.2.3/search.html} | 233 +-
.../4.2.3/searchindex.js | 1 +
.../apache-airflow-providers-sftp/stable.txt | 2 +-
.../4.0.4/.buildinfo | 4 +
.../airflow/providers/snowflake/hooks/index.html} | 201 +-
.../snowflake/hooks/snowflake}/index.html | 302 +-
.../_api/airflow/providers/snowflake/index.html} | 214 +-
.../providers/snowflake/operators/index.html} | 201 +-
.../snowflake/operators/snowflake}/index.html | 383 +-
.../transfers/copy_into_snowflake}/index.html | 146 +-
.../providers/snowflake/transfers/index.html} | 203 +-
.../transfers/s3_to_snowflake}/index.html | 147 +-
.../transfers/snowflake_to_slack}/index.html | 149 +-
.../providers/snowflake/utils/common}/index.html | 131 +-
.../airflow/providers/snowflake/utils/index.html} | 201 +-
.../snowflake/example_s3_to_snowflake}/index.html | 180 +-
.../snowflake/example_snowflake}/index.html | 194 +-
.../example_snowflake_to_slack}/index.html | 187 +-
.../tests/system/providers/snowflake/index.html} | 203 +-
.../providers/snowflake/hooks/snowflake.html} | 701 +-
.../providers/snowflake/operators/snowflake.html} | 661 +-
.../snowflake/transfers/copy_into_snowflake.html} | 378 +-
.../snowflake/transfers/s3_to_snowflake.html} | 394 +-
.../snowflake/transfers/snowflake_to_slack.html} | 350 +-
.../airflow/providers/snowflake/utils/common.html} | 263 +-
.../4.0.4/_modules/index.html} | 186 +-
.../snowflake/example_s3_to_snowflake.html} | 291 +-
.../providers/snowflake/example_snowflake.html} | 307 +-
.../snowflake/example_snowflake_to_slack.html} | 291 +-
.../providers/snowflake/hooks/index.rst.txt | 15 +
.../snowflake/hooks/snowflake/index.rst.txt | 152 +
.../_api/airflow/providers/snowflake/index.rst.txt | 18 +
.../providers/snowflake/operators/index.rst.txt | 15 +
.../snowflake/operators/snowflake/index.rst.txt | 232 +
.../transfers/copy_into_snowflake/index.rst.txt | 84 +
.../providers/snowflake/transfers/index.rst.txt | 17 +
.../transfers/s3_to_snowflake/index.rst.txt | 82 +
.../transfers/snowflake_to_slack/index.rst.txt | 72 +
.../providers/snowflake/utils/common/index.rst.txt | 38 +
.../providers/snowflake/utils/index.rst.txt | 15 +
.../example_s3_to_snowflake/index.rst.txt | 51 +
.../snowflake/example_snowflake/index.rst.txt | 57 +
.../example_snowflake_to_slack/index.rst.txt | 68 +
.../tests/system/providers/snowflake/index.rst.txt | 17 +
.../4.0.4/_sources/commits.rst.txt | 460 +
.../4.0.4/_sources/connections/snowflake.rst.txt | 96 +
.../4.0.4/_sources/index.rst.txt | 124 +
.../installing-providers-from-sources.rst.txt | 18 +
.../4.0.4/_sources/operators/index.rst.txt | 25 +
.../_sources/operators/s3_to_snowflake.rst.txt | 45 +
.../4.0.4/_sources/operators/snowflake.rst.txt | 60 +
.../_sources/operators/snowflake_to_slack.rst.txt | 59 +
.../4.0.4/_static/_gen/css/main-custom.min.css | 1 +
.../4.0.4/_static/_gen/css/main.min.css | 7 +
.../4.0.4/_static/_gen/js/docs.js | 1 +
.../_sphinx_javascript_frameworks_compat.js | 134 +
.../4.0.4/_static/basic.css | 899 +
.../4.0.4/_static/check-solid.svg | 4 +
.../4.0.4/_static/clipboard.min.js | 7 +
.../4.0.4/_static/copy-button.svg | 5 +
.../4.0.4/_static/copybutton.css | 94 +
.../4.0.4/_static/copybutton.js | 248 +
.../4.0.4/_static/copybutton_funcs.js | 73 +
.../4.0.4/_static/doctools.js | 156 +
.../4.0.4/_static/documentation_options.js | 14 +
.../4.0.4/_static/file.png | Bin 0 -> 286 bytes
.../4.0.4/_static/graphviz.css | 19 +
.../4.0.4/_static/jquery-3.6.0.js | 10881 ++++++++++++
.../4.0.4/_static/jquery.js | 2 +
.../4.0.4/_static/js/globaltoc.js | 24 +
.../4.0.4/_static/language_data.js | 199 +
.../4.0.4/_static/minus.png | Bin 0 -> 90 bytes
.../4.0.4/_static/pin_32.png | Bin 0 -> 1201 bytes
.../4.0.4/_static/plus.png | Bin 0 -> 90 bytes
.../4.0.4/_static/pygments.css | 74 +
.../4.0.4/_static/searchtools.js | 566 +
.../4.0.4/_static/sphinx_highlight.js | 144 +
.../4.0.4/_static/underscore-1.13.1.js | 2042 +++
.../4.0.4/_static/underscore.js | 6 +
.../4.0.4/commits.html | 2047 +++
.../4.0.4/connections/snowflake.html} | 211 +-
.../4.0.4/genindex.html} | 599 +-
.../4.0.4/index.html} | 738 +-
.../4.0.4/installing-providers-from-sources.html} | 247 +-
.../4.0.4/objects.inv | Bin 0 -> 1490 bytes
.../4.0.4/operators/index.html} | 157 +-
.../4.0.4/operators/s3_to_snowflake.html} | 177 +-
.../4.0.4/operators/snowflake.html} | 210 +-
.../4.0.4/operators/snowflake_to_slack.html} | 194 +-
.../4.0.4/py-modindex.html} | 328 +-
.../4.0.4/search.html} | 243 +-
.../4.0.4/searchindex.js | 1 +
.../apache-airflow-providers-snowflake/stable.txt | 2 +-
.../3.4.0/connections/ssh.html | 2 +-
.../core-extensions/connections.html | 68 +-
.../core-extensions/extra-links.html | 212 +-
.../core-extensions/logging.html | 16 +-
.../core-extensions/secrets-backends.html | 8 +-
.../operators-and-hooks-ref/apache.html | 36 +-
.../operators-and-hooks-ref/aws.html | 234 +-
.../operators-and-hooks-ref/azure.html | 76 +-
.../operators-and-hooks-ref/google.html | 455 +-
.../operators-and-hooks-ref/protocol.html | 44 +-
.../operators-and-hooks-ref/services.html | 44 +-
.../operators-and-hooks-ref/software.html | 88 +-
.../apache-airflow-providers/packages-ref.html | 48 +-
.../apache-airflow-providers/searchindex.js | 2 +-
3094 files changed, 838234 insertions(+), 220688 deletions(-)
diff --git a/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html b/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
index 37510689aa..04ce39008d 100644
--- a/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
+++ b/docs-archive/apache-airflow-providers-airbyte/3.2.0/_api/airflow/providers/airbyte/hooks/airbyte/index.html
@@ -610,7 +610,7 @@
<dl class="py class">
<dt class="sig sig-object py" id="airflow.providers.airbyte.hooks.airbyte.AirbyteHook">
<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.airbyte.hooks.airbyte.</span></span><span class="sig-name descname"><span class="pre">AirbyteHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">airbyte_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'airbyte_defa [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a></p>
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.2.0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a></p>
<p>Hook for Airbyte API</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
diff --git a/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo b/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo
new file mode 100644
index 0000000000..0591087a38
--- /dev/null
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/.buildinfo
@@ -0,0 +1,4 @@
+# Sphinx build info version 1
+# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
+config: 753554d42b9a989529104dfe4b922cb1
+tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
similarity index 88%
copy from docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
index 356f682a14..440bf5a78d 100644
--- a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/exceptions/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.discord.operators.discord_webhook — apache-airflow-providers-discord Documentation</title>
+ <title>airflow.providers.amazon.aws.exceptions — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.discord.operators" href="../index.html" />
+ <link rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.waiters.base_waiter" href="../waiters/base_waiter/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -325,10 +325,25 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -417,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -458,10 +473,25 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -557,11 +587,11 @@
<li class="breadcrumb-item"><a href="../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a></li>
</ul>
</div>
@@ -572,75 +602,56 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.discord.operators.discord_webhook">
-<span id="airflow-providers-discord-operators-discord-webhook"></span><h1><a class="reference internal" href="#module-airflow.providers.discord.operators.discord_webhook" title="airflow.providers.discord.operators.discord_webhook"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><a class="headerlink" href="#module-airflow.providers.discord.operators.discord_webhook" title="Permalink to this he [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.exceptions">
+<span id="airflow-providers-amazon-aws-exceptions"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.exceptions" title="airflow.providers.amazon.aws.exceptions"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.exceptions" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
-<div class="section" id="classes">
-<h3>Classes<a class="headerlink" href="#classes" title="Permalink to this heading">¶</a></h3>
-<table class="autosummary longtable docutils align-default">
-<colgroup>
-<col style="width: 10%" />
-<col style="width: 90%" />
-</colgroup>
-<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator" title="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a></p></td>
-<td><p>This operator allows you to post messages to Discord using incoming webhooks.</p></td>
-</tr>
-</tbody>
-</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.discord.operators.discord_webhook.</span></span><span class="sig-name descname"><span class="pre">DiscordWebhookOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">http_conn_id</span></span><span clas [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/operators/http/index.html#airflow.providers.http.operators.http.SimpleHttpOperator" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.operators.http.SimpleHttpOperator</span></code></a></p>
-<p>This operator allows you to post messages to Discord using incoming webhooks.
-Takes a Discord connection ID with a default relative webhook endpoint. The
-default endpoint can be overridden using the webhook_endpoint parameter
-(<a class="reference external" href="https://discordapp.com/developers/docs/resources/webhook">https://discordapp.com/developers/docs/resources/webhook</a>).</p>
-<p>Each Discord webhook can be pre-configured to use a specific username and
-avatar_url. You can override these defaults in this operator.</p>
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsTaskFailToStart</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airfl [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS tasks fail to start AFTER processing the request.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>http_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Http connection ID with host as “<a class="reference external" href="https://discord.com/api/">https://discord.com/api/</a>” and
-default webhook endpoint in the extra field in the form of
-{“webhook_endpoint”: “webhooks/{webhook.id}/{webhook.token}”}</p></li>
-<li><p><strong>webhook_endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Discord webhook endpoint in the form of
-“webhooks/{webhook.id}/{webhook.token}” (templated)</p></li>
-<li><p><strong>message</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The message you want to send to your Discord channel
-(max 2000 characters). (templated)</p></li>
-<li><p><strong>username</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default username of the webhook. (templated)</p></li>
-<li><p><strong>avatar_url</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default avatar of the webhook</p></li>
-<li><p><strong>tts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Is a text-to-speech message</p></li>
-<li><p><strong>proxy</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Proxy to use to make the Discord webhook call</p></li>
-</ul>
-</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/discord/operators/discord_webhook.html#DiscordWebhookOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.disc [...]
-<dd><p>Call the DiscordWebhookHook to post message</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsTaskFailToStart.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">EcsOperatorError</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">failures</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">message</span></span></em><span class="sig- [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
+<p>Raise when ECS cannot handle the request.</p>
<dl class="field-list simple">
</dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">
+<span class="sig-name descname"><span class="pre">__reduce__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#EcsOperatorError.__reduce__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__" title="Permalink to this definition">¶</a></dt>
+<dd><p>Helper for pickle.</p>
</dd></dl>
</dd></dl>
-</div>
+<dl class="py exception">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure">
+<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.exceptions.</span></span><span class="sig-name descname"><span class="pre">S3HookUriParseFailure</span></span><a class="reference internal" href="../../../../../../_modules/airflow/providers/amazon/aws/exceptions.html#S3HookUriParseFailure"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class [...]
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/exceptions/index.html#airflow.exceptions.AirflowException" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.exceptions.AirflowException</span></code></a></p>
+<p>When parse_s3_url fails to parse URL, this error is thrown.</p>
+</dd></dl>
+
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.discord.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.waiters.base_waiter" href="../waiters/base_waiter/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="tests.system.providers.amazon" href="../../../../../tests/system/providers/amazon/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -710,21 +721,26 @@ default webhook endpoint in the extra field in the form of
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.exceptions</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart"><code class="docutils literal notranslate"><span class="pre">EcsTaskFailToStart</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__"><code class="docutils literal notranslate"><span class="pre">EcsTaskFailToStart.__reduce__()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError"><code class="docutils literal notranslate"><span class="pre">EcsOperatorError</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__"><code class="docutils literal notranslate"><span class="pre">EcsOperatorError.__reduce__()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">DiscordWebhookOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure"><code class="docutils literal notranslate"><span class="pre">S3HookUriParseFailure</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart">EcsTaskFailToStart</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsTaskFailToStart.__reduce__">__reduce__</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError">EcsOperatorError</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.EcsOperatorError.__reduce__">__reduce__</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.exceptions.S3HookUriParseFailure">S3HookUriParseFailure</a></li>
</ul>
</li>
</ul>
@@ -751,7 +767,7 @@ default webhook endpoint in the extra field in the form of
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-discord/_api/airflow/providers/discord/operators/discord_webhook/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/exceptions/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
similarity index 85%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
index 1ea82ab6c2..a71f632384 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/appflow/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.appflow — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.appflow">
+<span id="airflow-providers-amazon-aws-hooks-appflow"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="airflow.providers.amazon.aws.hooks.appflow"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.appflow" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +616,83 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook" title="airflow.providers.amazon.aws.hooks.appflow.AppflowHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AppflowHook</span></code></a></p></td>
+<td><p>Interact with Amazon Appflow.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.appflow.</span></span><span class="sig-name descname"><span class="pre">AppflowHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Appflow.
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/appflow.html#Appflow.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("appflow")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
-</div>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/appflow/1.0/APIReference/Welcome.html">Amazon Appflow API Reference</a></p></li>
</ul>
-</dd>
-</dl>
+</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_OFFSET</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><span class="pre">int</span></a></em><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">15</span></em><a c [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">
+<span class="sig-name descname"><span class="pre">EVENTUAL_CONSISTENCY_POLLING</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><span class="pre">int</span></a></em><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a [...]
<dd></dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/appflow.html#AppflowHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 Appflow client (cached)</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">
+<span class="sig-name descname"><span class="pre">run_flow</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">poll_interval</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">20</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airfl [...]
+<dd><p>Execute an AppFlow run.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The flow name</p></li>
+<li><p><strong>poll_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time (seconds) to wait between two consecutive calls to check the run status</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>The run execution ID</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">
+<span class="sig-name descname"><span class="pre">update_flow_filter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">flow_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filter_tasks</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">set_trigger_ondemand</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span [...]
+<dd><p>Update the flow task filter.
+All filters will be removed if an empty array is passed to filter_tasks.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>flow_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The flow name</p></li>
+<li><p><strong>filter_tasks</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><em>mypy_boto3_appflow.type_defs.TaskTypeDef</em><em>]</em>) – List flow tasks to be added</p></li>
+<li><p><strong>set_trigger_ondemand</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – If True, set the trigger to on-demand; otherwise, keep the trigger as is</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +704,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks" href="../index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +777,23 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.appflow</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook"><code class="docutils literal notranslate"><span class="pre">AppflowHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET"><code class="docutils literal notranslate"><span class="pre">AppflowHook.EVENTUAL_CONSISTENCY_OFFSET</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING"><code class="docutils literal notranslate"><span class="pre">AppflowHook.EVENTUAL_CONSISTENCY_POLLING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn"><code class="docutils literal notranslate"><span class="pre">AppflowHook.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow"><code class="docutils literal notranslate"><span class="pre">AppflowHook.run_flow()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter"><code class="docutils literal notranslate"><span class="pre">AppflowHook.update_flow_filter()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook">AppflowHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_OFFSET">EVENTUAL_CONSISTENCY_OFFSET</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.EVENTUAL_CONSISTENCY_POLLING">EVENTUAL_CONSISTENCY_POLLING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.run_flow">run_flow</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.appflow.AppflowHook.update_flow_filter">update_flow_filter</a></li>
</ul>
</li>
</ul>
@@ -778,7 +824,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/appflow/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
similarity index 73%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
index 1ea82ab6c2..833d8b8b0a 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/athena/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.athena — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.athena">
+<span id="airflow-providers-amazon-aws-hooks-athena"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.athena" title="airflow.providers.amazon.aws.hooks.athena"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.athena" title="Permalink to this heading">¶</a></h1>
+<p>This module contains AWS Athena hook.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +617,205 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook" title="airflow.providers.amazon.aws.hooks.athena.AthenaHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AthenaHook</span></code></a></p></td>
+<td><p>Interact with Amazon Athena.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.athena.</span></span><span class="sig-name descname"><span class="pre">AthenaHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">sleep_ [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Athena.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("athena")</span></code></a>.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<li><p><strong>sleep_time</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time (in seconds) to wait between two consecutive calls to check query status on Athena</p></li>
+<li><p><strong>log_query</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Whether to log athena query and other execution params when it’s executed.
+Defaults to <em>True</em>.</p></li>
</ul>
</dd>
</dl>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('QUEUED',</span> <span class="pre">'RUNNING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.INTERMEDIATE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></ [...]
+<dd></dd></dl>
+
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('FAILED',</span> <span class="pre">'CANCELLED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a cla [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCEEDED',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">
+<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCEEDED',</span> <span class="pre">'FAILED',</span> <span class="pre">'CANCELLED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.TERMINAL_STATES"><span class="viewcode-link"><span clas [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">
+<span class="sig-name descname"><span class="pre">run_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">query_context</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">result_configuration</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">client_request_token</span></span><span class="o"><span class= [...]
+<dd><p>Run Presto query on athena with provided config and return submitted query_execution_id</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.start_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.start_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Presto query to run</p></li>
+<li><p><strong>query_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – Context in which query [...]
+<li><p><strong>result_configuration</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>]</em>) – Dict with path to store results in and config related to encryption</p></li>
+<li><p><strong>client_request_token</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Unique token created by user to avoid multiple executions of same query</p></li>
+<li><p><strong>workgroup</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Athena workgroup name, when not specified, will be ‘primary’</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">
+<span class="sig-name descname"><span class="pre">check_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.check_query_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dd><p>Fetch the status of submitted athena query. Returns None or one of valid query states.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">
+<span class="sig-name descname"><span class="pre">get_state_change_reason</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_state_change_reason"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Fetch the reason for a state change (e.g. error message). Returns None or reason string.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">
+<span class="sig-name descname"><span class="pre">get_query_results</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">next_token_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_results</span></span> [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else dict of query output</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_results" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_results()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>next_token_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The token that specifies where to start pagination.</p></li>
+<li><p><strong>max_results</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – The maximum number of results (rows) to return in this request.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">
+<span class="sig-name descname"><span class="pre">get_query_results_paginator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_items</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">page_size</span></s [...]
+<dd><p>Fetch submitted athena query results. returns none if query is in intermediate state or
+failed/cancelled state else a paginator to iterate through pages of results. If you
+wish to get all results at once, call build_full_result() on the returned PageIterator</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Paginator.GetQueryResults" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Athena.Paginator.GetQueryResults</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>max_items</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – The total number of items to return.</p></li>
+<li><p><strong>page_size</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – The size of each page.</p></li>
+<li><p><strong>starting_token</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – A token to specify where to start paginating.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">
+<span class="sig-name descname"><span class="pre">poll_query_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_tries</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_polling_attempts</span></ [...]
+<dd><p>Poll the status of submitted athena query until query state reaches final state.
+Returns one of the final states</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p></li>
+<li><p><strong>max_tries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Deprecated - Use max_polling_attempts instead</p></li>
+<li><p><strong>max_polling_attempts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of times to poll for query state before function exits</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">
+<span class="sig-name descname"><span class="pre">get_output_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.get_output_location"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Function to get the output location of the query results
+in s3 uri format.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.get_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.get_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">
+<span class="sig-name descname"><span class="pre">stop_query</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query_execution_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/athena.html#AthenaHook.stop_query"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd><p>Cancel the submitted athena query</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html#Athena.Client.stop_query_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">Athena.Client.stop_query_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>query_execution_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Id of submitted athena query</p>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +827,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.appflow" href="../appflow/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +900,37 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.athena</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook"><code class="docutils literal notranslate"><span class="pre">AthenaHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.FAILURE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.SUCCESS_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">AthenaHook.TERMINAL_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query"><code class="docutils literal notranslate"><span class="pre">AthenaHook.run_query()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status"><code class="docutils literal notranslate"><span class="pre">AthenaHook.check_query_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_state_change_reason()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_query_results()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_query_results_paginator()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status"><code class="docutils literal notranslate"><span class="pre">AthenaHook.poll_query_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location"><code class="docutils literal notranslate"><span class="pre">AthenaHook.get_output_location()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query"><code class="docutils literal notranslate"><span class="pre">AthenaHook.stop_query()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook">AthenaHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.FAILURE_STATES">FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.SUCCESS_STATES">SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.run_query">run_query</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.check_query_status">check_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_state_change_reason">get_state_change_reason</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results">get_query_results</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_query_results_paginator">get_query_results_paginator</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.poll_query_status">poll_query_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.get_output_location">get_output_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.athena.AthenaHook.stop_query">stop_query</a></li>
</ul>
</li>
</ul>
@@ -778,7 +961,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/athena/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
similarity index 59%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
index 311386562a..1147e12871 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/base_aws/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.base_aws — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,14 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.base_aws">
+<span id="airflow-providers-amazon-aws-hooks-base-aws"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="airflow.providers.amazon.aws.hooks.base_aws"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.base_aws" title="Permalink to this heading">¶</a></h1>
+<p>This module contains Base AWS Hook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p>For more information on how to use this hook, take a look at the guide:
+<a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-aws"><span class="std std-ref">Amazon Web Services Connection</span></a></p>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,311 +622,430 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseSessionFactory</span></code></a></p></td>
+<td><p>Base AWS Session Factory class to handle boto3 session creation.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a></p></td>
+<td><p>Generic class for interact with AWS.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></p></td>
+<td><p>Base class for interact with AWS.</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
-<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory" title="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">resolve_session_factory</span></code></a>()</p></td>
+<td><p>Resolves custom SessionFactory class</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection" title="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BaseAwsConnection</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionFactory</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseAwsConnection</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseAwsConnection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnectio [...]
<dd></dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">BaseSessionFactory</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">conn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><spa [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMixin</span></code></p>
+<p>Base AWS Session Factory class to handle boto3 session creation.
+It can handle most of the AWS supported authentication methods.</p>
+<p>User can also derive from this class to have full control of boto3 session
+creation or to support custom federation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../../../../../../../connections/aws.html#howto-connection-aws-session-factory"><span class="std std-ref">Session Factory</span></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+</dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">extra_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a><span class="p"><span class="pre">[</span></span><a class="reference external" href="https [...]
+<dd><p>AWS Connection extra_config.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </s [...]
+<dd><p>AWS Region Name read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Config</span><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/constants.html#None" title="(in Python v3.11)"> [...]
+<dd><p>Configuration for botocore client read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">role_arn</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span [...]
+<dd><p>Assume Role ARN from AWS Connection</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Cached AWS Connection Wrapper.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">
+<span class="sig-name descname"><span class="pre">basic_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.basic_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session" title="Permalink to thi [...]
+<dd><p>Cached property with basic boto3.session.Session.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">
+<span class="sig-name descname"><span class="pre">create_session</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#BaseSessionFactory.create_session"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session" title="Permalink to [...]
+<dd><p>Create boto3 Session from connection config.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
</dd></dl>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsGenericHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_co [...]
+<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/hooks/base/index.html#airflow.hooks.base.BaseHook" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.hooks.base.BaseHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">Generic</span></code>[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsC [...]
+<p>Generic class for interact with AWS.
+This class provide a thin wrapper around the boto3 python library.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
+<li><p><strong>aws_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The Airflow connection used for AWS credentials.
+If this is None or empty then the default boto3 behaviour is used. If
+running Airflow in a distributed manner and aws_conn_id is None or
+empty, then default boto3 configuration would be used (and must be
+maintained on each worker node).</p></li>
+<li><p><strong>verify</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Whether or not to verify SSL certificates. See:
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html</a></p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – AWS region_name. If not specified then the default boto3 behaviour is used.</p></li>
+<li><p><strong>client_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.client</span> <s [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">resource_type</span></code>.</p></li>
+<li><p><strong>resource_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.resource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.resource</sp [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">client_type</span></code>.</p></li>
+<li><p><strong>config</strong> (<em>Config</em><em> | </em><em>None</em>) – Configuration for botocore client. See:
+<a class="reference external" href="https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html">https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html</a></p></li>
</ul>
</dd>
</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">service_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </s [...]
+<dd><p>AWS Region Name read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">botocore.config.Config</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.config"><span class="viewcode-link"><span class="pre">[source]< [...]
+<dd><p>Configuration for botocore client read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">verify</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><span class="pre">bool</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </spa [...]
+<dd><p>Verify or not SSL certificates boto3 client/resource read-only property.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_region_name</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><p>Get actual AWS Region Name from Hook connection (cached).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">conn_partition</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/a [...]
+<dd><p>Get associated AWS Region Partition from Hook connection (cached).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">
+<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">
+<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">
+<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'aws'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">
+<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Amazon</span> <span class="pre">Web</span> <span class="pre">Services'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</spa [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">
+<span class="sig-name descname"><span class="pre">conn_config</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_config"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config" title="Permalink to this definition"> [...]
+<dd><p>Get the Airflow Connection object and wrap it in helper (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">
+<span class="sig-name descname"><span class="pre">get_session</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_session"><span class [...]
+<dd><p>Get the underlying boto3.session.Session(region_name=region_name).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">
+<span class="sig-name descname"><span class="pre">get_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get the underlying boto3 client using boto3 session</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">
+<span class="sig-name descname"><span class="pre">get_resource_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">config</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</s [...]
+<dd><p>Get the underlying boto3 resource using boto3 session</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">
+<span class="sig-name descname"><span class="pre">conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
<dl class="field-list simple">
<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
+<dd class="field-even"><p>BaseAwsConnection</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">
+<span class="sig-name descname"><span class="pre">conn_client_meta</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.conn_client_meta"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta" title="Permalink to th [...]
+<dd><p>Get botocore client metadata from Hook connection (cached).</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">
+<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_conn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn" title="Permalink to this definition">¶</a></dt>
+<dd><p>Get the underlying boto3 client/resource (cached)</p>
+<p>Implemented so that caching works as intended. It exists for compatibility
+with subclasses that rely on a super().get_conn() method.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>boto3.client or boto3.resource</p>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>BaseAwsConnection</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">
+<span class="sig-name descname"><span class="pre">get_credentials</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_credentials"><sp [...]
+<dd><p>Get the underlying <cite>botocore.Credentials</cite> object.</p>
+<p>This contains the following authentication attributes: access_key, secret_key and token.
+By use this method also secret_key and token will mask in tasks logs.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">
+<span class="sig-name descname"><span class="pre">expand_role</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">role</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">region_name</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow [...]
+<dd><p>If the IAM role is a role name, get the Amazon Resource Name (ARN) for the role.
+If IAM role is already an IAM role ARN, no change is made.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>role</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – IAM role name or ARN</p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Optional region name to get credentials for</p></li>
</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
+<dd class="field-even"><p>IAM role ARN</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">should_retry</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.retry"><span class="viewcode-link"><span class="pre">[source] [...]
+<dd><p>A decorator that provides a mechanism to repeat requests in response to exceeding a temporary quote
+limit.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">get_ui_field_behaviour</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_ui_field_behaviour"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Returns custom UI field behaviour for AWS Connection.</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">
+<span class="sig-name descname"><span class="pre">test_connection</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.test_connection"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection" title="Permalink to this [...]
+<dd><p>Tests the AWS connection by call AWS STS (Security Token Service) GetCallerIdentity API.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<p><a class="reference external" href="https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html">https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html</a></p>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path">
+<span class="sig-name descname"><span class="pre">waiter_path</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.waiter_path"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path" title="Permalink to this definition"> [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiter_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon. [...]
+<dd><p>First checks if there is a custom waiter with the provided waiter_name and
+uses that if it exists, otherwise it will check the service client for a
+waiter that matches the name and pass that through.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
+<dd class="field-odd"><p><strong>waiter_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should exactly match the
+name of the key in the waiter model file (typically this is CamelCase).</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters">
+<span class="sig-name descname"><span class="pre">list_waiters</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#AwsGenericHook.list_waiters"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters" title="Permalink to this definitio [...]
+<dd><p>Returns a list containing the names of all waiters for the service, official and custom.</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">AwsBaseHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">aws_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_ [...]
+<dd><p>Bases: <a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a>[<code class="xref py py-obj docutils literal notranslate"><span class="pre">Union</span></code>[<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/bo [...]
+<p>Base class for interact with AWS.
+This class provide a thin wrapper around the boto3 python library.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
+<li><p><strong>aws_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The Airflow connection used for AWS credentials.
+If this is None or empty then the default boto3 behaviour is used. If
+running Airflow in a distributed manner and aws_conn_id is None or
+empty, then default boto3 configuration would be used (and must be
+maintained on each worker node).</p></li>
+<li><p><strong>verify</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Whether or not to verify SSL certificates. See:
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html</a></p></li>
+<li><p><strong>region_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – AWS region_name. If not specified then the default boto3 behaviour is used.</p></li>
+<li><p><strong>client_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.client</span> <s [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">resource_type</span></code>.</p></li>
+<li><p><strong>resource_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Reference to <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#boto3.session.Session.resource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">boto3.resource</sp [...]
+Mutually exclusive with <code class="docutils literal notranslate"><span class="pre">client_type</span></code>.</p></li>
+<li><p><strong>config</strong> (<em>Config</em><em> | </em><em>None</em>) – Configuration for botocore client. See:
+<a class="reference external" href="https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html">https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html</a></p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">resolve_session_factory</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#resolve_session_factory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="hea [...]
+<dd><p>Resolves custom SessionFactory class</p>
+<dl class="field-list simple">
+</dl>
</dd></dl>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.</span></span><span class="sig-name descname"><span class="pre">SessionFactory</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/base_aws.html#SessionFactory"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory" title= [...]
+<dd></dd></dl>
+
</div>
</div>
</div>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.athena" href="../athena/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,69 +1115,95 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection"><code class="docutils literal notranslate"><span class="pre">BaseAwsConnection</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.extra_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.role_arn</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.basic_session()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session"><code class="docutils literal notranslate"><span class="pre">BaseSessionFactory.create_session()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.service_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.verify</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_region_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_partition</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_name_attr</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.default_conn_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_type</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.hook_name</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_config()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_session()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_client_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_resource_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.conn_client_meta()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_conn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_credentials()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.expand_role()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.retry()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_ui_field_behaviour()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.test_connection()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.waiter_path()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters"><code class="docutils literal notranslate"><span class="pre">AwsGenericHook.list_waiters()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="docutils literal notranslate"><span class="pre">AwsBaseHook</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory"><code class="docutils literal notranslate"><span class="pre">resolve_session_factory()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory"><code class="docutils literal notranslate"><span class="pre">SessionFactory</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseAwsConnection">BaseAwsConnection</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory">BaseSessionFactory</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.extra_config">extra_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.role_arn">role_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.basic_session">basic_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory.create_session">create_session</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook">AwsGenericHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.service_config">service_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.region_name">region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.config">config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.verify">verify</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_region_name">conn_region_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_partition">conn_partition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_name_attr">conn_name_attr</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.default_conn_name">default_conn_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_type">conn_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.hook_name">hook_name</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_config">conn_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_session">get_session</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_client_type">get_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_resource_type">get_resource_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn">conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.conn_client_meta">conn_client_meta</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_conn">get_conn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_credentials">get_credentials</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.expand_role">expand_role</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.retry">retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_ui_field_behaviour">get_ui_field_behaviour</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.test_connection">test_connection</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.waiter_path">waiter_path</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook.list_waiters">list_waiters</a></li>
</ul>
</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook">AwsBaseHook</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.resolve_session_factory">resolve_session_factory</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.base_aws.SessionFactory">SessionFactory</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1232,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/base_aws/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
similarity index 59%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
index 311386562a..eeb35c4c13 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_client/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.batch_client — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,17 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_client">
+<span id="airflow-providers-amazon-aws-hooks-batch-client"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="airflow.providers.amazon.aws.hooks.batch_client"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_client" title="Permalink to this heading">¶</a></h1>
+<p>A client for AWS Batch services</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html</a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html">https://docs.aws.amazon.com/batch/latest/APIReference/Welcome.html</a></p></li>
+</ul>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,236 +625,395 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchClientHook</span></code></a></p></td>
+<td><p>Interact with AWS Batch.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
-<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
-<dd></dd></dl>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class= [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('batch')</span> <span class="pre">-></span> <span class="pre">botocore.client.Batch</span></code>.
+This is used for type hints on <code class="xref py py-meth docutils literal notranslate"><span class="pre">BatchClient.client()</span></code>; it covers
+only the subset of client methods required.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html</a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">
+<span class="sig-name descname"><span class="pre">describe_jobs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.describe_jobs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get job descriptions from AWS Batch</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>jobs</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – a list of JobId to describe</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe jobs</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiterName</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
+<dd><p>Get an AWS Batch service waiter</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiterName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing).</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>AWS Batch might not have any waiters (until botocore PR-1307 is released).</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">boto3</span>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd></dd></dl>
+<span class="n">boto3</span><span class="o">.</span><span class="n">client</span><span class="p">(</span><span class="s2">"batch"</span><span class="p">)</span><span class="o">.</span><span class="n">waiter_names</span> <span class="o">==</span> <span class="p">[]</span>
+</pre></div>
+</div>
+</div>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/pull/1307">https://github.com/boto/botocore/pull/1307</a></p></li>
+</ul>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">
+<span class="sig-name descname"><span class="pre">submit_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobName</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobQueue</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">jobDefinition</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">arrayProperties</span></span></em>, <em class="sig-param"><span class=" [...]
+<dd><p>Submit a Batch job</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobName</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the name for the AWS Batch job</p></li>
+<li><p><strong>jobQueue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the queue name on AWS Batch</p></li>
+<li><p><strong>jobDefinition</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – the job definition name on AWS Batch</p></li>
+<li><p><strong>arrayProperties</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>containerOverrides</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+<li><p><strong>tags</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – the same parameter that boto3 will receive</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">jobId</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchProtocol.terminate_job"><span class="viewcode-link"><span class= [...]
+<dd><p>Terminate a Batch job</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>jobId</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a reason to terminate job ID</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.</span></span><span class="sig-name descname"><span class="pre">BatchClientHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class=" [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Batch.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html#Batch.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("batch")</span></code></a>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>max_retries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – exponential back-off retries, 4200 = 48 hours;
+polling is only used when waiters is None</p></li>
+<li><p><strong>status_retries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – number of HTTP retries to get job status, 10;
+polling is only used when waiters is None</p></li>
+</ul>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>Several methods use a default random delay to check or poll for job status, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>
+Using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
+<p>To modify the global defaults for the range of jitter allowed when a
+random delay is used to check Batch job status, modify these defaults, e.g.:
+.. code-block:</p>
+<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MIN</span> <span class="o">=</span> <span class="mi">0</span>
+<span class="n">BatchClient</span><span class="o">.</span><span class="n">DEFAULT_DELAY_MAX</span> <span class="o">=</span> <span class="mi">5</span>
+</pre></div>
+</div>
+<p>When explicit delay values are used, a 1 second random jitter is applied to the
+delay (e.g. a delay of 0 sec will be a <code class="docutils literal notranslate"><span class="pre">random.uniform(0,</span> <span class="pre">1)</span></code> delay. It is
+generally recommended that random jitter is added to API requests. A
+convenience method is provided for this, e.g. to get a random delay of
+10 sec +/- 5 sec: <code class="docutils literal notranslate"><span class="pre">delay</span> <span class="pre">=</span> <span class="pre">BatchClient.add_jitter(10,</span> <span class="pre">width=5,</span> <span class="pre">minima=0)</span></code></p>
+</div>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
+</div>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">client</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><span class="pre">BatchProtocol</span></a><span class="w"> </span><span cla [...]
+<dd><p>An AWS API client for Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a boto3 ‘batch’ client for the <code class="docutils literal notranslate"><span class="pre">.region_name</span></code></p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol" title="airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a> | botocore.client.BaseClient</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">
+<span class="sig-name descname"><span class="pre">MAX_RETRIES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">4200</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.MAX_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provider [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">
+<span class="sig-name descname"><span class="pre">STATUS_RETRIES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.STATUS_RETRIES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MIN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">1</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MIN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">
+<span class="sig-name descname"><span class="pre">DEFAULT_DELAY_MAX</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.DEFAULT_DELAY_MAX"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">
+<span class="sig-name descname"><span class="pre">FAILURE_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'FAILED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.FAILURE_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">
+<span class="sig-name descname"><span class="pre">SUCCESS_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'SUCCEEDED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.SUCCESS_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airfl [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">
+<span class="sig-name descname"><span class="pre">RUNNING_STATE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'RUNNING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.RUNNING_STATE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
<dd></dd></dl>
-</dd></dl>
-
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
-</ul>
-</dd>
-</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUBMITTED',</span> <span class="pre">'PENDING',</span> <span class="pre">'RUNNABLE',</span> <span class="pre">'STARTING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.INT [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('VALID',</span> <span class="pre">'DELETED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS"><span class="viewcode-link"> [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.COMPUTE_ENVIRONMENT_ [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_TERMINAL_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('VALID',</span> <span class="pre">'DELETED')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_TERMINAL_STATUS"><span class="viewcode-link"><span class="pre">[s [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">
+<span class="sig-name descname"><span class="pre">JOB_QUEUE_INTERMEDIATE_STATUS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('CREATING',</span> <span class="pre">'UPDATING',</span> <span class="pre">'DELETING')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS" [...]
<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">
+<span class="sig-name descname"><span class="pre">terminate_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.terminate_job"><span class="viewcode-link"><span cla [...]
+<dd><p>Terminate a Batch job</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a job ID to terminate</p></li>
+<li><p><strong>reason</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a reason to terminate job ID</p></li>
+</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
+<dd class="field-even"><p>an API response</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">
+<span class="sig-name descname"><span class="pre">check_job_success</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.check_job_success"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pro [...]
+<dd><p>Check the final status of the Batch job; return True if the job
+‘SUCCEEDED’, else raise an AirflowException</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">
+<span class="sig-name descname"><span class="pre">poll_for_job_running</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/ai [...]
+<dd><p>Poll for job running. The status that indicates a job is running or
+already complete are: ‘RUNNING’|’SUCCEEDED’|’FAILED’.</p>
+<p>So the status options that this will wait for are the transitions from:
+‘SUBMITTED’>’PENDING’>’RUNNABLE’>’STARTING’>’RUNNING’|’SUCCEEDED’|’FAILED’</p>
+<p>The completed status options are included for cases where the status
+changes too quickly for polling to detect a RUNNING status that moves
+quickly from STARTING to RUNNING to completed (often a failure).</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">
+<span class="sig-name descname"><span class="pre">poll_for_job_complete</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/a [...]
+<dd><p>Poll for job completion. The status that indicates job completion
+are: ‘SUCCEEDED’|’FAILED’.</p>
+<p>So the status options that this will wait for are the transitions from:
+‘SUBMITTED’>’PENDING’>’RUNNABLE’>’STARTING’>’RUNNING’>’SUCCEEDED’|’FAILED’</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay before polling for job status</p></li>
+</ul>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">
+<span class="sig-name descname"><span class="pre">poll_job_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">match_status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.poll_job_status"><span class="viewcode-link" [...]
+<dd><p>Poll for job status using an exponential back-off strategy (with max_retries).</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>match_status</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>]</em>) – a list of job status to match; the Batch job status are:
+‘SUBMITTED’|’PENDING’|’RUNNABLE’|’STARTING’|’RUNNING’|’SUCCEEDED’|’FAILED’</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">
+<span class="sig-name descname"><span class="pre">get_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow [...]
+<dd><p>Get job description (using status_retries).</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
+<dd class="field-even"><p>an API response for describe jobs</p>
</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">parse_job_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">response</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/h [...]
+<dd><p>Parse job description to extract description for job_id</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>response</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – an API response for describe jobs</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>an API response to describe job_id</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p>AirflowException</p>
</dd>
<dt class="field-even">Return type</dt>
<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
@@ -839,59 +1022,104 @@ See Tenacity documentation at <a class="reference external" href="https://github
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">
+<span class="sig-name descname"><span class="pre">get_job_awslogs_info</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.get_job_awslogs_info"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airfl [...]
+<dd><p>Parse job description to extract AWS CloudWatch information.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
+<dd class="field-odd"><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – AWS Batch Job ID</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">add_jitter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">width</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">1</span></span></em>, <em class="sig-param"><span cla [...]
+<dd><p>Use delay +/- width for random jitter</p>
+<p>Adding jitter to status polling can help to avoid
+AWS Batch API limits for monitoring Batch jobs with
+a high concurrency in Airflow tasks.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – number of seconds to pause;
+delay is assumed to be a positive number</p></li>
+<li><p><strong>width</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – delay +/- width for random jitter;
+width is assumed to be a positive number</p></li>
+<li><p><strong>minima</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – minimum delay allowed;
+minima is assumed to be a non-negative number</p></li>
</ul>
</dd>
<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
+<dd class="field-even"><p>uniform(delay - width, delay + width) jitter
+and it is a non-negative number</p>
</dd>
<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)">float</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/a [...]
+<dd><p>Pause execution for <code class="docutils literal notranslate"><span class="pre">delay</span></code> seconds.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – a delay to pause execution using <code class="docutils literal notranslate"><span class="pre">time.sleep(delay)</span></code>;
+a small 1 second jitter is applied to the delay.</p>
+</dd>
+</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method uses a default random delay, i.e.
+<code class="docutils literal notranslate"><span class="pre">random.uniform(DEFAULT_DELAY_MIN,</span> <span class="pre">DEFAULT_DELAY_MAX)</span></code>;
+using a random interval helps to avoid AWS API throttle limits
+when many concurrent tasks request job-descriptions.</p>
+</div>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">
+<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">exponential_delay</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">tries</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_client.html#BatchClientHook.exponential_delay"><span class="viewcode-link"><spa [...]
+<dd><p>An exponential back-off delay, with random jitter. There is a maximum
+interval of 10 minutes (with random jitter between 3 and 10 minutes).
+This is used in the <code class="xref py py-meth docutils literal notranslate"><span class="pre">poll_for_job_status()</span></code> method.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>tries</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Number of tries</p>
</dd>
</dl>
+<p>Examples of behavior:</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="k">def</span> <span class="nf">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">):</span>
+ <span class="n">max_interval</span> <span class="o">=</span> <span class="mf">600.0</span> <span class="c1"># 10 minutes in seconds</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="mi">1</span> <span class="o">+</span> <span class="nb">pow</span><span class="p">(</span><span class="n">tries</span> <span class="o">*</span> <span class="mf">0.6</span><span class="p">,</span> <span class="mi">2</span><span class="p">)</span>
+ <span class="n">delay</span> <span class="o">=</span> <span class="nb">min</span><span class="p">(</span><span class="n">max_interval</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+ <span class="nb">print</span><span class="p">(</span><span class="n">delay</span> <span class="o">/</span> <span class="mi">3</span><span class="p">,</span> <span class="n">delay</span><span class="p">)</span>
+
+
+<span class="k">for</span> <span class="n">tries</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">10</span><span class="p">):</span>
+ <span class="n">exp</span><span class="p">(</span><span class="n">tries</span><span class="p">)</span>
+
+<span class="c1"># 0.33 1.0</span>
+<span class="c1"># 0.45 1.35</span>
+<span class="c1"># 0.81 2.44</span>
+<span class="c1"># 1.41 4.23</span>
+<span class="c1"># 2.25 6.76</span>
+<span class="c1"># 3.33 10.00</span>
+<span class="c1"># 4.65 13.95</span>
+<span class="c1"># 6.21 18.64</span>
+<span class="c1"># 8.01 24.04</span>
+<span class="c1"># 10.05 30.15</span>
+</pre></div>
+</div>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/general/latest/gr/api-retries.html">https://docs.aws.amazon.com/general/latest/gr/api-retries.html</a></p></li>
+<li><p><a class="reference external" href="https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/">https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/</a></p></li>
+</ul>
+</div>
</dd></dl>
</dd></dl>
@@ -902,10 +1130,10 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.base_aws" href="../base_aws/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,67 +1203,77 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol"><code class="docutils literal notranslate"><span class="pre">BatchProtocol</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.describe_jobs()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.submit_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job"><code class="docutils literal notranslate"><span class="pre">BatchProtocol.terminate_job()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="docutils literal notranslate"><span class="pre">BatchClientHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.client</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.MAX_RETRIES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.STATUS_RETRIES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.DEFAULT_DELAY_MIN</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.DEFAULT_DELAY_MAX</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.FAILURE_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.SUCCESS_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.RUNNING_STATE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.JOB_QUEUE_TERMINAL_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.terminate_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.check_job_success()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.wait_for_job()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_for_job_running()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_for_job_complete()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.poll_job_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.get_job_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.parse_job_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.get_job_awslogs_info()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.add_jitter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.delay()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay"><code class="docutils literal notranslate"><span class="pre">BatchClientHook.exponential_delay()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol">BatchProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.describe_jobs">describe_jobs</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.submit_job">submit_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchProtocol.terminate_job">terminate_job</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook">BatchClientHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.client">client</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.MAX_RETRIES">MAX_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.STATUS_RETRIES">STATUS_RETRIES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MIN">DEFAULT_DELAY_MIN</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.DEFAULT_DELAY_MAX">DEFAULT_DELAY_MAX</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.FAILURE_STATE">FAILURE_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.SUCCESS_STATE">SUCCESS_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.RUNNING_STATE">RUNNING_STATE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.INTERMEDIATE_STATES">INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_TERMINAL_STATUS">COMPUTE_ENVIRONMENT_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS">COMPUTE_ENVIRONMENT_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_TERMINAL_STATUS">JOB_QUEUE_TERMINAL_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.JOB_QUEUE_INTERMEDIATE_STATUS">JOB_QUEUE_INTERMEDIATE_STATUS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.terminate_job">terminate_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.check_job_success">check_job_success</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.wait_for_job">wait_for_job</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_running">poll_for_job_running</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_for_job_complete">poll_for_job_complete</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.poll_job_status">poll_job_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_description">get_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.parse_job_description">parse_job_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.get_job_awslogs_info">get_job_awslogs_info</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.add_jitter">add_jitter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.delay">delay</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook.exponential_delay">exponential_delay</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1304,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_client/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
similarity index 75%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
index bbb82cc117..8ec91033f0 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.batch_waiters — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,16 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.batch_waiters">
+<span id="airflow-providers-amazon-aws-hooks-batch-waiters"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="airflow.providers.amazon.aws.hooks.batch_waiters"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.batch_waiters" title="Permalink to this heading">¶</a></h1>
+<p>AWS Batch service waiters</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
+</ul>
+</div>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,81 +624,194 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook" title="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchWaitersHook</span></code></a></p></td>
+<td><p>A utility to manage waiters for AWS Batch services.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters.</span></span><span class="sig-name descname"><span class="pre">BatchWaitersHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class [...]
+<dd><p>Bases: <a class="reference internal" href="../batch_client/index.html#airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook" title="airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook</span></code></a></p>
+<p>A utility to manage waiters for AWS Batch services.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+<span class="kn">from</span> <span class="nn">airflow.providers.amazon.aws.operators.batch_waiters</span> <span class="kn">import</span> <span class="n">BatchWaiters</span>
+
+<span class="c1"># to inspect default waiters</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">()</span>
+<span class="n">config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># type: Dict</span>
+<span class="n">waiter_names</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># -> ["JobComplete", "JobExists", "JobRunning"]</span>
+
+<span class="c1"># The default_config is a useful stepping stone to creating custom waiters, e.g.</span>
+<span class="n">custom_config</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">default_config</span> <span class="c1"># this is a deepcopy</span>
+<span class="c1"># modify custom_config['waiters'] as necessary and get a new instance:</span>
+<span class="n">waiters</span> <span class="o">=</span> <span class="n">BatchWaiters</span><span class="p">(</span><span class="n">waiter_config</span><span class="o">=</span><span class="n">custom_config</span><span class="p">)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_config</span> <span class="c1"># check the custom configuration (this is a deepcopy)</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">list_waiters</span><span class="p">()</span> <span class="c1"># names of custom waiters</span>
+
+<span class="c1"># During the init for BatchWaiters, the waiter_config is used to build a waiter_model;</span>
+<span class="c1"># and note that this only occurs during the class init, to avoid any accidental mutations</span>
+<span class="c1"># of waiter_config leaking into the waiter_model.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">waiter_model</span> <span class="c1"># -> botocore.waiter.WaiterModel object</span>
+
+<span class="c1"># The waiter_model is combined with the waiters.client to get a specific waiter</span>
+<span class="c1"># and the details of the config on that waiter can be further modified without any</span>
+<span class="c1"># accidental impact on the generation of new waiters from the defined waiter_model, e.g.</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+
+<span class="c1"># To use a specific waiter, update the config and call the `wait()` method for jobId, e.g.</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># -> botocore.waiter.Batch.Waiter.JobExists object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
</div>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://www.2ndwatch.com/blog/use-waiters-boto3-write/">https://www.2ndwatch.com/blog/use-waiters-boto3-write/</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/blob/develop/botocore/waiter.py">https://github.com/boto/botocore/blob/develop/botocore/waiter.py</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#waiters</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15">https://github.com/boto/botocore/tree/develop/botocore/data/ec2/2016-11-15</a></p></li>
+<li><p><a class="reference external" href="https://github.com/boto/botocore/issues/1915">https://github.com/boto/botocore/issues/1915</a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>waiter_config</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em> | </em><em>None</em>) – a custom waiter configuration for AWS Batch services</p></li>
+<li><p><strong>aws_conn_id</strong> – connection id of AWS credentials / region name. If None,
+credential boto3 strategy will be used
+(<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html">https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html</a>).</p></li>
+<li><p><strong>region_name</strong> – region name to use in AWS client.
+Override the AWS region in connection (if provided)</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">default_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers [...]
+<dd><p>An immutable default waiter configuration</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_config</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><span class="pre">dict</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/ [...]
+<dd><p>An immutable waiter configuration for this instance; a <code class="docutils literal notranslate"><span class="pre">deepcopy</span></code> is returned by this
+property. During the init for BatchWaiters, the waiter_config is used to build a
+waiter_model and this only occurs during the class init, to avoid any accidental
+mutations of waiter_config leaking into the waiter_model.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter configuration for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">waiter_model</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">botocore.waiter.WaiterModel</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.waiter_model"><span class="viewcode-link"><sp [...]
+<dd><p>A configured waiter model used to generate waiters on AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>a waiter model for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p>botocore.waiter.WaiterModel</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">waiter_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Get an AWS Batch service waiter, using the configured <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>.</p>
+<p>The <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is combined with the <code class="docutils literal notranslate"><span class="pre">.client</span></code> to get a specific waiter and
+the properties of that waiter can be modified without any accidental impact on the
+generation of new waiters from the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code>, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5</span>
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="c1"># -> 5 as defined by waiter_model</span>
+</pre></div>
+</div>
+<p>To use a specific waiter, update the config and call the <cite>wait()</cite> method for jobId, e.g.</p>
+<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">random</span>
+
+<span class="n">waiter</span> <span class="o">=</span> <span class="n">waiters</span><span class="o">.</span><span class="n">get_waiter</span><span class="p">(</span><span class="s2">"JobExists"</span><span class="p">)</span> <span class="c1"># a new waiter object</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">delay</span> <span class="o">=</span> <span class="n">random</span><span class="o">.</span><span class="n">uniform</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">10</span><span class="p">)</span> <span class="c1"># seconds</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">max_attempts</span> <span class="o">=</span> <span class="mi">10</span>
+<span class="n">waiter</span><span class="o">.</span><span class="n">wait</span><span class="p">(</span><span class="n">jobs</span><span class="o">=</span><span class="p">[</span><span class="n">jobId</span><span class="p">])</span>
+</pre></div>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>waiter_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The name of the waiter. The name should match
+the name (including the casing) of the key name in the waiter
+model file (typically this is CamelCasing); see <code class="docutils literal notranslate"><span class="pre">.list_waiters</span></code>.</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>a waiter object for the named AWS Batch service</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>botocore.waiter.Waiter</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">
+<span class="sig-name descname"><span class="pre">list_waiters</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/batch_waiters.html#BatchWaitersHook.list_waiters"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters" title="Permalink to [...]
+<dd><p>List the waiters in a waiter configuration for AWS Batch services.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>waiter names for AWS Batch services</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a>]</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">
+<span class="sig-name descname"><span class="pre">wait_for_job</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">job_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">delay</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/pr [...]
+<dd><p>Wait for Batch job to complete. This assumes that the <code class="docutils literal notranslate"><span class="pre">.waiter_model</span></code> is configured
+using some variation of the <code class="docutils literal notranslate"><span class="pre">.default_config</span></code> so that it can generate waiters with the
+following names: “JobExists”, “JobRunning” and “JobComplete”.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>job_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – a Batch job ID</p></li>
+<li><p><strong>delay</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em> | </em><em>None</em>) – A delay before polling for job status</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p>AirflowException</p>
+</dd>
</dl>
+<div class="admonition note">
+<p class="admonition-title">Note</p>
+<p>This method adds a small random jitter to the <code class="docutils literal notranslate"><span class="pre">delay</span></code> (+/- 2 sec, >= 1 sec).
+Using a random interval helps to avoid AWS API throttle limits when many
+concurrent tasks request job-descriptions.</p>
+<p>It also modifies the <code class="docutils literal notranslate"><span class="pre">max_attempts</span></code> to use the <code class="docutils literal notranslate"><span class="pre">sys.maxsize</span></code>,
+which allows Airflow to manage the timeout on waiting.</p>
+</div>
</dd></dl>
</dd></dl>
@@ -685,10 +822,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_client" href="../batch_client/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +895,25 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.batch_waiters</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.default_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.waiter_config</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.waiter_model</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.list_waiters()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job"><code class="docutils literal notranslate"><span class="pre">BatchWaitersHook.wait_for_job()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook">BatchWaitersHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.default_config">default_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_config">waiter_config</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.waiter_model">waiter_model</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.list_waiters">list_waiters</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook.wait_for_job">wait_for_job</a></li>
</ul>
</li>
</ul>
@@ -807,7 +944,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/batch_waiters/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
similarity index 86%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
index 1ea82ab6c2..be2af3f69d 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.sensors.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.cloud_formation — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.sensors.flink_kubernetes">
-<span id="airflow-providers-apache-flink-sensors-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title="airflow.providers.apache.flink.sensors.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.sensors.flink_kubernetes" title=" [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.cloud_formation">
+<span id="airflow-providers-amazon-aws-hooks-cloud-formation"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="airflow.providers.amazon.aws.hooks.cloud_formation"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.cloud_formation" title="Permalink to this heading [...]
+<p>This module contains AWS CloudFormation Hook</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,55 +617,77 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor" title="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a></p></td>
-<td><p>Checks flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook" title="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">CloudFormationHook</span></code></a></p></td>
+<td><p>Interact with AWS CloudFormation.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesSensor</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_name</span></span></e [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow/stable/_api/airflow/sensors/base/index.html#airflow.sensors.base.BaseSensorOperator" title="(in apache-airflow v2.6.0.dev0)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.sensors.base.BaseSensorOperator</span></code></a></p>
-<p>Checks flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation.</span></span><span class="sig-name descname"><span class="pre">CloudFormationHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span c [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS CloudFormation.
+Provide thin wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("cloudformation")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">
+<span class="sig-name descname"><span class="pre">get_stack_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.get_stack_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><p>Get stack status from CloudFormation.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.describe_stacks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.describe_stacks()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">
+<span class="sig-name descname"><span class="pre">create_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/cloud_formation.html#CloudFormationHook.create_stack"><span clas [...]
+<dd><p>Create stack in CloudFormation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.create_stack" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.create_stack()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – flink Application resource name</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – the kubernetes namespace where the flinkDeployment reside in</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection</span></a>
-to Kubernetes cluster</p></li>
-<li><p><strong>attach_log</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – determines whether logs for driver pod should be appended to the sensor log</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>plural</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api custom object plural</p></li>
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – parameters to be passed to CloudFormation.</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">
-<span class="sig-name descname"><span class="pre">FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('MISSING',</span> <span class="pre">'ERROR')</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</ [...]
-<dd></dd></dl>
-
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">
-<span class="sig-name descname"><span class="pre">SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('READY',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
-<dd></dd></dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">
-<span class="sig-name descname"><span class="pre">poke</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/sensors/flink_kubernetes.html#FlinkKubernetesSensor.poke"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apac [...]
-<dd><p>Function defined by the sensors while deriving this class should override.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">
+<span class="sig-name descname"><span class="pre">delete_stack</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">stack_name</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">cloudformation_parameters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../. [...]
+<dd><p>Delete stack in CloudFormation.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudformation.html#CloudFormation.Client.delete_stack" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">CloudFormation.Client.delete_stack()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>stack_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – stack_name.</p></li>
+<li><p><strong>cloudformation_parameters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em> | </em><em>None</em>) – parameters to be passed to CloudFormation (optional).</p></li>
+</ul>
+</dd>
</dl>
</dd></dl>
@@ -660,10 +699,10 @@ to Kubernetes cluster</p></li>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.sensors" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.batch_waiters" href="../batch_waiters/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -733,21 +772,19 @@ to Kubernetes cluster</p></li>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.sensors.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.cloud_formation</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.FAILURE_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.SUCCESS_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesSensor.poke()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.get_stack_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.create_stack()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack"><code class="docutils literal notranslate"><span class="pre">CloudFormationHook.delete_stack()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor">FlinkKubernetesSensor</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.FAILURE_STATES">FAILURE_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.SUCCESS_STATES">SUCCESS_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.sensors.flink_kubernetes.FlinkKubernetesSensor.poke">poke</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook">CloudFormationHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.get_stack_status">get_stack_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.create_stack">create_stack</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook.delete_stack">delete_stack</a></li>
</ul>
</li>
</ul>
@@ -778,7 +815,7 @@ to Kubernetes cluster</p></li>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/sensors/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/cloud_formation/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
similarity index 67%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
index bbb82cc117..b9741beda3 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/datasync/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.datasync — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.datasync">
+<span id="airflow-providers-amazon-aws-hooks-datasync"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="airflow.providers.amazon.aws.hooks.datasync"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.datasync" title="Permalink to this heading">¶</a></h1>
+<p>Interact with AWS DataSync, using the AWS <code class="docutils literal notranslate"><span class="pre">boto3</span></code> library.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +617,334 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook" title="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DataSyncHook</span></code></a></p></td>
+<td><p>Interact with AWS DataSync.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.datasync.</span></span><span class="sig-name descname"><span class="pre">DataSyncHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">wait_interval_seconds</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">30 [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS DataSync.
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("datasync")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>wait_interval_seconds</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Time to wait between two
+consecutive calls to check TaskExecution status. Defaults to 30 seconds.</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/exceptions.html#ValueError" title="(in Python v3.11)"><strong>ValueError</strong></a> – If wait_interval_seconds is not between 0 and 15*60 seconds.</p>
+</dd>
+</dl>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_INTERMEDIATE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('INITIALIZING',</span> <span class="pre">'QUEUED',</span> <span class="pre">'LAUNCHING',</span> <span class="pre">'PREPARING',</span> <span class="pre">'TRANSFERRING',</span> <span class="pre">'VERIFYING')</span></em><a class="reference internal" href="../. [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_FAILURE_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('ERROR',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_FAILURE_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class=" [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">
+<span class="sig-name descname"><span class="pre">TASK_EXECUTION_SUCCESS_STATES</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">('SUCCESS',)</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.TASK_EXECUTION_SUCCESS_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class [...]
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">
+<span class="sig-name descname"><span class="pre">create_location</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_location_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.htm [...]
+<dd><p>Creates a new location.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_s3" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_s3()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_smb" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_smb()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_nfs" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_nfs()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_location_efs" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_location_efs()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Location URI used to determine the location type (S3, SMB, NFS, EFS).</p></li>
+<li><p><strong>create_location_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">DataSync.Client.create_location_*</span></code> methods.</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>LocationArn of the created Location.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowException</strong> – If location type (prefix from <code class="docutils literal notranslate"><span class="pre">location_uri</span></code>) is invalid.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">
+<span class="sig-name descname"><span class="pre">get_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">location_uri</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">case_sensitive</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ignore_trailing_slash</span>< [...]
+<dd><p>Return all LocationArns which match a LocationUri.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>location_uri</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Location URI to search for, eg <code class="docutils literal notranslate"><span class="pre">s3://mybucket/mypath</span></code></p></li>
+<li><p><strong>case_sensitive</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Do a case sensitive search for location URI.</p></li>
+<li><p><strong>ignore_trailing_slash</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Ignore / at the end of URI when matching.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of LocationArns.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">location_uri</span></code> is empty</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a>]</p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">
+<span class="sig-name descname"><span class="pre">create_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">create_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="ref [...]
+<dd><p>Create a Task between the specified source and destination LocationArns.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.create_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.create_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Source LocationArn. Must exist already.</p></li>
+<li><p><strong>destination_location_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Destination LocationArn. Must exist already.</p></li>
+<li><p><strong>create_task_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">boto.create_task()</span></code>. See AWS boto3 datasync documentation.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskArn of the created Task</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">
+<span class="sig-name descname"><span class="pre">update_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">update_task_kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHo [...]
+<dd><p>Update a Task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.update_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.update_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The TaskArn to update.</p></li>
+<li><p><strong>update_task_kwargs</strong> – Passed to <code class="docutils literal notranslate"><span class="pre">boto.update_task()</span></code>, See AWS boto3 datasync documentation.</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">
+<span class="sig-name descname"><span class="pre">delete_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.delete_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Delete a Task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.delete_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.delete_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The TaskArn to delete.</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">
+<span class="sig-name descname"><span class="pre">get_task_arns_for_location_arns</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">source_location_arns</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">destination_location_arns</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task [...]
+<dd><p>Return list of TaskArns for which use any one of the specified
+source LocationArns and any one of the specified destination LocationArns.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>source_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of source LocationArns.</p></li>
+<li><p><strong>destination_location_arns</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of destination LocationArns.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">source_location_arns</span></code> or <code class="docutils literal notranslate"><span class="pre">destination_location_arns</span></code> are empty.</p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">
+<span class="sig-name descname"><span class="pre">start_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook. [...]
+<dd><p>Start a TaskExecution for the specified task_arn.
+Each task can have at most one TaskExecution.
+Additional keyword arguments send to <code class="docutils literal notranslate"><span class="pre">start_task_execution</span></code> boto3 method.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.start_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.start_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>TaskExecutionArn</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>ClientError</strong> – If a TaskExecution is already busy running for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p></li>
+<li><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">
+<span class="sig-name descname"><span class="pre">cancel_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.cancel_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Cancel a TaskExecution for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.cancel_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.cancel_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn.</p>
+</dd>
+<dt class="field-even">Raises</dt>
+<dd class="field-even"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">
+<span class="sig-name descname"><span class="pre">get_task_description</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_task_description"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.pr [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.describe_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.describe_task()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">
+<span class="sig-name descname"><span class="pre">describe_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.describe_task_execution"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" h [...]
+<dd><p>Get description for the specified <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/datasync.html#DataSync.Client.describe_task_execution" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DataSync.Client.describe_task_execution()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>AWS metadata about a task execution.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">
+<span class="sig-name descname"><span class="pre">get_current_task_execution_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/datasync.html#DataSyncHook.get_current_task_execution_arn"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlin [...]
+<dd><p>Get current TaskExecutionArn (if one exists) for the specified <code class="docutils literal notranslate"><span class="pre">task_arn</span></code>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskArn</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>CurrentTaskExecutionArn for this <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> or None.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><p><strong>AirflowBadRequest</strong> – if <code class="docutils literal notranslate"><span class="pre">task_arn</span></code> is empty.</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">
+<span class="sig-name descname"><span class="pre">wait_for_task_execution</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_execution_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">max_iterations</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">60</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../. [...]
+<dd><p>Wait for Task Execution status to be complete (SUCCESS/ERROR).
+The <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> must exist, or a boto3 ClientError will be raised.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>task_execution_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – TaskExecutionArn</p></li>
+<li><p><strong>max_iterations</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a>) – Maximum number of iterations before timing out.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Result of task execution.</p>
+</dd>
+<dt class="field-odd">Raises</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>AirflowTaskTimeout</strong> – If maximum iterations is exceeded.</p></li>
+<li><p><strong>AirflowBadRequest</strong> – If <code class="docutils literal notranslate"><span class="pre">task_execution_arn</span></code> is empty.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)">bool</a></p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +956,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.cloud_formation" href="../cloud_formation/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +1029,43 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.datasync</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook"><code class="docutils literal notranslate"><span class="pre">DataSyncHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_FAILURE_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.TASK_EXECUTION_SUCCESS_STATES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.create_location()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_location_arns()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.create_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.update_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.delete_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_task_arns_for_location_arns()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.start_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.cancel_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_task_description()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.describe_task_execution()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.get_current_task_execution_arn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution"><code class="docutils literal notranslate"><span class="pre">DataSyncHook.wait_for_task_execution()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook">DataSyncHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_INTERMEDIATE_STATES">TASK_EXECUTION_INTERMEDIATE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_FAILURE_STATES">TASK_EXECUTION_FAILURE_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.TASK_EXECUTION_SUCCESS_STATES">TASK_EXECUTION_SUCCESS_STATES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_location">create_location</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_location_arns">get_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.create_task">create_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.update_task">update_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.delete_task">delete_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_arns_for_location_arns">get_task_arns_for_location_arns</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.start_task_execution">start_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.cancel_task_execution">cancel_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_task_description">get_task_description</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.describe_task_execution">describe_task_execution</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.get_current_task_execution_arn">get_current_task_execution_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.datasync.DataSyncHook.wait_for_task_execution">wait_for_task_execution</a></li>
</ul>
</li>
</ul>
@@ -807,7 +1096,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/datasync/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
similarity index 74%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
index bbb82cc117..4d4555d659 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dms/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.dms — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dms">
+<span id="airflow-providers-amazon-aws-hooks-dms"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dms" title="airflow.providers.amazon.aws.hooks.dms"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dms" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,213 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus</span></code></a></p></td>
+<td><p>Available AWS DMS Task Waiter statuses.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook" title="airflow.providers.amazon.aws.hooks.dms.DmsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DmsHook</span></code></a></p></td>
+<td><p>Interact with AWS Database Migration Service (DMS).</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsTaskWaiterStatus</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="heade [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">str</span></code></a>, <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Available AWS DMS Task Waiter statuses.</p>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">
+<span class="sig-name descname"><span class="pre">DELETED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'deleted'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.DELETED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">
+<span class="sig-name descname"><span class="pre">READY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ready'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.READY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'stopped'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsTaskWaiterStatus.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dms.</span></span><span class="sig-name descname"><span class="pre">DmsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with AWS Database Migration Service (DMS).
+Provide thin wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("dms")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">
+<span class="sig-name descname"><span class="pre">describe_replication_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.describe_replication_tasks"><span class="viewcode-link"><span class="pre">[source]</span> [...]
+<dd><p>Describe replication tasks</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.describe_replication_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.describe_replication_tasks()</span></code></a></p></li>
+</ul>
</div>
+<dl class="field-list simple">
+<dt class="field-odd">Returns</dt>
+<dd class="field-odd"><p>Marker and list of replication tasks</p>
+</dd>
+<dt class="field-even">Return type</dt>
+<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#tuple" title="(in Python v3.11)">tuple</a>[<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None, <a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>]</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">
+<span class="sig-name descname"><span class="pre">find_replication_tasks_by_arn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">without_settings</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">False</span></span></em><span class="sig-paren">)</span><a class="reference internal" hre [...]
+<dd><p>Find and describe replication tasks by task ARN</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.describe_replication_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.describe_replication_tasks()</span></code></a></p></li>
+</ul>
</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task arn</p></li>
+<li><p><strong>without_settings</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – Indicates whether to return task information with settings.</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>list of replication tasks that match the ARN</p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">
+<span class="sig-name descname"><span class="pre">get_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.get_task_status"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Retrieve task status.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Current task status</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a> | None</p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">
+<span class="sig-name descname"><span class="pre">create_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">source_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_endpoint_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">replication_instance_arn</spa [...]
+<dd><p>Create DMS replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.create_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.create_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task id</p></li>
+<li><p><strong>source_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Source endpoint ARN</p></li>
+<li><p><strong>target_endpoint_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Target endpoint ARN</p></li>
+<li><p><strong>replication_instance_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication instance ARN</p></li>
+<li><p><strong>table_mappings</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a>) – Table mappings</p></li>
+<li><p><strong>migration_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Migration type (‘full-load’|’cdc’|’full-load-and-cdc’), full-load by default.</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Replication task ARN</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">
+<span class="sig-name descname"><span class="pre">start_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">start_replication_task_type</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class=" [...]
+<dd><p>Starts replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.start_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.start_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p></li>
+<li><p><strong>start_replication_task_type</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task start type (default=’start-replication’)
+(‘start-replication’|’resume-processing’|’reload-target’)</p></li>
+</ul>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">
+<span class="sig-name descname"><span class="pre">stop_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.stop_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
+<dd><p>Stops replication task.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.stop_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.stop_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> – Replication task ARN</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">
+<span class="sig-name descname"><span class="pre">delete_replication_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.delete_replication_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Starts replication task deletion and waits for it to be deleted.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms.html#DatabaseMigrationService.Client.delete_replication_task" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DatabaseMigrationService.Client.delete_replication_task()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>replication_task_arn</strong> – Replication task ARN</p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">
+<span class="sig-name descname"><span class="pre">wait_for_task_status</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">replication_task_arn</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">status</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dms.html#DmsHook.wait_for_task_status"><span class="viewcode-link [...]
+<dd><p>Waits for replication task to reach status.
+Supported statuses: deleted, ready, running, stopped.</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>status</strong> (<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus" title="airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><em>DmsTaskWaiterStatus</em></a>) – Status to wait for</p></li>
+<li><p><strong>replication_task_arn</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Replication task ARN</p></li>
+</ul>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +834,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.datasync" href="../datasync/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +907,43 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dms</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.DELETED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.READY</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.RUNNING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED"><code class="docutils literal notranslate"><span class="pre">DmsTaskWaiterStatus.STOPPED</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook"><code class="docutils literal notranslate"><span class="pre">DmsHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks"><code class="docutils literal notranslate"><span class="pre">DmsHook.describe_replication_tasks()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn"><code class="docutils literal notranslate"><span class="pre">DmsHook.find_replication_tasks_by_arn()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status"><code class="docutils literal notranslate"><span class="pre">DmsHook.get_task_status()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.create_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.start_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.stop_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task"><code class="docutils literal notranslate"><span class="pre">DmsHook.delete_replication_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status"><code class="docutils literal notranslate"><span class="pre">DmsHook.wait_for_task_status()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus">DmsTaskWaiterStatus</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.DELETED">DELETED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.READY">READY</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsTaskWaiterStatus.STOPPED">STOPPED</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook">DmsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.describe_replication_tasks">describe_replication_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.find_replication_tasks_by_arn">find_replication_tasks_by_arn</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.get_task_status">get_task_status</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.create_replication_task">create_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.start_replication_task">start_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.stop_replication_task">stop_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.delete_replication_task">delete_replication_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dms.DmsHook.wait_for_task_status">wait_for_task_status</a></li>
</ul>
</li>
</ul>
@@ -807,7 +974,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dms/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
similarity index 87%
copy from docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
index 356f682a14..78dd6af447 100644
--- a/docs-archive/apache-airflow-providers-discord/3.1.0/_api/airflow/providers/discord/operators/discord_webhook/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.html
@@ -9,18 +9,18 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.discord.operators.discord_webhook — apache-airflow-providers-discord Documentation</title>
- <link rel="stylesheet" href="../../../../../../_static/_gen/css/main.min.css" type="text/css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/pygments.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main.min.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/copybutton.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/_gen/css/main-custom.min.css" />
- <link rel="stylesheet" type="text/css" href="../../../../../../_static/graphviz.css" />
- <link rel="shortcut icon" href="../../../../../../_static/pin_32.png"/>
- <link rel="index" title="Index" href="../../../../../../genindex.html" />
- <link rel="search" title="Search" href="../../../../../../search.html" />
- <link rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" />
- <link rel="prev" title="airflow.providers.discord.operators" href="../index.html" />
+ <title>airflow.providers.amazon.aws.hooks.dynamodb — apache-airflow-providers-amazon Documentation</title>
+ <link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/copybutton.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main-custom.min.css" />
+ <link rel="stylesheet" type="text/css" href="../../../../../../../_static/graphviz.css" />
+ <link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
+ <link rel="index" title="Index" href="../../../../../../../genindex.html" />
+ <link rel="search" title="Search" href="../../../../../../../search.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -295,7 +295,7 @@
</div>
<div class="searchb-box">
- <form class="search-form" action="../../../../../../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -325,15 +325,30 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -417,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.1.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -428,7 +443,7 @@
</div>
<div class="searchb-box">
- <form class="search-form" action="../../../../../../search.html" method="get">
+ <form class="search-form" action="../../../../../../../search.html" method="get">
<input class="search-form__input" type="text" name="q" placeholder="Search docs" size="16">
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
@@ -458,15 +473,30 @@
<div class="toctree" role="navigation" aria-label="main navigation">
- <p class="caption" role="heading"><span class="caption-text">References</span></p>
+ <p class="caption" role="heading"><span class="caption-text">Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-discord/">PyPI Repository</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../commits.html">Detailed list of commits</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../commits.html">Detailed list of commits</a></li>
</ul>
</div>
@@ -555,13 +585,15 @@
<ul class="breadcrumb">
- <li class="breadcrumb-item"><a href="../../../../../../index.html" class="icon icon-home"> Home</a></li>
+ <li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
+
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a></li>
</ul>
</div>
@@ -572,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.discord.operators.discord_webhook">
-<span id="airflow-providers-discord-operators-discord-webhook"></span><h1><a class="reference internal" href="#module-airflow.providers.discord.operators.discord_webhook" title="airflow.providers.discord.operators.discord_webhook"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><a class="headerlink" href="#module-airflow.providers.discord.operators.discord_webhook" title="Permalink to this he [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.dynamodb">
+<span id="airflow-providers-amazon-aws-hooks-dynamodb"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="airflow.providers.amazon.aws.hooks.dynamodb"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.dynamodb" title="Permalink to this heading">¶</a></h1>
+<p>This module contains the Amazon DynamoDB Hook</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -584,48 +617,50 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator" title="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a></p></td>
-<td><p>This operator allows you to post messages to Discord using incoming webhooks.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook" title="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DynamoDBHook</span></code></a></p></td>
+<td><p>Interact with Amazon DynamoDB.</p></td>
</tr>
</tbody>
</table>
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.discord.operators.discord_webhook.</span></span><span class="sig-name descname"><span class="pre">DiscordWebhookOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">http_conn_id</span></span><span clas [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/operators/http/index.html#airflow.providers.http.operators.http.SimpleHttpOperator" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.operators.http.SimpleHttpOperator</span></code></a></p>
-<p>This operator allows you to post messages to Discord using incoming webhooks.
-Takes a Discord connection ID with a default relative webhook endpoint. The
-default endpoint can be overridden using the webhook_endpoint parameter
-(<a class="reference external" href="https://discordapp.com/developers/docs/resources/webhook">https://discordapp.com/developers/docs/resources/webhook</a>).</p>
-<p>Each Discord webhook can be pre-configured to use a specific username and
-avatar_url. You can override these defaults in this operator.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb.</span></span><span class="sig-name descname"><span class="pre">DynamoDBHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">ta [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon DynamoDB.
+Provide thick wrapper around
+<a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.ServiceResource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.resource("dynamodb")</span></code></a>.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>http_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Http connection ID with host as “<a class="reference external" href="https://discord.com/api/">https://discord.com/api/</a>” and
-default webhook endpoint in the extra field in the form of
-{“webhook_endpoint”: “webhooks/{webhook.id}/{webhook.token}”}</p></li>
-<li><p><strong>webhook_endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Discord webhook endpoint in the form of
-“webhooks/{webhook.id}/{webhook.token}” (templated)</p></li>
-<li><p><strong>message</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The message you want to send to your Discord channel
-(max 2000 characters). (templated)</p></li>
-<li><p><strong>username</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default username of the webhook. (templated)</p></li>
-<li><p><strong>avatar_url</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Override the default avatar of the webhook</p></li>
-<li><p><strong>tts</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a>) – Is a text-to-speech message</p></li>
-<li><p><strong>proxy</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Proxy to use to make the Discord webhook call</p></li>
+<li><p><strong>table_keys</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – partition key and sort key</p></li>
+<li><p><strong>table_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – target DynamoDB table</p></li>
</ul>
</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
-
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../_modules/airflow/providers/discord/operators/discord_webhook.html#DiscordWebhookOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.disc [...]
-<dd><p>Call the DiscordWebhookHook to post message</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">
+<span class="sig-name descname"><span class="pre">write_batch_data</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">items</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/dynamodb.html#DynamoDBHook.write_batch_data"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Write batch items to DynamoDB table with provisioned throughout capacity.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.ServiceResource.Table" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.ServiceResource.Table()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.Table.batch_writer" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.Table.batch_writer()</span></code></a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb.html#DynamoDB.Table.put_item" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">DynamoDB.Table.put_item()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>items</strong> (<em>Iterable</em>) – list of DynamoDB items.</p>
+</dd>
</dl>
</dd></dl>
@@ -637,10 +672,10 @@ default webhook endpoint in the extra field in the form of
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.discord.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dms" href="../dms/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="Installing from sources" href="../../../../../../installing-providers-from-sources.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -710,17 +745,15 @@ default webhook endpoint in the extra field in the form of
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.discord.operators.discord_webhook</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.dynamodb</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute"><code class="docutils literal notranslate"><span class="pre">DiscordWebhookOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook"><code class="docutils literal notranslate"><span class="pre">DynamoDBHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data"><code class="docutils literal notranslate"><span class="pre">DynamoDBHook.write_batch_data()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator">DiscordWebhookOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.discord.operators.discord_webhook.DiscordWebhookOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook">DynamoDBHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook.write_batch_data">write_batch_data</a></li>
</ul>
</li>
</ul>
@@ -751,7 +784,7 @@ default webhook endpoint in the extra field in the form of
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-discord/_api/airflow/providers/discord/operators/discord_webhook/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/dynamodb/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
@@ -885,19 +918,19 @@ default webhook endpoint in the extra field in the form of
</span>
</div>
</footer>
- <script type="text/javascript" src="../../../../../../_static/_gen/js/docs.js"></script>
- <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../" src="../../../../../../_static/documentation_options.js"></script>
+ <script type="text/javascript" src="../../../../../../../_static/_gen/js/docs.js"></script>
+ <script type="text/javascript" id="documentation_options" data-url_root="../../../../../../../" src="../../../../../../../_static/documentation_options.js"></script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.3/umd/popper.min.js" integrity="sha384-ZMP7rVo3mIykV+2+9J3UJ46jBk0WLaUAdn689aCwoqbBJiSnjAK/l8WvCWPIPm49" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.1.3/js/bootstrap.min.js" integrity="sha384-ChfqqxuZUCnJSK3+MXmPNIyE6ZbWh2IMqE241rYiqJxyMiZ6OW/JmZQ5stwEULTy" crossorigin="anonymous"></script>
- <script data-url_root="../../../../../../" id="documentation_options" src="../../../../../../_static/documentation_options.js"></script>
- <script src="../../../../../../_static/jquery.js"></script>
- <script src="../../../../../../_static/underscore.js"></script>
- <script src="../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
- <script src="../../../../../../_static/doctools.js"></script>
- <script src="../../../../../../_static/sphinx_highlight.js"></script>
- <script src="../../../../../../_static/clipboard.min.js"></script>
- <script src="../../../../../../_static/copybutton.js"></script>
- <script src="../../../../../../_static/js/globaltoc.js"></script>
+ <script data-url_root="../../../../../../../" id="documentation_options" src="../../../../../../../_static/documentation_options.js"></script>
+ <script src="../../../../../../../_static/jquery.js"></script>
+ <script src="../../../../../../../_static/underscore.js"></script>
+ <script src="../../../../../../../_static/_sphinx_javascript_frameworks_compat.js"></script>
+ <script src="../../../../../../../_static/doctools.js"></script>
+ <script src="../../../../../../../_static/sphinx_highlight.js"></script>
+ <script src="../../../../../../../_static/clipboard.min.js"></script>
+ <script src="../../../../../../../_static/copybutton.js"></script>
+ <script src="../../../../../../../_static/js/globaltoc.js"></script>
</body>
</html>
\ No newline at end of file
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
similarity index 76%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
index bbb82cc117..f7109f9395 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ec2/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ec2 — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ec2">
+<span id="airflow-providers-amazon-aws-hooks-ec2"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="airflow.providers.amazon.aws.hooks.ec2"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ec2" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,214 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook" title="airflow.providers.amazon.aws.hooks.ec2.EC2Hook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EC2Hook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Compute Cloud (EC2).</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type" title="airflow.providers.amazon.aws.hooks.ec2.only_client_type"><code class="xref py py-obj docutils literal notranslate"><span class="pre">only_client_type</span></code></a>(func)</p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.only_client_type">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">only_client_type</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">func</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#only_client_type"><span class="viewcode-link"><s [...]
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ec2.</span></span><span class="sig-name descname"><span class="pre">EC2Hook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">api_type</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'resource_type'</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Elastic Compute Cloud (EC2).
+Provide thick wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ec2")</span></code></a>
+or <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.ServiceResource" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.resource("ec2")</span></code></a>.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>api_type</strong> – If set to <code class="docutils literal notranslate"><span class="pre">client_type</span></code> then hook use <code class="docutils literal notranslate"><span class="pre">boto3.client("ec2")</span></code> capabilities,
+If set to <code class="docutils literal notranslate"><span class="pre">resource_type</span></code> then hook use <code class="docutils literal notranslate"><span class="pre">boto3.resource("ec2")</span></code> capabilities.</p>
+</dd>
+</dl>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
<div class="admonition seealso">
<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
</div>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">
+<span class="sig-name descname"><span class="pre">API_TYPES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.API_TYPES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">
+<span class="sig-name descname"><span class="pre">get_instance</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/air [...]
+<dd><p>Get EC2 instance by id and return it.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p></li>
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p></li>
</ul>
</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Instance object</p>
+</dd>
</dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
-<dd></dd></dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">
+<span class="sig-name descname"><span class="pre">stop_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.stop_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws [...]
+<dd><p>Stop instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to stop</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StoppingInstances</cite> and value as list of instances being stopped</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
-<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
-<dd></dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">
+<span class="sig-name descname"><span class="pre">start_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.start_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.a [...]
+<dd><p>Start instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to start</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>StartingInstances</cite> and value as list of instances being started</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
+</dl>
+</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">
+<span class="sig-name descname"><span class="pre">terminate_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.terminate_instances"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers. [...]
+<dd><p>Terminate instances with given ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a>) – List of instance ids to terminate</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Dict with key <cite>TerminatingInstances</cite> and value as list of instances being terminated</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">
+<span class="sig-name descname"><span class="pre">describe_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None [...]
+<dd><p>Describe EC2 instances, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to describe</p></li>
+<li><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of instance IDs to describe</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>Response from EC2 describe_instances API</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">
+<span class="sig-name descname"><span class="pre">get_instances</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">instance_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</spa [...]
+<dd><p>Get list of instance details, optionally applying filters and selective instance ids</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of ids to get instances for</p></li>
+<li><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instances</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a></p>
+</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">
+<span class="sig-name descname"><span class="pre">get_instance_ids</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">filters</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_ids"><span class="view [...]
+<dd><p>Get list of instance ids, optionally applying filters to fetch selective instances</p>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>filters</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em> | </em><em>None</em>) – List of filters to specify instances to get</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>List of instance ids</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">
+<span class="sig-name descname"><span class="pre">get_instance_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ec2.html#EC2Hook.get_instance_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
+<dd><p>Get EC2 instance state by id and return it.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>current state of the instance</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)">str</a></p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">
+<span class="sig-name descname"><span class="pre">wait_for_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">instance_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">target_state</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">check_interval</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/ [...]
+<dd><p>Wait EC2 instance until its state is equal to the target_state.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>instance_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – id of the AWS EC2 instance</p></li>
+<li><p><strong>target_state</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – target state of instance</p></li>
+<li><p><strong>check_interval</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a>) – time in seconds that the job should wait in
+between each instance state checks until operation is completed</p></li>
+</ul>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>None</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p>None</p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +835,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.dynamodb" href="../dynamodb/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +908,36 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ec2</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type"><code class="docutils literal notranslate"><span class="pre">only_client_type()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook"><code class="docutils literal notranslate"><span class="pre">EC2Hook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES"><code class="docutils literal notranslate"><span class="pre">EC2Hook.API_TYPES</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.stop_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.start_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.terminate_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.describe_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instances()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance_ids()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state"><code class="docutils literal notranslate"><span class="pre">EC2Hook.get_instance_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state"><code class="docutils literal notranslate"><span class="pre">EC2Hook.wait_for_state()</span></code></a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.only_client_type">only_client_type</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook">EC2Hook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.API_TYPES">API_TYPES</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance">get_instance</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.stop_instances">stop_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.start_instances">start_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.terminate_instances">terminate_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.describe_instances">describe_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instances">get_instances</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_ids">get_instance_ids</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.get_instance_state">get_instance_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ec2.EC2Hook.wait_for_state">wait_for_state</a></li>
</ul>
</li>
</ul>
@@ -807,7 +968,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ec2/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
similarity index 82%
copy from docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
index bbb82cc117..769312bd5d 100644
--- a/docs-archive/apache-airflow-providers-apache-flink/1.0.0/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecr/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.flink.operators.flink_kubernetes — apache-airflow-providers-apache-flink Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ecr — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" />
- <link rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">1.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-flink/1.0.0/tests/system/providers/apache/flink">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-flink/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a></li>
</ul>
</div>
@@ -588,8 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.flink.operators.flink_kubernetes">
-<span id="airflow-providers-apache-flink-operators-flink-kubernetes"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.flink.operators.flink_kubernetes" title="airflow.providers.apache.flink.operators.flink_kubernetes"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.flink.operators.flink_kubernete [...]
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ecr">
+<span id="airflow-providers-amazon-aws-hooks-ecr"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ecr" title="airflow.providers.amazon.aws.hooks.ecr"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ecr" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -600,80 +616,109 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator" title="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a></p></td>
-<td><p>Creates flinkDeployment object in kubernetes cluster:</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcrCredentials</span></code></a></p></td>
+<td><p>Helper (frozen dataclass) for storing temporary ECR credentials.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook" title="airflow.providers.amazon.aws.hooks.ecr.EcrHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcrHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Container Registry (ECR).</p></td>
</tr>
</tbody>
</table>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes.</span></span><span class="sig-name descname"><span class="pre">FlinkKubernetesOperator</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">application_file</span></span [...]
-<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.models.BaseOperator</span></code></p>
-<p>Creates flinkDeployment object in kubernetes cluster:</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information on how to use this operator, take a look at the guide:
-<a class="reference internal" href="../../../../../../../operators.html#howto-operator-flinkkubernetesoperator"><span class="std std-ref">FlinkKubernetesOperator</span></a></p>
-</div>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more detail about Flink Deployment Object have a look at the reference:
-<a class="reference external" href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment">https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/reference/#flinkdeployment</a></p>
</div>
+<div class="section" id="attributes">
+<h3>Attributes<a class="headerlink" href="#attributes" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger" title="airflow.providers.amazon.aws.hooks.ecr.logger"><code class="xref py py-obj docutils literal notranslate"><span class="pre">logger</span></code></a></p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+<dl class="py data">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.logger">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">logger</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#logger"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecr.logger" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">EcrCredentials</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" hre [...]
+<dd><p>Helper (frozen dataclass) for storing temporary ECR credentials.</p>
+<dl class="py property">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry">
+<em class="property"><span class="pre">property</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">registry</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/ [...]
+<dd><p>Return registry in appropriate <cite>docker login</cite> format.</p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>application_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Defines Kubernetes ‘custom_resource_definition’ of ‘flinkDeployment’ as either a
-path to a ‘.yaml’ file, ‘.json’ file, YAML string or JSON string.</p></li>
-<li><p><strong>namespace</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – kubernetes namespace to put flinkDeployment</p></li>
-<li><p><strong>kubernetes_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The <a class="reference external" href="/docs/apache-airflow-providers-cncf-kubernetes/stable/connections/kubernetes.html#howto-connection-kubernetes" title="(in apache-airflow-providers-cncf-kubernetes v5.1.1)"><span class="xref std std-ref">kubernetes connection id</span></a>
-for the to Kubernetes cluster.</p></li>
-<li><p><strong>api_group</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api group of flinkDeployment</p></li>
-<li><p><strong>api_version</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – kubernetes api version of flinkDeployment</p></li>
-<li><p><strong>in_cluster</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.11)"><em>bool</em></a><em> | </em><em>None</em>) – run kubernetes client with in_cluster configuration.</p></li>
-<li><p><strong>cluster_context</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – context that points to kubernetes cluster.
-Ignored when in_cluster is True. If None, current-context is used.</p></li>
-<li><p><strong>config_file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The path to the Kubernetes config file. (templated)
-If not specified, default value is <code class="docutils literal notranslate"><span class="pre">~/.kube/config</span></code></p></li>
-</ul>
-</dd>
</dl>
+</dd></dl>
+
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">
-<span class="sig-name descname"><span class="pre">template_fields</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username">
+<span class="sig-name descname"><span class="pre">username</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.username"><span class="viewcode-link"><span class [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">
-<span class="sig-name descname"><span class="pre">template_ext</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="pre">Sequence</span><span class="p"><span class="pre">[</span></span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> < [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password">
+<span class="sig-name descname"><span class="pre">password</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.password"><span class="viewcode-link"><span class [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">
-<span class="sig-name descname"><span class="pre">ui_color</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'#f4a460'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.ui_color"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href=" [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint">
+<span class="sig-name descname"><span class="pre">proxy_endpoint</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><span class="pre">str</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.proxy_endpoint"><span class="viewcode-link" [...]
<dd></dd></dl>
-<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">
-<span class="sig-name descname"><span class="pre">hook</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.hook"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook" title="Perma [...]
-<dd><dl class="field-list simple">
-</dl>
-</dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at">
+<span class="sig-name descname"><span class="pre">expires_at</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/datetime.html#datetime.datetime" title="(in Python v3.11)"><span class="pre">datetime.datetime</span></a></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.expires_at"><span c [...]
+<dd></dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">
-<span class="sig-name descname"><span class="pre">client</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.client"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client" title= [...]
-<dd><dl class="field-list simple">
-</dl>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__">
+<span class="sig-name descname"><span class="pre">__post_init__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrCredentials.__post_init__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
</dd></dl>
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.</span></span><span class="sig-name descname"><span class="pre">EcrHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href= [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p>
+<p>Interact with Amazon Elastic Container Registry (ECR).
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecr.html#ECR.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ecr")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">
-<span class="sig-name descname"><span class="pre">execute</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">context</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/flink/operators/flink_kubernetes.html#FlinkKubernetesOperator.execute"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
-<dd><p>This is the main method to derive when creating an operator.
-Context is the same dictionary used as when rendering jinja templates.</p>
-<p>Refer to get_template_context for more context.</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials">
+<span class="sig-name descname"><span class="pre">get_temporary_credentials</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">registry_ids</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecr.html#EcrHook.get_temporary_credent [...]
+<dd><p>Get temporary credentials for Amazon ECR.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecr.html#ECR.Client.get_authorization_token" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECR.Client.get_authorization_token()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>registry_ids</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </ [...]
+with the registries from which credentials are obtained. If you do not specify a registry,
+the default registry is assumed.</p>
+</dd>
+<dt class="field-even">Returns</dt>
+<dd class="field-even"><p>list of <a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr.EcrCredentials</span></code></a>,
+obtained credentials valid for 12 hours.</p>
+</dd>
+<dt class="field-odd">Return type</dt>
+<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)">list</a>[<a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials" title="airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">EcrCredentials</a>]</p>
+</dd>
</dl>
</dd></dl>
@@ -685,10 +730,10 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.flink.operators" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ec2" href="../ec2/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.flink.sensors" href="../../sensors/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -758,25 +803,36 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.flink.operators.flink_kubernetes</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecr</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_fields</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.template_ext</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.ui_color</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.hook()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.client()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute"><code class="docutils literal notranslate"><span class="pre">FlinkKubernetesOperator.execute()</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#attributes">Attributes</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger"><code class="docutils literal notranslate"><span class="pre">logger</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials"><code class="docutils literal notranslate"><span class="pre">EcrCredentials</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.registry</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.username</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.password</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.proxy_endpoint</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.expires_at</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__"><code class="docutils literal notranslate"><span class="pre">EcrCredentials.__post_init__()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook"><code class="docutils literal notranslate"><span class="pre">EcrHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials"><code class="docutils literal notranslate"><span class="pre">EcrHook.get_temporary_credentials()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.logger">logger</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials">EcrCredentials</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.registry">registry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.username">username</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.password">password</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.proxy_endpoint">proxy_endpoint</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.expires_at">expires_at</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrCredentials.__post_init__">__post_init__</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator">FlinkKubernetesOperator</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_fields">template_fields</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.template_ext">template_ext</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.ui_color">ui_color</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.hook">hook</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.client">client</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.flink.operators.flink_kubernetes.FlinkKubernetesOperator.execute">execute</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook">EcrHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecr.EcrHook.get_temporary_credentials">get_temporary_credentials</a></li>
</ul>
</li>
</ul>
@@ -807,7 +863,7 @@ Context is the same dictionary used as when rendering jinja templates.</p>
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-flink/_api/airflow/providers/apache/flink/operators/flink_kubernetes/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ecr/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
similarity index 62%
copy from docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
index 311386562a..5ed9a30ad2 100644
--- a/docs-archive/apache-airflow-providers-apache-livy/3.2.0/_api/airflow/providers/apache/livy/hooks/livy/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/ecs/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.apache.livy.hooks.livy — apache-airflow-providers-apache-livy Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.ecs — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,16 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -425,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.2.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -468,16 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-apache-livy/3.2.0/tests/system/providers/apache/livy/">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-apache-livy/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -573,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a></li>
</ul>
</div>
@@ -588,9 +604,8 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.apache.livy.hooks.livy">
-<span id="airflow-providers-apache-livy-hooks-livy"></span><h1><a class="reference internal" href="#module-airflow.providers.apache.livy.hooks.livy" title="airflow.providers.apache.livy.hooks.livy"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><a class="headerlink" href="#module-airflow.providers.apache.livy.hooks.livy" title="Permalink to this heading">¶</a></h1>
-<p>This module contains the Apache Livy hook.</p>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.ecs">
+<span id="airflow-providers-amazon-aws-hooks-ecs"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="airflow.providers.amazon.aws.hooks.ecs"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.ecs" title="Permalink to this heading">¶</a></h1>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -601,296 +616,340 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState"><code class="xref py py-obj docutils literal notranslate"><span class="pre">BatchState</span></code></a></p></td>
-<td><p>Batch session states</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Cluster.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task Definition.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an ECS Task.</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook" title="airflow.providers.amazon.aws.hooks.ecs.EcsHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Container Service (ECS).</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher" title="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsTaskLogFetcher</span></code></a></p></td>
+<td><p>Fetches Cloudwatch log events with specific interval as a thread</p></td>
+</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol" title="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EcsProtocol</span></code></a></p></td>
+<td><p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on</p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<div class="section" id="functions">
+<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
+<table class="autosummary longtable docutils align-default">
+<colgroup>
+<col style="width: 10%" />
+<col style="width: 90%" />
+</colgroup>
+<tbody>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry" title="airflow.providers.amazon.aws.hooks.ecs.should_retry"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ECS resource quota (CPU, MEM).</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook" title="airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LivyHook</span></code></a></p></td>
-<td><p>Hook for Apache Livy through the REST API.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni" title="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni"><code class="xref py py-obj docutils literal notranslate"><span class="pre">should_retry_eni</span></code></a>(exception)</p></td>
+<td><p>Check if exception is related to ENI (Elastic Network Interfaces).</p></td>
</tr>
</tbody>
</table>
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry"><span class="viewcode-link"><span [...]
+<dd><p>Check if exception is related to ECS resource quota (CPU, MEM).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py function">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">
+<span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">should_retry_eni</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">exception</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#should_retry_eni"><span class="viewcode-lin [...]
+<dd><p>Check if exception is related to ENI (Elastic Network Interfaces).</p>
+<dl class="field-list simple">
+</dl>
+</dd></dl>
+
<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">BatchState</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsClusterStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
-<p>Batch session states</p>
+<p>Contains the possible State values of an ECS Cluster.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">
-<span class="sig-name descname"><span class="pre">NOT_STARTED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'not_started'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.NOT_STARTED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.a [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">
-<span class="sig-name descname"><span class="pre">STARTING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'starting'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.STARTING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.liv [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.prov [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">
-<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'running'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEPROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">
-<span class="sig-name descname"><span class="pre">IDLE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'idle'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.IDLE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">
+<span class="sig-name descname"><span class="pre">FAILED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'FAILED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.FAILED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">
-<span class="sig-name descname"><span class="pre">BUSY</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'busy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.BUSY"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'INACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsClusterStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskDefinitionStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a clas [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task Definition.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">
-<span class="sig-name descname"><span class="pre">SHUTTING_DOWN</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'shutting_down'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SHUTTING_DOWN"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provi [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">
+<span class="sig-name descname"><span class="pre">ACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.ACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazo [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">
-<span class="sig-name descname"><span class="pre">ERROR</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'error'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.ERROR"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">
+<span class="sig-name descname"><span class="pre">INACTIVE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'INACTIVE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskDefinitionStates.INACTIVE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskStates</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href= [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/enum.html#enum.Enum" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">enum.Enum</span></code></a></p>
+<p>Contains the possible State values of an ECS Task.</p>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">
-<span class="sig-name descname"><span class="pre">DEAD</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'dead'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.DEAD"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">
+<span class="sig-name descname"><span class="pre">PROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provide [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">
-<span class="sig-name descname"><span class="pre">KILLED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'killed'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.KILLED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hook [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">
+<span class="sig-name descname"><span class="pre">PENDING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'PENDING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.PENDING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">
-<span class="sig-name descname"><span class="pre">SUCCESS</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'success'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#BatchState.SUCCESS"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">
+<span class="sig-name descname"><span class="pre">ACTIVATING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'ACTIVATING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.ACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.ama [...]
<dd></dd></dl>
-</dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">
+<span class="sig-name descname"><span class="pre">RUNNING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'RUNNING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.RUNNING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
+<dd></dd></dl>
-<dl class="py class">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.apache.livy.hooks.livy.</span></span><span class="sig-name descname"><span class="pre">LivyHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">livy_conn_id</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">default_conn_name< [...]
-<dd><p>Bases: <a class="reference external" href="/docs/apache-airflow-providers-http/stable/_api/airflow/providers/http/hooks/http/index.html#airflow.providers.http.hooks.http.HttpHook" title="(in apache-airflow-providers-http v4.1.1)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.http.hooks.http.HttpHook</span></code></a>, <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.utils.log.logging_mixin.LoggingMi [...]
-<p>Hook for Apache Livy through the REST API.</p>
-<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>livy_conn_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – reference to a pre-defined Livy Connection.</p></li>
-<li><p><strong>extra_options</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of options passed to Livy.</p></li>
-<li><p><strong>extra_headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – A dictionary of headers passed to the HTTP request to livy.</p></li>
-<li><p><strong>auth_type</strong> (<em>Any</em><em> | </em><em>None</em>) – The auth type for the service.</p></li>
-</ul>
-</dd>
-</dl>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more details refer to the Apache Livy API reference:
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">
-<span class="sig-name descname"><span class="pre">TERMINAL_STATES</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.TERMINAL_STATES"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES" title="Permalink to this definition">¶</a></dt>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">
+<span class="sig-name descname"><span class="pre">DEACTIVATING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEACTIVATING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEACTIVATING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provide [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">
-<span class="sig-name descname"><span class="pre">conn_name_attr</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_conn_id'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_name_attr"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.provid [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">
+<span class="sig-name descname"><span class="pre">STOPPING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'STOPPING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aw [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">
-<span class="sig-name descname"><span class="pre">default_conn_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy_default'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.default_conn_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow. [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">
+<span class="sig-name descname"><span class="pre">DEPROVISIONING</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'DEPROVISIONING'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.DEPROVISIONING"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.p [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">
-<span class="sig-name descname"><span class="pre">conn_type</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.conn_type"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.ho [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">
+<span class="sig-name descname"><span class="pre">STOPPED</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'STOPPED'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.STOPPED"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.h [...]
<dd></dd></dl>
<dl class="py attribute">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">
-<span class="sig-name descname"><span class="pre">hook_name</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'Apache</span> <span class="pre">Livy'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.hook_name"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="# [...]
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">
+<span class="sig-name descname"><span class="pre">NONE</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'NONE'</span></em><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskStates.NONE"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs. [...]
<dd></dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsHook</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></s [...]
+<dd><p>Bases: <a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook</span></code></a></p>
+<p>Interact with Amazon Elastic Container Service (ECS).
+Provide thin wrapper around <a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-class docutils literal notranslate"><span class="pre">boto3.client("ecs")</span></code></a>.</p>
+<p>Additional arguments (such as <code class="docutils literal notranslate"><span class="pre">aws_conn_id</span></code>) may be specified and
+are passed down to the underlying AwsBaseHook.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference internal" href="../base_aws/index.html#airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook" title="airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook"><code class="xref py py-class docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook</span></code></a></p></li>
+<li><p><a class="reference external" href="https://docs.aws.amazon.com/AmazonECS/latest/APIReference/Welcome.html">Amazon Elastic Container Service</a></p></li>
+</ul>
+</div>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">
-<span class="sig-name descname"><span class="pre">get_conn</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">headers</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_conn"><span class="viewcode-link"><s [...]
-<dd><p>Returns http session for use with requests</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">
+<span class="sig-name descname"><span class="pre">get_cluster_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster_name</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_cluster_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amaz [...]
+<dd><p>Get ECS Cluster state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_clusters" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_clusters()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – additional headers to be passed through as a dictionary</p>
+<dd class="field-odd"><p><strong>cluster_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – ECS Cluster name or full cluster Amazon Resource Name (ARN) entry.</p>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>requests session</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">
+<span class="sig-name descname"><span class="pre">get_task_definition_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">task_definition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_definition_state"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#air [...]
+<dd><p>Get ECS Task Definition state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_task_definition()</span></code></a></p></li>
+</ul>
+</div>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters</dt>
+<dd class="field-odd"><p><strong>task_definition</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – The family for the latest ACTIVE revision,
+family and revision ( family:revision ) for a specific revision in the family,
+or full Amazon Resource Name (ARN) of the task definition to describe.</p>
</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">
-<span class="sig-name descname"><span class="pre">run_method</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">endpoint</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">method</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">'GET'</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">data</span></span><span class="o"><span class="p [...]
-<dd><p>Wrapper for HttpHook, allows to change method on the same HttpHook</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">
+<span class="sig-name descname"><span class="pre">get_task_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsHook.get_task_state"><span class="viewcode-link"><span class="pre">[source [...]
+<dd><p>Get ECS Task state.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks" title="(in Boto3 Docs v1.26.76)"><code class="xref py py-meth docutils literal notranslate"><span class="pre">ECS.Client.describe_tasks()</span></code></a></p></li>
+</ul>
+</div>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><ul class="simple">
-<li><p><strong>method</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – http method</p></li>
-<li><p><strong>endpoint</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – endpoint</p></li>
-<li><p><strong>data</strong> (<em>Any</em><em> | </em><em>None</em>) – request payload</p></li>
-<li><p><strong>headers</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – headers</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
+<li><p><strong>cluster</strong> – The short name or full Amazon Resource Name (ARN)
+of the cluster that hosts the task or tasks to describe.</p></li>
+<li><p><strong>task</strong> – Task ID or full ARN entry.</p></li>
</ul>
</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>http response</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>Any</p>
-</dd>
</dl>
</dd></dl>
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsTaskLogFetcher</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_group</span></span></em>, <em class="sig-param"><s [...]
+<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/threading.html#threading.Thread" title="(in Python v3.11)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">threading.Thread</span></code></a></p>
+<p>Fetches Cloudwatch log events with specific interval as a thread
+and sends the log events to the info channel of the provided logger.</p>
+<dl class="field-list simple">
+</dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">
-<span class="sig-name descname"><span class="pre">post_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">*</span></span><span class="n"><span class="pre">args</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/li [...]
-<dd><p>Perform request to submit batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">
+<span class="sig-name descname"><span class="pre">run</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.run"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run" title="Permalink to this definition">¶</a></dt>
+<dd><p>Method representing the thread’s activity.</p>
+<p>You may override this method in a subclass. The standard run() method
+invokes the callable object passed to the object’s constructor as the
+target argument, if any, with sequential and keyword arguments taken
+from the args and kwargs arguments, respectively.</p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>batch session id</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)">int</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">
-<span class="sig-name descname"><span class="pre">get_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.get_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.hooks.l [...]
-<dd><p>Fetch info about the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">
+<span class="sig-name descname"><span class="pre">get_last_log_messages</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">number_messages</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_messages"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#a [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">
+<span class="sig-name descname"><span class="pre">get_last_log_message</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.get_last_log_message"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message" title="Permali [...]
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">
+<span class="sig-name descname"><span class="pre">is_stopped</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.is_stopped"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped" title="Permalink to this definition">¶</a></dt>
+<dd><dl class="field-list simple">
+</dl>
+</dd></dl>
+
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">
+<span class="sig-name descname"><span class="pre">stop</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsTaskLogFetcher.stop"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop" title="Permalink to this definition">¶</a></dt>
+<dd></dd></dl>
+
+</dd></dl>
+
+<dl class="py class">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">airflow.providers.amazon.aws.hooks.ecs.</span></span><span class="sig-name descname"><span class="pre">EcsProtocol</span></span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">airflow.typing_compat.Protocol</span></code></p>
+<p>A structured Protocol for <code class="docutils literal notranslate"><span class="pre">boto3.client('ecs')</span></code>. This is used for type hints on
+<code class="xref py py-meth docutils literal notranslate"><span class="pre">EcsOperator.client()</span></code>.</p>
+<div class="admonition seealso">
+<p class="admonition-title">See also</p>
+<ul class="simple">
+<li><p><a class="reference external" href="https://mypy.readthedocs.io/en/latest/protocols.html">https://mypy.readthedocs.io/en/latest/protocols.html</a></p></li>
+<li><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html</a></p></li>
+</ul>
+</div>
+<dl class="py method">
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">
+<span class="sig-name descname"><span class="pre">run_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.run_task"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">
-<span class="sig-name descname"><span class="pre">get_batch_state</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">retry_args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_module [...]
-<dd><p>Fetch the state of the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">
+<span class="sig-name descname"><span class="pre">get_waiter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.get_waiter"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.amazon.aws.hooks.ecs.EcsP [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.get_waiter</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p></li>
-<li><p><strong>retry_args</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Arguments which define the retry behaviour.
-See Tenacity documentation at <a class="reference external" href="https://github.com/jd/tenacity">https://github.com/jd/tenacity</a></p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>batch state</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState" title="airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">
-<span class="sig-name descname"><span class="pre">delete_batch</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.delete_batch"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache.livy.h [...]
-<dd><p>Delete the specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">
+<span class="sig-name descname"><span class="pre">describe_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">tasks</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_tasks"><span class="viewcode-link"><span class="pre">[s [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">
-<span class="sig-name descname"><span class="pre">get_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_start_position</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">log_batch_size</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/provi [...]
-<dd><p>Gets the session logs for a specified batch.
-:param session_id: identifier of the batch sessions
-:param log_start_position: Position from where to pull the logs
-:param log_batch_size: Number of lines to pull in one batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">
+<span class="sig-name descname"><span class="pre">stop_task</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">task</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">reason</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.stop_task</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Returns</dt>
-<dd class="field-odd"><p>response body</p>
-</dd>
-<dt class="field-even">Return type</dt>
-<dd class="field-even"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">
-<span class="sig-name descname"><span class="pre">dump_batch_logs</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session_id</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/apache/livy/hooks/livy.html#LivyHook.dump_batch_logs"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#airflow.providers.apache. [...]
-<dd><p>Dumps the session logs for a specified batch</p>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">
+<span class="sig-name descname"><span class="pre">describe_task_definition</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">taskDefinition</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../../../../../../../_modules/airflow/providers/amazon/aws/hooks/ecs.html#EcsProtocol.describe_task_definition"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#ai [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.describe_task_definition</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><p><strong>session_id</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – identifier of the batch sessions</p>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>response body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p>None</p>
-</dd>
</dl>
</dd></dl>
<dl class="py method">
-<dt class="sig sig-object py" id="airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">
-<em class="property"><span class="pre">static</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">build_post_batch_body</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">file</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">args</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-para [...]
-<dd><p>Build the post batch request body.</p>
-<div class="admonition seealso">
-<p class="admonition-title">See also</p>
-<p>For more information about the format refer to
-<a class="reference external" href="https://livy.apache.org/docs/latest/rest-api.html">https://livy.apache.org/docs/latest/rest-api.html</a></p>
-</div>
+<dt class="sig sig-object py" id="airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">
+<span class="sig-name descname"><span class="pre">list_tasks</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">cluster</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">launchType</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">desiredStatus</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">family</span></span></em><span class="sig-paren">)</span><a class="re [...]
+<dd><p><a class="reference external" href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.list_tasks</a></p>
<dl class="field-list simple">
-<dt class="field-odd">Parameters</dt>
-<dd class="field-odd"><ul class="simple">
-<li><p><strong>file</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a>) – Path of the file containing the application to execute (required).</p></li>
-<li><p><strong>proxy_user</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – User to impersonate when running the job.</p></li>
-<li><p><strong>class_name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Application Java/Spark main class string.</p></li>
-<li><p><strong>args</strong> (<em>Sequence</em><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.11)"><em>float</em></a><em>] </em>< [...]
-<li><p><strong>jars</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – jars to be used in this sessions.</p></li>
-<li><p><strong>py_files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Python files to be used in this session.</p></li>
-<li><p><strong>files</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – files to be used in this session.</p></li>
-<li><p><strong>driver_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use for the driver process string.</p></li>
-<li><p><strong>driver_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of cores to use for the driver process int.</p></li>
-<li><p><strong>executor_memory</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Amount of memory to use per executor process string.</p></li>
-<li><p><strong>executor_cores</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><em>None</em>) – Number of cores to use for each executor int.</p></li>
-<li><p><strong>num_executors</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.11)"><em>int</em></a><em> | </em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – Number of executors to launch for this session int.</p></li>
-<li><p><strong>archives</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.11)"><em>list</em></a><em>[</em><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em>] </em><em>| </em><em>None</em>) – Archives to be used in this session.</p></li>
-<li><p><strong>queue</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of the YARN queue to which submitted string.</p></li>
-<li><p><strong>name</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#str" title="(in Python v3.11)"><em>str</em></a><em> | </em><em>None</em>) – The name of this session string.</p></li>
-<li><p><strong>conf</strong> (<a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)"><em>dict</em></a><em>[</em><em>Any</em><em>, </em><em>Any</em><em>] </em><em>| </em><em>None</em>) – Spark configuration properties.</p></li>
-</ul>
-</dd>
-<dt class="field-even">Returns</dt>
-<dd class="field-even"><p>request body</p>
-</dd>
-<dt class="field-odd">Return type</dt>
-<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/stdtypes.html#dict" title="(in Python v3.11)">dict</a></p>
-</dd>
</dl>
</dd></dl>
@@ -902,10 +961,10 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="pager" role="navigation" aria-label="related navigation">
- <a rel="prev" title="airflow.providers.apache.livy.hooks" href="../index.html" >
+ <a rel="prev" title="airflow.providers.amazon.aws.hooks.ecr" href="../ecr/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="p">Previous</button>
</a>
- <a rel="next" title="airflow.providers.apache.livy.operators" href="../../operators/index.html" >
+ <a rel="next" title="airflow.providers.amazon.aws.hooks.eks" href="../eks/index.html" >
<button class="btn-hollow btn-blue bodytext__medium--cerulean-blue" accesskey="n">Next</button>
</a>
</div>
@@ -975,67 +1034,108 @@ See Tenacity documentation at <a class="reference external" href="https://github
<nav class="wy-nav-side-toc">
<div class="wy-menu-vertical">
<ul>
-<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.apache.livy.hooks.livy</span></code></a><ul>
+<li><a class="reference internal" href="#"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.ecs</span></code></a><ul>
<li><a class="reference internal" href="#module-contents">Module Contents</a><ul>
-<li><a class="reference internal" href="#classes">Classes</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState"><code class="docutils literal notranslate"><span class="pre">BatchState</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED"><code class="docutils literal notranslate"><span class="pre">BatchState.NOT_STARTED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING"><code class="docutils literal notranslate"><span class="pre">BatchState.STARTING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING"><code class="docutils literal notranslate"><span class="pre">BatchState.RUNNING</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE"><code class="docutils literal notranslate"><span class="pre">BatchState.IDLE</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY"><code class="docutils literal notranslate"><span class="pre">BatchState.BUSY</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN"><code class="docutils literal notranslate"><span class="pre">BatchState.SHUTTING_DOWN</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR"><code class="docutils literal notranslate"><span class="pre">BatchState.ERROR</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD"><code class="docutils literal notranslate"><span class="pre">BatchState.DEAD</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED"><code class="docutils literal notranslate"><span class="pre">BatchState.KILLED</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS"><code class="docutils literal notranslate"><span class="pre">BatchState.SUCCESS</span></code></a></li>
+<li><a class="reference internal" href="#classes">Classes</a></li>
+<li><a class="reference internal" href="#functions">Functions</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry"><code class="docutils literal notranslate"><span class="pre">should_retry()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni"><code class="docutils literal notranslate"><span class="pre">should_retry_eni()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.ACTIVE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.PROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.DEPROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.FAILED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsClusterStates.INACTIVE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates.ACTIVE</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE"><code class="docutils literal notranslate"><span class="pre">EcsTaskDefinitionStates.INACTIVE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.PROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.PENDING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.ACTIVATING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.RUNNING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.DEACTIVATING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.STOPPING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.DEPROVISIONING</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.STOPPED</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE"><code class="docutils literal notranslate"><span class="pre">EcsTaskStates.NONE</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook"><code class="docutils literal notranslate"><span class="pre">EcsHook</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_cluster_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_task_definition_state()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state"><code class="docutils literal notranslate"><span class="pre">EcsHook.get_task_state()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.run()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.get_last_log_messages()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.get_last_log_message()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.is_stopped()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop"><code class="docutils literal notranslate"><span class="pre">EcsTaskLogFetcher.stop()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol"><code class="docutils literal notranslate"><span class="pre">EcsProtocol</span></code></a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.run_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.get_waiter()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.describe_tasks()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.stop_task()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.describe_task_definition()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks"><code class="docutils literal notranslate"><span class="pre">EcsProtocol.list_tasks()</span></code></a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry">should_retry</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.should_retry_eni">should_retry_eni</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates">EcsClusterStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.FAILED">FAILED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsClusterStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates">EcsTaskDefinitionStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.ACTIVE">ACTIVE</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskDefinitionStates.INACTIVE">INACTIVE</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates">EcsTaskStates</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PROVISIONING">PROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.PENDING">PENDING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.ACTIVATING">ACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.RUNNING">RUNNING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEACTIVATING">DEACTIVATING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPING">STOPPING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.DEPROVISIONING">DEPROVISIONING</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.STOPPED">STOPPED</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskStates.NONE">NONE</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook"><code class="docutils literal notranslate"><span class="pre">LivyHook</span></code></a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES"><code class="docutils literal notranslate"><span class="pre">LivyHook.TERMINAL_STATES</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_name_attr</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.default_conn_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type"><code class="docutils literal notranslate"><span class="pre">LivyHook.conn_type</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name"><code class="docutils literal notranslate"><span class="pre">LivyHook.hook_name</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_conn()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method"><code class="docutils literal notranslate"><span class="pre">LivyHook.run_method()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.post_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_state()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch"><code class="docutils literal notranslate"><span class="pre">LivyHook.delete_batch()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.get_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs"><code class="docutils literal notranslate"><span class="pre">LivyHook.dump_batch_logs()</span></code></a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body"><code class="docutils literal notranslate"><span class="pre">LivyHook.build_post_batch_body()</span></code></a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook">EcsHook</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_cluster_state">get_cluster_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_definition_state">get_task_definition_state</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsHook.get_task_state">get_task_state</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState">BatchState</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.NOT_STARTED">NOT_STARTED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.STARTING">STARTING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.RUNNING">RUNNING</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.IDLE">IDLE</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.BUSY">BUSY</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SHUTTING_DOWN">SHUTTING_DOWN</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.ERROR">ERROR</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.DEAD">DEAD</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.KILLED">KILLED</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.BatchState.SUCCESS">SUCCESS</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher">EcsTaskLogFetcher</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.run">run</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_messages">get_last_log_messages</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.get_last_log_message">get_last_log_message</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.is_stopped">is_stopped</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsTaskLogFetcher.stop">stop</a></li>
</ul>
</li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook">LivyHook</a><ul>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.TERMINAL_STATES">TERMINAL_STATES</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_name_attr">conn_name_attr</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.default_conn_name">default_conn_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.conn_type">conn_type</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.hook_name">hook_name</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_conn">get_conn</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.run_method">run_method</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.post_batch">post_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch">get_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_state">get_batch_state</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.delete_batch">delete_batch</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.get_batch_logs">get_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.dump_batch_logs">dump_batch_logs</a></li>
-<li><a class="reference internal" href="#airflow.providers.apache.livy.hooks.livy.LivyHook.build_post_batch_body">build_post_batch_body</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol">EcsProtocol</a><ul>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.run_task">run_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.get_waiter">get_waiter</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_tasks">describe_tasks</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.stop_task">stop_task</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.describe_task_definition">describe_task_definition</a></li>
+<li><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.ecs.EcsProtocol.list_tasks">list_tasks</a></li>
</ul>
</li>
</ul>
@@ -1066,7 +1166,7 @@ See Tenacity documentation at <a class="reference external" href="https://github
<div class="base-layout--button">
- <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-apache-livy/_api/airflow/providers/apache/livy/hooks/livy/index.rst" rel="nofollow">
+ <a href="https://github.com/apache/airflow/edit/main/docs/apache-airflow-providers-amazon/_api/airflow/providers/amazon/aws/hooks/ecs/index.rst" rel="nofollow">
<button class="btn-hollow btn-brown btn-with-icon with-box-shadow button-fixed">
<svg xmlns="http://www.w3.org/2000/svg" width="30.76" height="30">
diff --git a/docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
similarity index 55%
copy from docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html
copy to docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
index 76f76aaa70..57ab80c562 100644
--- a/docs-archive/apache-airflow-providers-dbt-cloud/3.0.0/_api/airflow/providers/dbt/cloud/hooks/dbt/index.html
+++ b/docs-archive/apache-airflow-providers-amazon/7.2.1/_api/airflow/providers/amazon/aws/hooks/eks/index.html
@@ -9,7 +9,7 @@
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>airflow.providers.dbt.cloud.hooks.dbt — apache-airflow-providers-dbt-cloud Documentation</title>
+ <title>airflow.providers.amazon.aws.hooks.eks — apache-airflow-providers-amazon Documentation</title>
<link rel="stylesheet" href="../../../../../../../_static/_gen/css/main.min.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/pygments.css" />
<link rel="stylesheet" type="text/css" href="../../../../../../../_static/_gen/css/main.min.css" />
@@ -19,8 +19,8 @@
<link rel="shortcut icon" href="../../../../../../../_static/pin_32.png"/>
<link rel="index" title="Index" href="../../../../../../../genindex.html" />
<link rel="search" title="Search" href="../../../../../../../search.html" />
- <link rel="next" title="airflow.providers.dbt.cloud.operators" href="../../operators/index.html" />
- <link rel="prev" title="airflow.providers.dbt.cloud.hooks" href="../index.html" />
+ <link rel="next" title="airflow.providers.amazon.aws.hooks.elasticache_replication_group" href="../elasticache_replication_group/index.html" />
+ <link rel="prev" title="airflow.providers.amazon.aws.hooks.ecs" href="../ecs/index.html" />
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
@@ -284,7 +284,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -327,17 +327,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections.html">Connecting to dbt Cloud</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-dbt-cloud/3.0.0/tests/system/providers/dbt/cloud/example_dbt_cloud.py">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-dbt-cloud/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -426,7 +432,7 @@
<div id="docs-version-selector" class="docs-version-selector sidebar__version-selector">
<a class="dropdown-toggle" href="#" id="versionDropdown" role="button" data-toggle="dropdown" aria-haspopup="true"
aria-expanded="false">
- <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">3.0.0</span>
+ <span class="bodytext__medium--greyish-brown">Version: </span><span class="version">7.2.1</span>
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
@@ -469,17 +475,23 @@
<div class="toctree" role="navigation" aria-label="main navigation">
<p class="caption" role="heading"><span class="caption-text">Guides</span></p>
<ul>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections.html">Connecting to dbt Cloud</a></li>
-<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../connections/index.html">Connection types</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../operators/index.html">Operators</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../secrets-backends/index.html">Secrets backends</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../logging/index.html">Logging for Tasks</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">References</span></p>
<ul class="current">
-<li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Python API</a></li>
+<li class="toctree-l1 current"><a class="reference internal" href="../../../index.html">Python API</a></li>
+</ul>
+<p class="caption" role="heading"><span class="caption-text">System tests</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference external" href="https://aws-mwaa.github.io/open-source/system-tests/dashboard.html">System Tests Dashboard</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Resources</span></p>
<ul>
-<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/airflow/tree/providers-dbt-cloud/3.0.0/tests/system/providers/dbt/cloud/example_dbt_cloud.py">Example DAGs</a></li>
-<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-dbt-cloud/">PyPI Repository</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../../../../../../../example-dags.html">Example DAGs</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://pypi.org/project/apache-airflow-providers-amazon/">PyPI Repository</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../../../../../../installing-providers-from-sources.html">Installing from sources</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Commits</span></p>
@@ -575,11 +587,13 @@
<li class="breadcrumb-item"><a href="../../../../../../../index.html" class="icon icon-home"> Home</a></li>
- <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon</span></code></a></li>
+
+ <li class="breadcrumb-item"><a href="../../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws</span></code></a></li>
- <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks</span></code></a></li>
+ <li class="breadcrumb-item"><a href="../index.html"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks</span></code></a></li>
- <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks.dbt</span></code></a></li>
+ <li class="breadcrumb-item"><a href="index.html"> <code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a></li>
</ul>
</div>
@@ -590,8 +604,9 @@
<div class="bodywrapper">
<div class="body" role="main">
- <div class="section" id="module-airflow.providers.dbt.cloud.hooks.dbt">
-<span id="airflow-providers-dbt-cloud-hooks-dbt"></span><h1><a class="reference internal" href="#module-airflow.providers.dbt.cloud.hooks.dbt" title="airflow.providers.dbt.cloud.hooks.dbt"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.dbt.cloud.hooks.dbt</span></code></a><a class="headerlink" href="#module-airflow.providers.dbt.cloud.hooks.dbt" title="Permalink to this heading">¶</a></h1>
+ <div class="section" id="module-airflow.providers.amazon.aws.hooks.eks">
+<span id="airflow-providers-amazon-aws-hooks-eks"></span><h1><a class="reference internal" href="#module-airflow.providers.amazon.aws.hooks.eks" title="airflow.providers.amazon.aws.hooks.eks"><code class="xref py py-mod docutils literal notranslate"><span class="pre">airflow.providers.amazon.aws.hooks.eks</span></code></a><a class="headerlink" href="#module-airflow.providers.amazon.aws.hooks.eks" title="Permalink to this heading">¶</a></h1>
+<p>Interact with Amazon EKS, using the boto3 library.</p>
<div class="section" id="module-contents">
<h2>Module Contents<a class="headerlink" href="#module-contents" title="Permalink to this heading">¶</a></h2>
<div class="section" id="classes">
@@ -602,34 +617,17 @@
<col style="width: 90%" />
</colgroup>
<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.TokenAuth" title="airflow.providers.dbt.cloud.hooks.dbt.TokenAuth"><code class="xref py py-obj docutils literal notranslate"><span class="pre">TokenAuth</span></code></a></p></td>
-<td><p>Helper class for Auth when executing requests.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.ClusterStates" title="airflow.providers.amazon.aws.hooks.eks.ClusterStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">ClusterStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Cluster.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.JobRunInfo" title="airflow.providers.dbt.cloud.hooks.dbt.JobRunInfo"><code class="xref py py-obj docutils literal notranslate"><span class="pre">JobRunInfo</span></code></a></p></td>
-<td><p>Type class for the <code class="docutils literal notranslate"><span class="pre">job_run_info</span></code> dictionary.</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.FargateProfileStates" title="airflow.providers.amazon.aws.hooks.eks.FargateProfileStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">FargateProfileStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an AWS Fargate profile.</p></td>
</tr>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.DbtCloudJobRunStatus" title="airflow.providers.dbt.cloud.hooks.dbt.DbtCloudJobRunStatus"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DbtCloudJobRunStatus</span></code></a></p></td>
-<td><p>dbt Cloud Job statuses.</p></td>
+<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.NodegroupStates" title="airflow.providers.amazon.aws.hooks.eks.NodegroupStates"><code class="xref py py-obj docutils literal notranslate"><span class="pre">NodegroupStates</span></code></a></p></td>
+<td><p>Contains the possible State values of an EKS Managed Nodegroup.</p></td>
</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.DbtCloudHook" title="airflow.providers.dbt.cloud.hooks.dbt.DbtCloudHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DbtCloudHook</span></code></a></p></td>
-<td><p>Interact with dbt Cloud using the V2 API.</p></td>
-</tr>
-</tbody>
-</table>
-</div>
-<div class="section" id="functions">
-<h3>Functions<a class="headerlink" href="#functions" title="Permalink to this heading">¶</a></h3>
-<table class="autosummary longtable docutils align-default">
-<colgroup>
-<col style="width: 10%" />
-<col style="width: 90%" />
-</colgroup>
-<tbody>
-<tr class="row-odd"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.fallback_to_default_account" title="airflow.providers.dbt.cloud.hooks.dbt.fallback_to_default_account"><code class="xref py py-obj docutils literal notranslate"><span class="pre">fallback_to_default_account</span></code></a>(func)</p></td>
-<td><p>Decorator which provides a fallback value for <code class="docutils literal notranslate"><span class="pre">account_id</span></code>. If the <code class="docutils literal notranslate"><span class="pre">account_id</span></code> is None or not passed</p></td>
-</tr>
-<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.dbt.cloud.hooks.dbt.provide_account_id" title="airflow.providers.dbt.cloud.hooks.dbt.provide_account_id"><code class="xref py py-obj docutils literal notranslate"><span class="pre">provide_account_id</span></code></a>(func)</p></td>
-<td><p>Decorator which provides a fallback value for <code class="docutils literal notranslate"><span class="pre">account_id</span></code>. If the <code class="docutils literal notranslate"><span class="pre">account_id</span></code> is None or not passed</p></td>
+<tr class="row-even"><td><p><a class="reference internal" href="#airflow.providers.amazon.aws.hooks.eks.EksHook" title="airflow.providers.amazon.aws.hooks.eks.EksHook"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EksHook</span></code></a></p></td>
+<td><p>Interact with Amazon Elastic Kubernetes Service (EKS).</p></td>
</tr>
</tbody>
</table>
@@ -642,546 +640,581 @@
<col style="width: 90%" />
... 1239113 lines suppressed ...