(airflow) branch main updated: Bedrock system test adjustment (#40032)

[fe...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

ferruzzi pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 8a32b940ce Bedrock system test adjustment (#40032)
8a32b940ce is described below

commit 8a32b940ce1151ea0b973b0130428a4834b519c1
Author: D. Ferruzzi <fe...@amazon.com>
AuthorDate: Mon Jun 3 14:53:05 2024 -0700

    Bedrock system test adjustment (#40032)
---
 .../providers/amazon/aws/example_bedrock_retrieve_and_generate.py    | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/tests/system/providers/amazon/aws/example_bedrock_retrieve_and_generate.py b/tests/system/providers/amazon/aws/example_bedrock_retrieve_and_generate.py
index c544cee7f8..fcebc8c40a 100644
--- a/tests/system/providers/amazon/aws/example_bedrock_retrieve_and_generate.py
+++ b/tests/system/providers/amazon/aws/example_bedrock_retrieve_and_generate.py
@@ -511,6 +511,11 @@ with DAG(
     )
     # [END howto_operator_bedrock_create_data_source]
 
+    # In this demo, delete_data_source and delete_cluster are both trying to delete
+    # the data from the S3 bucket and occasionally hitting a conflict.  This ensures that
+    # delete_data_source doesn't attempt to delete the files, leaving that duty to delete_bucket.
+    create_data_source.create_data_source_kwargs["dataDeletionPolicy"] = "RETAIN"
+
     # [START howto_operator_bedrock_ingest_data]
     ingest_data = BedrockIngestDataOperator(
         task_id="ingest_data",