[GitHub] [airflow] josh-fell opened a new pull request, #29565: Handle deleting more than 256 blobs using `WasbHook.delete_file()`

["josh-fell (via GitHub)" <gi...@apache.org>]

josh-fell opened a new pull request, #29565:
URL: https://github.com/apache/airflow/pull/29565

   Currently users cannot delete more than 256 blobs in a single `WasbHook.delete_file()` call per limits of the [`ContainerClient.delete_blobs()` API](https://learn.microsoft.com/en-us/python/api/azure-storage-blob/azure.storage.blob.containerclient?view=azure-python#azure-storage-blob-containerclient-delete-blobs). This PR introduces batching of these delete requests such that the maximum number of blobs to delete is 256 while users only need to call `WasbHook.delete_file()` only once (this is also applicable for the WasbDeleteBlobOperator).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] josh-fell merged pull request #29565: Handle deleting more than 256 blobs using `WasbHook.delete_file()`

["josh-fell (via GitHub)" <gi...@apache.org>]

josh-fell merged PR #29565:
URL: https://github.com/apache/airflow/pull/29565


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org