You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "Omega359 (via GitHub)" <gi...@apache.org> on 2025/03/20 21:55:57 UTC
[I] Object store failing during bulk delete in S3 [arrow-rs-object-store]
Omega359 opened a new issue, #277:
URL: https://github.com/apache/arrow-rs-object-store/issues/277
**Describe the bug**
<!--
A clear and concise description of what the bug is.
-->
This started recently and I'm uncertain as to the cause. I have a rather large S3 directory (10TB) that I delete using the following code:
```
let object_store_s3_path = &object_store::path::Path::from(s3_path);
let stream = object_store.list(Some(object_store_s3_path)).map_ok(|m| m.location).boxed();
object_store.delete_stream(stream).try_collect::<Vec<Path>>().await?;
````
The error I started receiving this weekend is:
```
Got invalid DeleteObjects response: unknown variant `Code`, expected `Deleted` or `Error`
Caused by:
0: Got invalid DeleteObjects response: unknown variant `Code`, expected `Deleted` or `Error`
1: unknown variant `Code`, expected `Deleted` or `Error`
```
Using version 0.11.0.
Deleting the directory via other tooling works as expected.
**To Reproduce**
<!--
Steps to reproduce the behavior:
-->
For me just attempting to delete a large directory seems to trigger it.
**Expected behavior**
<!--
A clear and concise description of what you expected to happen.
-->
**Additional context**
<!--
Add any other context about the problem here.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org