You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "leiysky (via GitHub)" <gi...@apache.org> on 2025/04/15 16:08:29 UTC
[I] bug: `Operator::remove_all` conflict with huaweicloud OBS when using s3-service [opendal]
leiysky opened a new issue, #6032:
URL: https://github.com/apache/opendal/issues/6032
### Describe the bug
Huaweicloud OBS has concept of directory, which isn't part of S3 protocol.
This difference brings some issues when performing recursive deletion.
For example, if we are trying to invoke `Operator::remove_all` on a prefix, it will try to `stat` the prefix first. OBS will return a directory object which cannot be deleted(will cause `DirectoryNotEmpty` error) if there is still objects in the directory.
### Steps to Reproduce
```rs
op.write_with("/path/to/obj", payload).await.unwrap();
op.remove_all("/").await.unwrap(); // this will return error
```
### Expected Behavior
No error.
### Additional Context
_No response_
### Are you willing to submit a PR to fix this bug?
- [ ] Yes, I would like to submit a PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support `Operator::remove_all` in huaweicloud OBS Parallel File System [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #6032:
URL: https://github.com/apache/opendal/issues/6032#issuecomment-2808182806
I remove the `bug` tag from this issue since it's more a new feature to support.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] bug: `Operator::remove_all` conflict with huaweicloud OBS when using s3-service [opendal]
Posted by "tisonkun (via GitHub)" <gi...@apache.org>.
tisonkun commented on issue #6032:
URL: https://github.com/apache/opendal/issues/6032#issuecomment-2807729499
What happens if you use [`Obs`](https://docs.rs/opendal/*/opendal/services/struct.Obs.html) service instead?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] bug: `Operator::remove_all` conflict with huaweicloud OBS when using s3-service [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #6032:
URL: https://github.com/apache/opendal/issues/6032#issuecomment-2808175278
OpenDAL now relies on `list_with_recursive` to perform `remove_all`. If storage services support `list_with_recursive`, we treat them as flat storage services, where `/path/` is considered a flat key rather than a directory, allowing it to be safely removed. If not, as with `fs`, we list directories one by one and ensure the directory is removed at the end.
However, in `obs` case, it applies `dir` concepts at the level of list recursion. This can happen if users create an obs bucket with `x-obs-fs-file-interface: Enabled` which they called it [`Parallel File System`](https://support.huaweicloud.com/productdesc-obs/obs_03_0150.html)

I think we need some special handling or even a new service for it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org