You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "fangbo (via GitHub)" <gi...@apache.org> on 2025/09/01 07:54:07 UTC
[I] bug: exception when visit volcano TOS using S3 protocol [opendal]
fangbo opened a new issue, #6549:
URL: https://github.com/apache/opendal/issues/6549
### Describe the bug
TOS is volcano engine's object storage service. See https://www.volcengine.com/docs/6349/74820
TOS also provides S3 protocol to visit a bucket.
As using the code to visit TOS, some exception is thrown
```
String scheme = "s3";
Map<String, String> config = new HashMap<>();
config.put("access_key_id", "xx");
config.put("secret_access_key", "xx");
config.put("region", "cn-beijing");
config.put("endpoint", "https://fangbobj.tos-s3-cn-beijing.volces.com");
config.put("virtual_hosted_style_request", "true");
config.put("bucket", "fangbobj");
config.put("root", "lance_db");
Operator operator = Operator.of(scheme, config);
operator.list("/");
```
The exception is:
```
Exception in thread "main" org.apache.opendal.OpenDALException: PermissionDenied (permanent) at list => S3Error { code: "InvalidPathAccess", message: "Forbidden path to access server.", resource: "", request_id: "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1" }
Context:
uri: https://tos-s3-cn-beijing.volces.com/fangbobj?delimiter=%2F&list-type=2&prefix=lance_db%2F
response: Parts { status: 403, version: HTTP/1.1, headers: {"content-type": "application/xml", "date": "Mon, 01 Sep 2025 07:50:35 GMT", "server": "TosServer", "x-amz-ec": "0003-00000002", "x-amz-id-2": "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1", "x-amz-request-id": "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1", "x-amz-server-time": "10", "content-length": "309"} }
service: s3
path: /
listed: 0
at org.apache.opendal.Operator.list(Native Method)
at org.apache.opendal.Operator.list(Operator.java:147)
at org.apache.opendal.Operator.list(Operator.java:143)
```
### Steps to Reproduce
```
String scheme = "s3";
Map<String, String> config = new HashMap<>();
config.put("access_key_id", "xx");
config.put("secret_access_key", "xx");
config.put("region", "cn-beijing");
config.put("endpoint", "https://fangbobj.tos-s3-cn-beijing.volces.com");
config.put("virtual_hosted_style_request", "true");
config.put("bucket", "fangbobj");
config.put("root", "lance_db");
Operator operator = Operator.of(scheme, config);
operator.list("/");
```
### Expected Behavior
Exception is thrown:
```
Exception in thread "main" org.apache.opendal.OpenDALException: PermissionDenied (permanent) at list => S3Error { code: "InvalidPathAccess", message: "Forbidden path to access server.", resource: "", request_id: "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1" }
Context:
uri: https://tos-s3-cn-beijing.volces.com/fangbobj?delimiter=%2F&list-type=2&prefix=lance_db%2F
response: Parts { status: 403, version: HTTP/1.1, headers: {"content-type": "application/xml", "date": "Mon, 01 Sep 2025 07:50:35 GMT", "server": "TosServer", "x-amz-ec": "0003-00000002", "x-amz-id-2": "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1", "x-amz-request-id": "f3ab01b5504b53aa68b5504b-ac14d324-1uszJD-LB-cb-1AZ-F-LFRZ-B-K2-1", "x-amz-server-time": "10", "content-length": "309"} }
service: s3
path: /
listed: 0
at org.apache.opendal.Operator.list(Native Method)
at org.apache.opendal.Operator.list(Operator.java:147)
at org.apache.opendal.Operator.list(Operator.java:143)
at Main.main(Main.java:21)
Process finished with exit code 1
```
### Additional Context
_No response_
### Are you willing to submit a PR to fix this bug?
- [ ] Yes, I would like to submit a PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] bug: exception when visit volcano TOS using S3 protocol [opendal]
Posted by "fangbo (via GitHub)" <gi...@apache.org>.
fangbo closed issue #6549: bug: exception when visit volcano TOS using S3 protocol
URL: https://github.com/apache/opendal/issues/6549
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] bug: exception when visit volcano TOS using S3 protocol [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #6549:
URL: https://github.com/apache/opendal/issues/6549#issuecomment-3241303477
Please use `enable_virtual_host_style` for setting virtual host style, the `virtual_hosted_style_request ` support will be added in next release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org