You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Revathi Vijay (Jira)" <ji...@apache.org> on 2025/06/17 16:44:00 UTC

[jira] [Created] (HADOOP-19588) Add support for S3express in S3A

Revathi Vijay created HADOOP-19588:
--------------------------------------

             Summary: Add support for S3express in S3A
                 Key: HADOOP-19588
                 URL: https://issues.apache.org/jira/browse/HADOOP-19588
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/s3
    Affects Versions: 3.4.1, 3.4.0
            Reporter: Revathi Vijay
             Fix For: 3.4.1, 3.4.0


Currently, the endpoint for using S3 accesspoint is resolved for S3 and S3 on outposts: https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/ArnResource.java#L29-L30

However, for s3express, the endpoint is "s3express-<zoneId>.<region>.amazonaws.com".
This ticket adds support for s3express endpoint.

Additionally, for access objects using s3express in the `S3AFileSystem`, we need to parse the access point ARN for an S3express access point into the access point name, since ARNs aren't supported on S3express other than in IAM policies. (https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-points-directory-buckets-restrictions-limitations-naming-rules.html). This ticket also addresses this change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org