You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by ke...@apache.org on 2025/12/24 18:02:30 UTC
(iceberg) branch main updated: [doc] Add highlight note for Hadoop S3A FileSystem (#14913)
This is an automated email from the ASF dual-hosted git repository.
kevinjqliu pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/iceberg.git
The following commit(s) were added to refs/heads/main by this push:
new 0651b8913d [doc] Add highlight note for Hadoop S3A FileSystem (#14913)
0651b8913d is described below
commit 0651b8913d27c3b1c9aca4a9609bec521905fb36
Author: nhuantho <91...@users.noreply.github.com>
AuthorDate: Thu Dec 25 01:02:23 2025 +0700
[doc] Add highlight note for Hadoop S3A FileSystem (#14913)
---------
Co-authored-by: nhuan.bc <nh...@teko.vn>
---
docs/docs/aws.md | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/docs/docs/aws.md b/docs/docs/aws.md
index c306d5493a..9c979b9da8 100644
--- a/docs/docs/aws.md
+++ b/docs/docs/aws.md
@@ -416,9 +416,11 @@ There is no redundant consistency wait and check which might negatively impact p
### Hadoop S3A FileSystem
+!!! important
+ **S3FileIO is recommended** for S3 use cases rather than the `S3A FileSystem` (`HadoopFileIO`).
+
Before `S3FileIO` was introduced, many Iceberg users choose to use `HadoopFileIO` to write data to S3 through the [S3A FileSystem](https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java).
-As introduced in the previous sections, `S3FileIO` adopts the latest AWS clients and S3 features for optimized security and performance
- and is thus recommended for S3 use cases rather than the S3A FileSystem.
+As introduced in the previous sections, `S3FileIO` adopts the latest AWS clients and S3 features for optimized security and performance.
`S3FileIO` writes data with `s3://` URI scheme, but it is also compatible with schemes written by the S3A FileSystem.
This means for any table manifests containing `s3a://` or `s3n://` file paths, `S3FileIO` is still able to read them.