[GitHub] [iceberg] jackye1995 edited a comment on issue #3546: Support for S3FileIO in hadoop catalog

[GitBox <gi...@apache.org>]

jackye1995 edited a comment on issue #3546:
URL: https://github.com/apache/iceberg/issues/3546#issuecomment-968586593


   Hadoop catalog uses the `warehouse/db/table` path pattern to figure out what are the databases and tables in the catalog. This is the internal implementation detail of the Hadoop catalog. This is equivalent to Hive using Hive metastore to store such information.
   
   The object storage mode defines how new data files are stored in Iceberg, this is the same feature across all catalogs.
   
   By the way, another issue with using Hadoop catalog with S3 is that S3 does not support atomic file write, but Hadoop catalog relies on the atomic write of a table version hint file to ensure transaction. So it is definitely not recommended for production usage.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org