[GitHub] [iceberg] Fokko commented on issue #7979: Pyiceberg StaticTable use the last metadata json URL when the full path is not provided

["Fokko (via GitHub)" <gi...@apache.org>]

Fokko commented on issue #7979:
URL: https://github.com/apache/iceberg/issues/7979#issuecomment-1619644532

   Thanks for raising this, I can see how this is confusing. How the table is written? Ideally, this information comes from a catalog. When using the HDFS, there is a `version-hint.txt` that could be used, but this is [optional](https://github.com/apache/iceberg/issues/1496).
   
   Some context. By design, Iceberg forbids list operations on the filesystem. This is because Iceberg is object-store-oriented, and list operations are expensive. S3 and GCS don't have a notion of a directory, and if you do a list, it might return a lot of files (which will be fetched paged, so this will result in many requests).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org