[GitHub] [iceberg] szehon-ho commented on pull request #5516: API: Add Generate Symlink Manifest API

[GitBox <gi...@apache.org>]

szehon-ho commented on PR #5516:
URL: https://github.com/apache/iceberg/pull/5516#issuecomment-1216068428

   While there are definitely caveats like renaming column name case and presence of V2 delete files that we should warn about, I also agree with @jackye1995 , generate SymlinkManifest seems quite useful, we have seen some asks for interop of data in iceberg table to non-Iceberg systems (in house file-based tools for instance).   
   
   https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/SymlinkTextInputFormat.java seems a pretty standard way to provide file listing, and both generating/reading seems supported in a variety of data warehouse systems.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org