You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2019/09/24 02:49:00 UTC
[GitHub] [incubator-iceberg] ppadma commented on issue #491: Use relative
path for manifest_path and file_path
ppadma commented on issue #491: Use relative path for manifest_path and file_path
URL: https://github.com/apache/incubator-iceberg/pull/491#issuecomment-534365040
Using relative path by default will make it restrictive with the expectation that the table data has to necessarily follow a hierarchical directory structure starting from base table location. One of the use cases that iceberg works great with is having table data in different locations. As long as we specify the full path, we can create a table with data in multiple locations.
The problem that this PR is trying to address is when we want to migrate table from one location to another location, we have to rebuild the metadata to update manifest and data file locations. I am wondering if there is a better way to address this issue instead of using relative paths. Also, we could make using relative paths optional and specify during table creation or have base path per manifest i.e. each manifest will have a base path and data files in the manifest will be relative to that.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org