[GitHub] mccheah commented on issue #16: Custom metadata in data files

[GitBox <gi...@apache.org>]

mccheah commented on issue #16: Custom metadata in data files
URL: https://github.com/apache/incubator-iceberg/issues/16#issuecomment-442171391
 
 
   We're planning to use Iceberg as an ephemeral table storage format so that we can take advantage of Iceberg's Data Source V2 implementation to read Parquet files. However, we intend to customize the way files are read and written that is specific to our representation of data (see https://github.com/apache/incubator-iceberg/issues/12). In such a case we need multiple metadata fields that we know will only make sense in our use case and no one else's, really - they're specific to our data platform.
   
   There are also some examples of metadata tags in the issue description.
   
   `Map<String, String>` is effectively a JSON Blob as it is, right? It's more strongly typed than just `String`. I'd prefer biasing more towards strongly typed schemas than the more loosely typed `String`.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services