[GitHub] [iceberg] rdblue commented on issue #859: [Proposal] An iceberg-unstructured module

[GitBox <gi...@apache.org>]

rdblue commented on issue #859:
URL: https://github.com/apache/iceberg/issues/859#issuecomment-906794720


   We talked about this recently in Slack. An alternative that I like is adding a BLOB type to the spec that is backed by a file. Then each unstructured file is represented by a row in a table that can contain metadata, and isn't just a file reference in an Iceberg manifest file.
   
   I think using a BLOB type is a simpler path to managing unstructured data collections and end up delivering more features.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org