[GitHub] [incubator-iceberg] rdblue opened a new pull request #201: Add appendManifest to AppendFiles API.

[GitBox <gi...@apache.org>]

rdblue opened a new pull request #201: Add appendManifest to AppendFiles API.
URL: https://github.com/apache/incubator-iceberg/pull/201
 
 
   This is intended for writers that need to checkpoint state or to help parallelize conversion. Writers that checkpoint should be able to create manifest files and append the contents of those manifests to a table, instead of checkpointing individual data files. Similarly, when copying table state to convert to Iceberg, tasks should be able to create manifests in parallel and commit a small list of manifests to a table instead of collecting all data files into a single commit.
   
   Manifests that will be appended must be rewritten in the final commit to correctly set the snapshot ID of all new data files.
   
   This also makes `ManifestWriter` public and cleans up its public API.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org