[GitHub] [incubator-iceberg] rdblue opened a new pull request #206: Add option to load column stats with data files.

[GitBox <gi...@apache.org>]

rdblue opened a new pull request #206: Add option to load column stats with data files.
URL: https://github.com/apache/incubator-iceberg/pull/206
 
 
   This adds an option to `BaseTableScan` to load column-level stats. Many clients do not need column-level stats when scanning Iceberg tables and removing them before copying data files speeds up query planning.
   
   When filtering files listed in a manifest, stats columns are now always loaded for the `InclusiveMetricsEvaluator`. When a data file is selected, its contents are either copied using a full copy or a "slim" copy that discards the large maps of column stats.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org