[GitHub] [iceberg] ahshahid commented on issue #6198: colStats flag in TableContext remains false except in situation where delete files are present

[GitBox <gi...@apache.org>]

ahshahid commented on issue #6198:
URL: https://github.com/apache/iceberg/issues/6198#issuecomment-1315884814

   What I noticed was that by default when iceberg format files are generated,  the manifest file  does not contain lower bound/ upper bound info for non-partition columns.
   For **non partition** columns it writes empty bytes.
   
   And this behaviour is due to the flag colStats being false by default and gets turned on , only under specific cases ( like presence of delete files).
   
   If colStats flag is true, then manifest file records valid (i.e not empty byte buffer),  non-partition-column's stats, too.
   
   I believe these stats if available can help in pruning for some queries atleast...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org