[GitHub] [iceberg] pvary commented on pull request #4512: Core: Optimise BaseFileScanTask memory usage

[GitBox <gi...@apache.org>]

pvary commented on PR #4512:
URL: https://github.com/apache/iceberg/pull/4512#issuecomment-1091422796

   @rbalamohan:
   Do I understand correctly that the maximum size of `expr` is the same as the `residuals`, and it could be smaller if the partition values would prevent specific parts of the expression to change the results of the expression? Like if the `residuals` would say `date<2022 Jan 15` and the file contains `year(date)=2021`?
   
   Is there any edge case when the `expr` is bigger than the `residuals`?
   
   What is the CPU cost of calculating the `expr`? @rdblue: Are there any places in the Iceberg code where we create the filter but do not call the `residuals()` method?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org