You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "hantangwangd (via GitHub)" <gi...@apache.org> on 2026/05/14 03:19:51 UTC
[PR] Spark: Also disable min/max aggregation push down for binary [iceberg]
hantangwangd opened a new pull request, #16328:
URL: https://github.com/apache/iceberg/pull/16328
For min/max aggregation push down, binary has the same limitations as string. Iceberg may truncate min/max statistics for binary columns in Parquet files. Since min/max push down is already disabled for string, this PR extends the same behavior to binary columns to avoid potential incorrect results. Refer to the test case in this PR for details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark: Disable min/max aggregation push down for binary [iceberg]
Posted by "huaxingao (via GitHub)" <gi...@apache.org>.
huaxingao commented on PR #16328:
URL: https://github.com/apache/iceberg/pull/16328#issuecomment-4452170903
Thanks @hantangwangd for the PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark: Also disable min/max aggregation push down for binary [iceberg]
Posted by "hantangwangd (via GitHub)" <gi...@apache.org>.
hantangwangd commented on PR #16328:
URL: https://github.com/apache/iceberg/pull/16328#issuecomment-4448594476
Hi @huaxingao, thanks for review #16320. This PR is another fix for min/max aggregation push down, applying the same constraints to binary columns as are already applied to string columns. Since Iceberg may truncate min/max statistics for binary columns in Parquet files.
Please take a look when you have a chance, thanks a lot!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark: Disable min/max aggregation push down for binary [iceberg]
Posted by "huaxingao (via GitHub)" <gi...@apache.org>.
huaxingao merged PR #16328:
URL: https://github.com/apache/iceberg/pull/16328
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org