You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "terbed (via GitHub)" <gi...@apache.org> on 2026/10/11 16:25:19 UTC

[I] Enable page index for Iceberg scans [datafusion-iceberg]

terbed opened a new issue, #62:
URL: https://github.com/apache/datafusion-iceberg/issues/62

   Iceberg supports page-index pruning through `TableScanBuilder::with_row_selection_enabled`, but the DataFusion integration does not forward the session’s enable_page_index setting.
   
   Propagate this setting into Iceberg scans so callers can enable or disable page-index pruning through the existing DataFusion configuration. Verify identical query results and reduced storage reads for selective predicates on indexed Parquet files.
   
   Would be happy to add this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] Enable page index pruning for Iceberg scans [datafusion-iceberg]

Posted by "terbed (via GitHub)" <gi...@apache.org>.
terbed commented on issue #62:
URL: https://github.com/apache/datafusion-iceberg/issues/62#issuecomment-6176955451

   Hi @gabotechs ,
   I think this is a quite significant issue, iceberg scans should honor the default page index pruning behavior. 
   Do I miss something that blocks this? Could you please look into this or recommend a reviewer?
   
   Thanks a lot!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org