Re: [PR] Flink: Report table statistics to the planner in batch jobs [iceberg]

["talatuyarer (via GitHub)" <gi...@apache.org>]

talatuyarer commented on PR #17878:
URL: https://github.com/apache/iceberg/pull/17878#issuecomment-5465591367

   To assist with the review process, I have created a demo using Google’s public Iceberg datasets. By using Flink’s EXPLAIN command, I have demonstrated how this feature significantly improves query plans. For example, the optimizer was able to reduce the estimated scan count from **323,000,000 to 12,919 rows** and successfully chose **a broadcast join over a costly shuffle** for large datasets. You are welcome to explore these results and test the implementation yourself. [Table Stats Demo](https://gist.github.com/talatuyarer/ddc84fb203fcaf18e95b11937ab6d891)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org