You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "danny0405 (via GitHub)" <gi...@apache.org> on 2023/03/28 05:38:23 UTC

[GitHub] [hudi] danny0405 commented on pull request #8102: [HUDI-5880] Support partition pruning for flink streaming source in runtime

danny0405 commented on PR #8102:
URL: https://github.com/apache/hudi/pull/8102#issuecomment-1486248143

   > SupportsPartitionPushDown
   
   Thanks for the explanation, I think we have 2 ways to address the problem.
   
   1. Do we have some chance to fetch all the filters from the `HoodieTableSource` even though it implements the `SupportsPartitionPushDown`, like if the `SupportsFilterPushDown` applies first, if we could, then we can maintain these patition filters instead of relying on the Flink optimizer
   2. Remove the implementation of `SupportsPartitionPushDown` for `HoodieTableSource`, use the filter push down directly for partition pruning in our `FileIndex`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org