[jira] [Commented] (HUDI-8357) BaseHoodieTableFileIndex should not scan archival timeline

["Y Ethan Guo (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889417#comment-17889417 ] 

Y Ethan Guo commented on HUDI-8357:
-----------------------------------

Note that the fix to master/Hudi 1.0 is part of HUDI-8141 (https://github.com/apache/hudi/pull/11947). The fix to branch-0.x should be taken up separately.

> BaseHoodieTableFileIndex should not scan archival timeline
> ----------------------------------------------------------
>
>                 Key: HUDI-8357
>                 URL: https://issues.apache.org/jira/browse/HUDI-8357
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Shawn Chang
>            Priority: Blocker
>             Fix For: 1.0.0, 0.15.1
>
>
> When developing completion time incremental query(https://github.com/apache/hudi/pull/11947), we noticed that BaseHoodieTableFileIndex#listPartitionPaths would scan archival timeline, which would harm the performance of incremental queries. This issue was addressed along with the PR above in 1.0, but we need to address this for Hudi 0.x as well



--
This message was sent by Atlassian Jira
(v8.20.10#820010)