You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2023/10/05 01:42:03 UTC

[jira] [Updated] (HUDI-5619) Fix HoodieTableFileSystemView inefficient latest base-file lookups

     [ https://issues.apache.org/jira/browse/HUDI-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prashant Wason updated HUDI-5619:
---------------------------------
    Fix Version/s: 0.14.1
                       (was: 0.14.0)

> Fix HoodieTableFileSystemView inefficient latest base-file lookups
> ------------------------------------------------------------------
>
>                 Key: HUDI-5619
>                 URL: https://issues.apache.org/jira/browse/HUDI-5619
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: core
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.14.1
>
>
> Currently, HoodieTableFileSystemView when looking up latest base-file in a single file-group [have to process the whole partition|https://github.com/apache/hudi/blob/master/hudi-common/src/main/java/org/apache/hudi/common/table/view/AbstractTableFileSystemView.java#L584], which is obviously not very efficient.
> Instead, we should be able to lookup and process just the file-group in question.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)