You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2024/10/12 04:54:00 UTC

[jira] [Created] (HUDI-8341) Avoid filesystem view and use commit metadata to get the partition file slices pairs for which functional index is to be updated

Sagar Sumit created HUDI-8341:
---------------------------------

             Summary: Avoid filesystem view and use commit metadata to get the partition file slices pairs for which functional index is to be updated
                 Key: HUDI-8341
                 URL: https://issues.apache.org/jira/browse/HUDI-8341
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Sagar Sumit
            Assignee: Sagar Sumit
             Fix For: 1.0.0


The logic [here|https://github.com/apache/hudi/blob/7530e4fa48fb6c32e9cafb587914521bbbb4bc23/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java#L1084] could be problematic for COW and we might end up recomputing index for some files that are not touched by the commit. This should be fixed. We should solely rely on commit metadata.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)