You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Timothy Brown (Jira)" <ji...@apache.org> on 2025/05/02 00:09:00 UTC

[jira] [Created] (HUDI-9364) Improve performance when loading FileSystemView for large partitions

Timothy Brown created HUDI-9364:
-----------------------------------

             Summary: Improve performance when loading FileSystemView for large partitions
                 Key: HUDI-9364
                 URL: https://issues.apache.org/jira/browse/HUDI-9364
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Timothy Brown


When the partition is very large and you are using a spillable map, there is a high cost for estimating the resources. Also the fetch from the Metadata Table can be expensive due to recomputing the valid instants per scanner. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)