You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2024/04/20 19:17:00 UTC

[jira] [Created] (HUDI-7645) Optimize BQ sync tool for MDT

sivabalan narayanan created HUDI-7645:
-----------------------------------------

             Summary: Optimize BQ sync tool for MDT
                 Key: HUDI-7645
                 URL: https://issues.apache.org/jira/browse/HUDI-7645
             Project: Apache Hudi
          Issue Type: Improvement
          Components: meta-sync
            Reporter: sivabalan narayanan


Looks like in BQ sync, we are polling fsview for latest files sequentially for every partition. 

 

When MDT is enabled, we could load all partitions in one call. 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)