You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Manoj Govindassamy (Jira)" <ji...@apache.org> on 2022/01/21 18:07:00 UTC

[jira] [Created] (HUDI-3300) Timeline server FSViewManager should avoid inline reading for metadata file partition

Manoj Govindassamy created HUDI-3300:
----------------------------------------

             Summary: Timeline server FSViewManager should avoid inline reading for metadata file partition
                 Key: HUDI-3300
                 URL: https://issues.apache.org/jira/browse/HUDI-3300
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Manoj Govindassamy
            Assignee: Ethan Guo
             Fix For: 0.11.0


When inline reading is enabled, that is hoodie.metadata.enable.full.scan.log.files = false, MetadataMergedLogRecordReader doesn't cache the file listings records via the ExternalSpillableMap. So, every file listing will lead to re-reading of metadata files partition log and base files. Since files partition is less in size, even when inline reading is enabled, the TimelineServer should construct the FSViewManager with inline reading disabled for metadata files partition. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)