You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Zhaojing Yu (Jira)" <ji...@apache.org> on 2022/10/01 12:24:00 UTC

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

     [ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhaojing Yu updated HUDI-3300:
------------------------------
    Fix Version/s:     (was: 0.12.1)

> Timeline server FSViewManager should avoid point lookup for metadata file partition
> -----------------------------------------------------------------------------------
>
>                 Key: HUDI-3300
>                 URL: https://issues.apache.org/jira/browse/HUDI-3300
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: metadata, timeline-server
>            Reporter: Manoj Govindassamy
>            Assignee: Yue Zhang
>            Priority: Major
>
> When inline reading is enabled, that is hoodie.metadata.enable.full.scan.log.files = false, MetadataMergedLogRecordReader doesn't cache the file listings records via the ExternalSpillableMap. So, every file listing will lead to re-reading of metadata files partition log and base files. Since files partition is less in size, even when inline reading is enabled, the TimelineServer should construct the FSViewManager with inline reading disabled for metadata files partition. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)