You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2022/02/17 06:23:00 UTC

[jira] [Assigned] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

     [ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo reassigned HUDI-3300:
-------------------------------

    Assignee: Yue Zhang  (was: Ethan Guo)

> Timeline server FSViewManager should avoid point lookup for metadata file partition
> -----------------------------------------------------------------------------------
>
>                 Key: HUDI-3300
>                 URL: https://issues.apache.org/jira/browse/HUDI-3300
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: metadata
>            Reporter: Manoj Govindassamy
>            Assignee: Yue Zhang
>            Priority: Blocker
>             Fix For: 0.11.0
>
>
> When inline reading is enabled, that is hoodie.metadata.enable.full.scan.log.files = false, MetadataMergedLogRecordReader doesn't cache the file listings records via the ExternalSpillableMap. So, every file listing will lead to re-reading of metadata files partition log and base files. Since files partition is less in size, even when inline reading is enabled, the TimelineServer should construct the FSViewManager with inline reading disabled for metadata files partition. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)