You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/01/25 01:12:00 UTC

[jira] [Updated] (HUDI-5613) Improve the abstraction of the table file system view

     [ https://issues.apache.org/jira/browse/HUDI-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-5613:
----------------------------
    Description: 
AbstractTableFileSystemView does not contain HoodieEngineContext instance and instead relies on the caller to parallelize the listing per partition when metadata table is disabled.  In contrast, HoodieMetadataFileSystemView uses HoodieBackedTableMetadata leveraging the HoodieEngineContext instance.  We need to improve the abstraction so that two code paths (w/ and w/o metadata table) are unified with better abstraction of the table file system view.

 

> Improve the abstraction of the table file system view
> -----------------------------------------------------
>
>                 Key: HUDI-5613
>                 URL: https://issues.apache.org/jira/browse/HUDI-5613
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Ethan Guo
>            Priority: Major
>
> AbstractTableFileSystemView does not contain HoodieEngineContext instance and instead relies on the caller to parallelize the listing per partition when metadata table is disabled.  In contrast, HoodieMetadataFileSystemView uses HoodieBackedTableMetadata leveraging the HoodieEngineContext instance.  We need to improve the abstraction so that two code paths (w/ and w/o metadata table) are unified with better abstraction of the table file system view.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)