You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/01/13 22:26:00 UTC

[jira] [Updated] (HUDI-2926) Inline compaction of MOR table does not merge last log blocks when metadata table is enabled

     [ https://issues.apache.org/jira/browse/HUDI-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-2926:
--------------------------------------
    Fix Version/s: 0.10.0

> Inline compaction of MOR table does not merge last log blocks when metadata table is enabled
> --------------------------------------------------------------------------------------------
>
>                 Key: HUDI-2926
>                 URL: https://issues.apache.org/jira/browse/HUDI-2926
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Prashant Wason
>            Priority: Major
>             Fix For: 0.10.0
>
>
> This issue happens when:
>  # Metadata Table is enabled
>  # It is a MOR Table
>  # Append is not supported
> See HUDI-2925 for more detailed reasoning in the context of clean operations.
>  
> Summary: HoodieTable has a cached metadata reader which should be synced to pick up changes on the dataset.
> Assume last deltacommit was 99.deltacommit and the log file version is 15. The next commit will be 100.deltacommit which will write log file 16 (new log file as APPEND not supported). If postWrite we [read from the cached metadata reader |https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java#L108] then it will not report log version 16.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)