You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/10/21 00:48:00 UTC

[jira] [Closed] (HUDI-167) Rethink Metadata archiving in Hoodie

     [ https://issues.apache.org/jira/browse/HUDI-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar closed HUDI-167.
-------------------------------
    Resolution: Duplicate

HUDI-309 

> Rethink Metadata archiving in Hoodie
> ------------------------------------
>
>                 Key: HUDI-167
>                 URL: https://issues.apache.org/jira/browse/HUDI-167
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>          Components: Common Core
>            Reporter: Balaji Varadarajan
>            Assignee: Vinoth Chandar
>            Priority: Major
>
> The current archiving logic is not cleanly designed and implemented. Recently, we ran into the issue https://issues.apache.org/jira/browse/HUDI-162?filter=-2 . One of the main factor for this is the archiving logic. Currently, the archiving logic retains last N commits for each action. This could result in gaps in the active timeline for certain actions when  considering all timeline for all actions.
>  
> We need to re-design the archiving policy



--
This message was sent by Atlassian Jira
(v8.3.4#803005)