You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2020/10/17 00:42:00 UTC

[jira] [Created] (HUDI-1346) Fix clean and Asyn Clean when metadata table is enabled

Prashant Wason created HUDI-1346:
------------------------------------

             Summary: Fix clean and Asyn Clean when metadata table is enabled
                 Key: HUDI-1346
                 URL: https://issues.apache.org/jira/browse/HUDI-1346
             Project: Apache Hudi
          Issue Type: Sub-task
            Reporter: Prashant Wason
            Assignee: Prashant Wason


Metadata Table creates a deltacommit for each change on the dataset. This deltacommit has the same timestamp as the change (COMMIT, CLEAN, etc).

Hence, for correct syncing, two instants on the dataset should not have the same timestamp.

Currently, when autoclean or async clean is enabled, the instantTime is reused. That breaks metadata table sync.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)