You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2024/09/23 16:00:00 UTC

[jira] [Created] (HUDI-8240) Add locks to clean and rollbacks to validate timestamps

sivabalan narayanan created HUDI-8240:
-----------------------------------------

             Summary: Add locks to clean and rollbacks to validate timestamps
                 Key: HUDI-8240
                 URL: https://issues.apache.org/jira/browse/HUDI-8240
             Project: Apache Hudi
          Issue Type: Improvement
          Components: writer-core
            Reporter: sivabalan narayanan


We are adding timestamp validation to ensure new timestamp generated is latest compared to any previous timestamp generated. 

But due to expansion of scope, we punted locks for clean and roll backs. Filing this tracking ticket for the same. 

for clean, strict timestamp ordering may not matter much. since, no other ingestion nor table services writers depends on clean timestamps. only subsequent clean depends on previous cleans. So, lets think through in detail and then add locks if need be. 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)