You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2021/11/02 00:16:00 UTC

[jira] [Created] (HUDI-2663) Incorrect deletion of heartbeat files for inflight commits

Vinoth Chandar created HUDI-2663:
------------------------------------

             Summary: Incorrect deletion of heartbeat files for inflight commits
                 Key: HUDI-2663
                 URL: https://issues.apache.org/jira/browse/HUDI-2663
             Project: Apache Hudi
          Issue Type: Sub-task
          Components: Writer Core
            Reporter: Vinoth Chandar
             Fix For: 0.10.0


https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java#L818
AbstractHoodieWriteClient.java
      HeartbeatUtils.cleanExpiredHeartbeats(this.heartbeatClient.getAllExistingHeartbeatInstants(),
<https://github.com/apache/hudi|apache/hudi>apache/hudi | Added by GitHub



5:43
This method just blindly deletes all heartbeat files for all inflight commits
5:43
this causes other commits to see it as missing heartbeats
5:43
causing to rollback other inflight commits



--
This message was sent by Atlassian Jira
(v8.3.4#803005)