You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/10/18 14:30:00 UTC

[jira] [Created] (HUDI-2573) Deadlock w/ multi writer

sivabalan narayanan created HUDI-2573:
-----------------------------------------

             Summary: Deadlock w/ multi writer 
                 Key: HUDI-2573
                 URL: https://issues.apache.org/jira/browse/HUDI-2573
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: sivabalan narayanan
            Assignee: sivabalan narayanan
             Fix For: 0.10.0


With synchronous metadata patch, we added locking for cleaning and rollbacks. but there are code paths, where we do double locking and hence it hangs or fails after sometime.

 

inline cleaning enabled.

```

C1 acquires lock. 

    post commit -> triggers cleaning. 

                      cleaning again tries to acquire lock when about to commit and this is problematic.

```

 

Also, when upgrade is needed, we take a lock and rollback failed writes. this again will run into issues w/ double locking. 

 

 

                      



--
This message was sent by Atlassian Jira
(v8.3.4#803005)