[jira] [Created] (HUDI-2595) Guard all writes to metadata table even for tables where locking is not enabled

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-2595:
-----------------------------------------

             Summary: Guard all writes to metadata table even for tables where locking is not enabled
                 Key: HUDI-2595
                 URL: https://issues.apache.org/jira/browse/HUDI-2595
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: sivabalan narayanan


Guard all writes to metadata table even for tables where locking is not enabled.

As of now, we guard all writes to metadata table by taking a data table lock. This might work well for tables where multi-writer is enabled and so locking does take place. but for tables where multi-writer is not enabled, changes to metadata table happens w/o any lock. 

so, if async compaction is running, it could potentially overstep w/ just 1 writer. both could concurrently try to update metadata table. 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)