[jira] [Created] (HUDI-9407) Add support for individual locks to Metadata table

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-9407:
-----------------------------------------

             Summary: Add support for individual locks to Metadata table 
                 Key: HUDI-9407
                 URL: https://issues.apache.org/jira/browse/HUDI-9407
             Project: Apache Hudi
          Issue Type: Bug
          Components: writer-core
            Reporter: sivabalan narayanan


As of now, all writes to MDT happens within data table lock. 

This means that we do not need to burden user to configure a diff set of lock configuration for metadata table. But with streaming writes support with https://issues.apache.org/jira/browse/HUDI-9281, we are enabling NBCC w/ MDT. 

And so, this opens up the opportunity for us to write to MDT concurrently from data table using a diff lock. 

but in first version of HUDI-9281, we are not introducing this as this needs more considerations around usability etc. So, filing this tracking ticket. 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)