[jira] [Created] (HUDI-6154) Race condition in case of multi-writers may cause hoodie.properties to be unreadable

["Prashant Wason (Jira)" <ji...@apache.org>]

Prashant Wason created HUDI-6154:
------------------------------------

             Summary: Race condition in case of multi-writers may cause hoodie.properties to be unreadable
                 Key: HUDI-6154
                 URL: https://issues.apache.org/jira/browse/HUDI-6154
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Prashant Wason
            Assignee: Prashant Wason


When a process wants to update hoodie.properties, it follows these steps:
 # Read hoodie.properties
 # Create hoodie.properties.backup
 # Write properties read in #1 into hoodie.properties.backup
 # Delete hoodie.properties
 # Create hoodie.properties
 # Write updated properties into hoodie.properties
 # Delete hoodie.properties.backup

The reader has this mechanism:
 # Read hoodie.properties.
 # If not found, read hoodie.properties.backup

In case of a race between reader and writer, reader may read hoodie.properties after step #4 (hoodie.properties deleted by writer) and then try to read hoodie.properties.backup after step #7 (hoodie.properties.backup deleted by writer). The reader will assume that hoodie.properties does not exist and throw an error.

To deal with this a retry is introduced.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)