[jira] [Updated] (HUDI-6154) Race condition in case of multi-writers may cause hoodie.properties to be unreadable

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HUDI-6154:
---------------------------------
    Labels: pull-request-available  (was: )

> Race condition in case of multi-writers may cause hoodie.properties to be unreadable
> ------------------------------------------------------------------------------------
>
>                 Key: HUDI-6154
>                 URL: https://issues.apache.org/jira/browse/HUDI-6154
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Prashant Wason
>            Assignee: Prashant Wason
>            Priority: Major
>              Labels: pull-request-available
>
> When a process wants to update hoodie.properties, it follows these steps:
>  # Read hoodie.properties
>  # Create hoodie.properties.backup
>  # Write properties read in #1 into hoodie.properties.backup
>  # Delete hoodie.properties
>  # Create hoodie.properties
>  # Write updated properties into hoodie.properties
>  # Delete hoodie.properties.backup
> The reader has this mechanism:
>  # Read hoodie.properties.
>  # If not found, read hoodie.properties.backup
> In case of a race between reader and writer, reader may read hoodie.properties after step #4 (hoodie.properties deleted by writer) and then try to read hoodie.properties.backup after step #7 (hoodie.properties.backup deleted by writer). The reader will assume that hoodie.properties does not exist and throw an error.
> To deal with this a retry is introduced.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)