[GitHub] [hudi] nsivabalan commented on issue #8670: [SUPPORT] Hudi cannot multi-write referring to case #7653

["nsivabalan (via GitHub)" <gi...@apache.org>]

nsivabalan commented on issue #8670:
URL: https://github.com/apache/hudi/issues/8670#issuecomment-1557575588

   Nope. issue is, with OCC (optimistic concurrency control), when two writers are trying to modify the same data concurrently, only one can succeed and another one will fail. So, as long as you keep trying to write concurrently from 2 writers where in both writers are trying to modify the same data, one will definitely fail. If not, it could lead to data loss or some data consistency issues. 
   
   But if there are concurrent writers writing to diff set of data, you should not see any conflicts and both will succeed. 
   For eg, if wirter1 writes to partition1 and writer2 writes to partition2. 
   Or writer 1 is writing to latest partitions, while writer2 is doing a backfill for a 6 month old partition. These are valid scenarios where concurrent writing will succeed. 
   
   lets us know if you need any more details. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org