You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/10/11 21:06:33 UTC

[GitHub] [hudi] ChiehFu commented on issue #3782: [SUPPORT] Hudi Concurrent write (OCC) with upsert tables random errors

ChiehFu commented on issue #3782:
URL: https://github.com/apache/hudi/issues/3782#issuecomment-940439919


   In addition, looking at how a Hudi instantTime is created, it seems that there is no additional mechanism to prevent two concurrent jobs from having a same instantTime. 
   
   Cloud two jobs having a same instantTime have contributed to any of the error mentioned above?
   
   https://github.com/apache/hudi/blob/da65d3cae99e8fee0ede9b5ed8630a3716d284c8/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala#L99
   
   https://github.com/apache/hudi/blob/da65d3cae99e8fee0ede9b5ed8630a3716d284c8/hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java#L89-L97


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org