You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/01/23 20:00:00 UTC

[jira] [Commented] (HUDI-1926) Concurrent write conflict when generating same instanttime

    [ https://issues.apache.org/jira/browse/HUDI-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480725#comment-17480725 ] 

sivabalan narayanan commented on HUDI-1926:
-------------------------------------------

We upgraded out commit time to ms granularity with 0.10.0 with the hope that such conflicts may not happen. Let us know if you face the issue after 0.10.0. 

We wanted to avoid taking a lock just to generate commit time and hence trying out other ways for now. 

>  Concurrent write conflict when generating same instanttime
> -----------------------------------------------------------
>
>                 Key: HUDI-1926
>                 URL: https://issues.apache.org/jira/browse/HUDI-1926
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: writer-core
>    Affects Versions: 0.8.0
>            Reporter: taylor liao
>            Assignee: taylor liao
>            Priority: Major
>             Fix For: 0.11.0
>
>
> Now can use zookeeper or hive metastore control concurrent write, but when write program very short less than 1s. Here will generate same instanttime.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)