You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2021/07/31 01:05:00 UTC

[jira] [Updated] (HUDI-2099) hive lock which state is WATING should be released, otherwise this hive lock will be locked forever

     [ https://issues.apache.org/jira/browse/HUDI-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Udit Mehrotra updated HUDI-2099:
--------------------------------
    Status: In Progress  (was: Open)

>  hive lock which state is WATING should be released,  otherwise this hive lock will be locked forever
> -----------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-2099
>                 URL: https://issues.apache.org/jira/browse/HUDI-2099
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: Common Core
>    Affects Versions: 0.8.0
>         Environment: spark3.1.1
> hive3.1.1
> hadoop3.1.1
>            Reporter: tao meng
>            Assignee: tao meng
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.8.0
>
>
> when we acquire hive lock failed and the lock state is WATING, we should release this WATING lock; otherwise this hive lock will be locked forever。
> test step:
> use hive lock to control concurrent write for hudi, let‘s call this lock hive_lock
> start three writers to write hudi table by using hive_lock concurrently, one of the writer will failed to acquire hive lock due to competition issues。
> *Exception in thread "main" org.apache.hudi.exception.HoodieLockException: Unable to acquire lock, lock object LockResponse(lockid:76, state:WAITING)*
>  
> start another writer to write hudi table by using same hive_lock, then we find hive_lock is locked forever, we have no way to acquire it
> *Exception in thread "main" org.apache.hudi.exception.HoodieLockException: Unable to acquire lock, lock object LockResponse(lockid:87, state:WAITING)*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)