You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hudi.apache.org by Hemanth Gowda <he...@gmail.com> on 2023/01/17 21:46:47 UTC

Starvation when using OCC with FileSystemBasedLockProvider and Deadlock with ZooKeeperLockProvider

Hi Team,

Just bumping this up https://github.com/apache/hudi/issues/7654.
- Starvation when using OCC with FileSystemBasedLockProvider - I've tried
setting the timeouts and retries very high. The test still fails except
when I reduce contention (Not possible in actual production use cases we
have).
- Deadlock when using OCC with ZooKeeperLockProvider






Thanks,
Hemanth Gowda
LinkedIn <https://www.linkedin.com/in/hemanthbm/>

Re: Starvation when using OCC with FileSystemBasedLockProvider and Deadlock with ZooKeeperLockProvider

Posted by 冯健 <fe...@gmail.com>.

if you did not set withFileSystemLockExpire, the Filelock is also stuck,
right?

Have you ever tried the master branch to run your code? I met the same
issue when I ran your code in 0.12.1 but seems ok in the master branch,
maybe this has already been fixed by someone...

On Wed, 18 Jan 2023 at 05:47, Hemanth Gowda <he...@gmail.com> wrote:

> Hi Team,
>
> Just bumping this up https://github.com/apache/hudi/issues/7654.
> - Starvation when using OCC with FileSystemBasedLockProvider - I've tried
> setting the timeouts and retries very high. The test still fails except
> when I reduce contention (Not possible in actual production use cases we
> have).
> - Deadlock when using OCC with ZooKeeperLockProvider
>
>
>
>
>
>
> Thanks,
> Hemanth Gowda
> LinkedIn <https://www.linkedin.com/in/hemanthbm/>
>