Samza with Rocksdb hanged forever in KeyValueStorageEngine.restore()

[Weinan Zhao <zh...@gmail.com>]

Hi all,

I've encountered Samza on yarn couldn't start up and stuck
in KeyValueStorageEngine.restore(). The job has 12 tasks, some of which
will handed forever.

I tried Samza 0.10 on Yarn 2.7.1 on CentOS 6, and Samza 0.9 on Yarn 2.4.1
on mixed of CentOS 5&6, and the wired thing is it seems always the
container on CentOS 6 stucks, I comments on a Rocksdb issue
<https://github.com/facebook/rocksdb/issues/696> for some help, and am
taking my chance here to see if anyone got into the same trouble, please
advice.

Re: Samza with Rocksdb hanged forever in KeyValueStorageEngine.restore()

[Yi Pan <ni...@gmail.com>]

Hi, Weinan,

We have not seen this hanging issue at LinkedIn. But it would be good to
track that. We will keep an eye on issue-696 as well.

Thanks for reporting!

-Yi

On Sun, Mar 13, 2016 at 8:03 PM, Weinan Zhao <zh...@gmail.com> wrote:

> Hi all,
>
> I've encountered Samza on yarn couldn't start up and stuck
> in KeyValueStorageEngine.restore(). The job has 12 tasks, some of which
> will handed forever.
>
> I tried Samza 0.10 on Yarn 2.7.1 on CentOS 6, and Samza 0.9 on Yarn 2.4.1
> on mixed of CentOS 5&6, and the wired thing is it seems always the
> container on CentOS 6 stucks, I comments on a Rocksdb issue
> <https://github.com/facebook/rocksdb/issues/696> for some help, and am
> taking my chance here to see if anyone got into the same trouble, please
> advice.
>