You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Hung Tran (JIRA)" <ji...@apache.org> on 2017/11/08 00:36:01 UTC

[jira] [Resolved] (GOBBLIN-308) Gobblin cluster bootup hangs

     [ https://issues.apache.org/jira/browse/GOBBLIN-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hung Tran resolved GOBBLIN-308.
-------------------------------
    Resolution: Fixed

Issue resolved by pull request #2162
[https://github.com/apache/incubator-gobblin/pull/2162]

> Gobblin cluster bootup hangs
> ----------------------------
>
>                 Key: GOBBLIN-308
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-308
>             Project: Apache Gobblin
>          Issue Type: Bug
>            Reporter: Kuai Yu
>            Assignee: Kuai Yu
>
> The problem happens when there are more than 100 files in the job catalog. During the boot up sequence, spec consumer was launched after jobCatalog. However the jobCatalog launches with a job listener which will push job spec into a blocking queue, and due to spec consumer hasn't been started, no component will start to consume job specs from the blocking queue. Once the blocking queue max size (100 by default) is reached, the system is hanging.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)