You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/09 22:44:00 UTC

[jira] [Commented] (SAMZA-1385) Coordination utils in LocalApplicationRunner uses same Zk path as ZkJobCoordinatorFactory for leader election

    [ https://issues.apache.org/jira/browse/SAMZA-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120775#comment-16120775 ] 

ASF GitHub Bot commented on SAMZA-1385:
---------------------------------------

GitHub user bharathkk opened a pull request:

    https://github.com/apache/samza/pull/265

    SAMZA-1385: Fix zookeeper path conflict between LocalApplicationRunner and ZkJobCoordinator

    Tested the fix w/ sample page view adclick joiner job.
    @navina @sborya @nickpan47 can you please take a look at the RB?

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bharathkk/samza master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/265.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #265
    
----
commit c86ec0a22b8e18f544343609a3d8b423cd85658a
Author: Bharath Kumarasubramanian <bk...@linkedin.com>
Date:   2017-05-26T20:14:17Z

    Extract hdfs docs into its own section

commit eb48b5d3a2f651b44d0402287682868c58d1d444
Author: Bharath Kumarasubramanian <bk...@linkedin.com>
Date:   2017-06-08T22:40:54Z

    Merge remote-tracking branch 'upstream/master'

commit a28cb882d7790c35ed54f9f9d9291b75a63faf1c
Author: Bharath Kumarasubramanian <bk...@linkedin.com>
Date:   2017-08-08T00:34:35Z

    Merge remote-tracking branch 'upstream/master'

commit 37c5879517b0ea931aa8f8bdd3aadd32c8b1106d
Author: Bharath Kumarasubramanian <bk...@linkedin.com>
Date:   2017-08-09T18:07:15Z

    Merge remote-tracking branch 'upstream/master'

commit e2ed4c8fe5d2976d0783e8b3fe978dc7ebcd4483
Author: Bharath Kumarasubramanian <bk...@linkedin.com>
Date:   2017-08-09T22:11:25Z

    SAMZA-1385: Fix zookeeper path conflict between LocalApplicationRunner and ZkJobCoordinator

----


> Coordination utils in LocalApplicationRunner uses same Zk path as ZkJobCoordinatorFactory for leader election
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: SAMZA-1385
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1385
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Bharath Kumarasubramanian
>            Assignee: Bharath Kumarasubramanian
>             Fix For: 0.13.1
>
>
> In case of applications which involves creating intermediate stream, we perform the leader election twice. once for coordination for stream creation and another for job coordination.
> We currently use the same zookeeper path for both of these and this results in two nodes for the same processor in zookeeper. As a result, the process goes into listener mode and stuck in job model generation phase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)