You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@twill.apache.org by "Terence Yim (JIRA)" <ji...@apache.org> on 2014/05/13 01:29:15 UTC

[jira] [Updated] (TWILL-79) Kafka publisher should be aware of changes in broker list

     [ https://issues.apache.org/jira/browse/TWILL-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Terence Yim updated TWILL-79:
-----------------------------

    Attachment: TWILL-79-1.patch

The patch involves

1. Added method to attach listener for watching broker list changes in BrokerService
2. SimplePublisher implementation watch for changes in broker list using the BrokerServiceChangeListener
    2a. Create new producer and close the old one if the broker list changed .

> Kafka publisher should be aware of changes in broker list
> ---------------------------------------------------------
>
>                 Key: TWILL-79
>                 URL: https://issues.apache.org/jira/browse/TWILL-79
>             Project: Apache Twill
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.2.0-incubating
>            Reporter: Terence Yim
>         Attachments: TWILL-79-1.patch
>
>
> After a KafkaPublisher is being created from the KafkaClientService, it never refreshes it's broker list. It will break if the broker list change in time. E.g. 
> Time     List
> t1         [host1]
> t2         [host1, host2]
> t3         [host2]          <- Break, no longer able to publish



--
This message was sent by Atlassian JIRA
(v6.2#6252)