You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias J. Sax (JIRA)" <ji...@apache.org> on 2017/12/08 01:05:00 UTC

[jira] [Assigned] (KAFKA-6126) Reduce rebalance time by not checking if created topics are available

     [ https://issues.apache.org/jira/browse/KAFKA-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias J. Sax reassigned KAFKA-6126:
--------------------------------------

    Assignee: Matthias J. Sax

> Reduce rebalance time by not checking if created topics are available
> ---------------------------------------------------------------------
>
>                 Key: KAFKA-6126
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6126
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 1.0.0
>            Reporter: Matthias J. Sax
>            Assignee: Matthias J. Sax
>             Fix For: 1.1.0
>
>
> Within {{StreamPartitionAssignor#assign}} we create new topics and afterwards wait in an "infinite loop" until topic metadata propagated throughout the cluster. We do this, to make sure topics are available when we start processing.
> However, with this approach we "extend" the time in the rebalance phase and thus are not responsive (no calls to `poll` for liveness check and {{KafkaStreams#close}} suffers). Thus, we might want to remove this check and handle potential "topic not found" exceptions in the main thread gracefully.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)