[jira] [Created] (KAFKA-6126) Reduce rebalance time by not checking if created topics are available

["Matthias J. Sax (JIRA)" <ji...@apache.org>]

Matthias J. Sax created KAFKA-6126:
--------------------------------------

             Summary: Reduce rebalance time by not checking if created topics are available
                 Key: KAFKA-6126
                 URL: https://issues.apache.org/jira/browse/KAFKA-6126
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 1.0.0
            Reporter: Matthias J. Sax
             Fix For: 1.1.0


Within {{StreamPartitionAssignor#assign}} we create new topics and afterwards wait in an "infinite loop" until topic metadata propagated throughout the cluster. We do this, to make sure topics are available when we start processing.

However, with this approach we "extend" the time in the rebalance phase and thus are not responsive (no calls to `poll` for liveness check and {{KafkaStreams#close}} suffers). Thus, we might want to remove this check and handle potential "topic not found" exceptions in the main thread gracefully.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)