[jira] [Created] (KAFKA-10006) Streams should not attempt to create internal topics that may exist

["Sophie Blee-Goldman (Jira)" <ji...@apache.org>]

Sophie Blee-Goldman created KAFKA-10006:
-------------------------------------------

             Summary: Streams should not attempt to create internal topics that may exist
                 Key: KAFKA-10006
                 URL: https://issues.apache.org/jira/browse/KAFKA-10006
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Sophie Blee-Goldman


During assignment, Streams will attempt to validate all internal topics and their number of partitions, and create them if necessary. However we have seen that the InternalTopicManager will occasionally try to recreate internal topics that already exist when the broker is unavailable, and the describeTopics request fails. 

This is because we catch both UnknownTopicOrPartitionException AND LeaderNotAvailableException and treat them the same, ie we assume the topic does not exist. We shouldn't try to create topics until we've validated that they don't actually exist. If we can't connect to the brokers to check whether the topic exists, there's no reason to believe we would be able to create the topic anyway.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)