[jira] [Created] (KAFKA-4631) Refresh consumer metadata more frequently for unknown subscribed topics

["Jason Gustafson (JIRA)" <ji...@apache.org>]

Jason Gustafson created KAFKA-4631:
--------------------------------------

             Summary: Refresh consumer metadata more frequently for unknown subscribed topics
                 Key: KAFKA-4631
                 URL: https://issues.apache.org/jira/browse/KAFKA-4631
             Project: Kafka
          Issue Type: Bug
            Reporter: Jason Gustafson
            Assignee: Matthias J. Sax
             Fix For: 0.10.2.0


By default, the consumer refreshes metadata every 5 minutes. In testing, it can often happen that a topic is created at about the same time that the consumer is started. In the worst case, it finishes after the consumer fetches metadata, and the test must wait 5 minutes for the consumer to refresh metadata. To address this problem, users can decrease the metadata refresh interval, but this means more frequent refreshes even after all topics are known. An improvement would be to internally let the consumer fetch metadata more frequently when the consumer encounters unknown topics. Perhaps every 5-10 seconds would be reasonable, for example.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)