You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Geoff Anderson (JIRA)" <ji...@apache.org> on 2015/09/09 01:55:46 UTC

[jira] [Created] (KAFKA-2525) Update ConsumerPerformance.scala to report join group time (new consumer)

Geoff Anderson created KAFKA-2525:
-------------------------------------

             Summary: Update ConsumerPerformance.scala to report join group time (new consumer)
                 Key: KAFKA-2525
                 URL: https://issues.apache.org/jira/browse/KAFKA-2525
             Project: Kafka
          Issue Type: Improvement
            Reporter: Geoff Anderson
            Assignee: Geoff Anderson
            Priority: Minor
             Fix For: 0.9.0


The patch for https://issues.apache.org/jira/browse/KAFKA-2489 adds a small amount of logic to ConsumerPerformance.scala which triggers consumer offsets topic creation/group join etc. before consumer performance is measured.

In https://github.com/apache/kafka/pull/179, [~gwenshap] pointed out that for detecting regressions, it may be useful with the new consumer to report group join time in addition to the other stats.

The only tricky bit here is that this "consumer preparation" time also includes time required to create the consumer offsets topic, so we'd like to trigger creation of consumer offsets topic and make sure it's complete before moving on the the "join group" phase.

The solution here may be as simple as calling consumer.partitionsFor(consumerOffsetTopic) to trigger a metadata request (and hence topic creation)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)