You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Geoff Anderson (JIRA)" <ji...@apache.org> on 2015/09/09 01:55:46 UTC
[jira] [Created] (KAFKA-2525) Update ConsumerPerformance.scala to
report join group time (new consumer)
Geoff Anderson created KAFKA-2525:
-------------------------------------
Summary: Update ConsumerPerformance.scala to report join group time (new consumer)
Key: KAFKA-2525
URL: https://issues.apache.org/jira/browse/KAFKA-2525
Project: Kafka
Issue Type: Improvement
Reporter: Geoff Anderson
Assignee: Geoff Anderson
Priority: Minor
Fix For: 0.9.0
The patch for https://issues.apache.org/jira/browse/KAFKA-2489 adds a small amount of logic to ConsumerPerformance.scala which triggers consumer offsets topic creation/group join etc. before consumer performance is measured.
In https://github.com/apache/kafka/pull/179, [~gwenshap] pointed out that for detecting regressions, it may be useful with the new consumer to report group join time in addition to the other stats.
The only tricky bit here is that this "consumer preparation" time also includes time required to create the consumer offsets topic, so we'd like to trigger creation of consumer offsets topic and make sure it's complete before moving on the the "join group" phase.
The solution here may be as simple as calling consumer.partitionsFor(consumerOffsetTopic) to trigger a metadata request (and hence topic creation)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)