You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jason Gustafson (JIRA)" <ji...@apache.org> on 2016/09/13 01:12:20 UTC
[jira] [Updated] (KAFKA-2525) Update ConsumerPerformance.scala to
report join group time (new consumer)
[ https://issues.apache.org/jira/browse/KAFKA-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Gustafson updated KAFKA-2525:
-----------------------------------
Fix Version/s: (was: 0.10.1.0)
0.10.2.0
> Update ConsumerPerformance.scala to report join group time (new consumer)
> -------------------------------------------------------------------------
>
> Key: KAFKA-2525
> URL: https://issues.apache.org/jira/browse/KAFKA-2525
> Project: Kafka
> Issue Type: Improvement
> Reporter: Geoff Anderson
> Assignee: Geoff Anderson
> Priority: Minor
> Fix For: 0.10.2.0
>
>
> The patch for https://issues.apache.org/jira/browse/KAFKA-2489 adds a small amount of logic to ConsumerPerformance.scala which triggers consumer offsets topic creation/group join etc. before consumer performance is measured.
> In https://github.com/apache/kafka/pull/179, [~gwenshap] pointed out that for detecting regressions, it may be useful with the new consumer to report group join time in addition to the other stats.
> The only tricky bit here is that this "consumer preparation" time also includes time required to create the consumer offsets topic, so we'd like to trigger creation of consumer offsets topic and make sure it's complete before moving on the the "join group" phase.
> The solution here may be as simple as calling consumer.partitionsFor(consumerOffsetTopic) to trigger a metadata request (and hence topic creation)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)