You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/10/17 09:14:00 UTC
[jira] [Commented] (KAFKA-7515) Trogdor - Add Consumer Group
Benchmark Specification
[ https://issues.apache.org/jira/browse/KAFKA-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653223#comment-16653223 ]
ASF GitHub Bot commented on KAFKA-7515:
---------------------------------------
stanislavkozlovski opened a new pull request #5810: KAFKA-7515: Trogdor - Add Consumer Group Benchmark Specification
URL: https://github.com/apache/kafka/pull/5810
https://issues.apache.org/jira/browse/KAFKA-7515
**WIP**
I tested it locally by running two agents and they split up the messages in the partition fine
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Trogdor - Add Consumer Group Benchmark Specification
> ----------------------------------------------------
>
> Key: KAFKA-7515
> URL: https://issues.apache.org/jira/browse/KAFKA-7515
> Project: Kafka
> Issue Type: Improvement
> Reporter: Stanislav Kozlovski
> Assignee: Stanislav Kozlovski
> Priority: Minor
>
> Trogdor's `ConsumeBenchWorker` and `ConsumeBenchSpec` currently takes specific topic partitions and assigns a consumer to them ([https://github.com/apache/kafka/blob/509dd95ebbf03681ea680a84b8436814ba3e7541/tools/src/main/java/org/apache/kafka/trogdor/workload/ConsumeBenchWorker.java#L125)]
> It is useful to have functionality that supports consumer group usage since most Kafka consumers in practice subscribe to topics, not specific partitions. Using the `subscribe()` API will also make use of the consumer group, allowing for more flexible benchmark tests (e.g consuming a topic while creating a new partition)
> This will also allow for benchmarking more real-life scenarios like spinning up multiple consumers in a consumer group via spawning multiple Trogdor agents (or multiple consumers in one agent if https://issues.apache.org/jira/browse/KAFKA-7514 gets accepted)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)