You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Stanislav Kozlovski (JIRA)" <ji...@apache.org> on 2018/10/16 12:49:00 UTC
[jira] [Updated] (KAFKA-7515) Trogdor - Add Consumer Group Benchmark Specification

     [ https://issues.apache.org/jira/browse/KAFKA-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stanislav Kozlovski updated KAFKA-7515:
---------------------------------------
    Description: 
Trogdor's `ConsumeBenchWorker` and `ConsumeBenchSpec` currently takes specific topic partitions and assigns a consumer to them ([https://github.com/apache/kafka/blob/509dd95ebbf03681ea680a84b8436814ba3e7541/tools/src/main/java/org/apache/kafka/trogdor/workload/ConsumeBenchWorker.java#L125)]

It is useful to have functionality that supports consumer group usage since most Kafka consumers in practice subscribe to topics, not specific partitions. Using the `subscribe()` API will also make use of the consumer group, allowing for more flexible benchmark tests (e.g consuming a topic while creating a new partition)

This will also allow for benchmarking more real-life scenarios like spinning up multiple consumers in a consumer group via spawning multiple Trogdor agents (or multiple consumers in one agent if https://issues.apache.org/jira/browse/KAFKA-7514 gets accepted)

  was:
Trogdor's `ConsumeBenchWorker` and `ConsumeBenchSpec` currently takes specific topic partitions and assigns a consumer to them ([https://github.com/apache/kafka/blob/509dd95ebbf03681ea680a84b8436814ba3e7541/tools/src/main/java/org/apache/kafka/trogdor/workload/ConsumeBenchWorker.java#L125)]

It is useful to have functionality that supports consumer group usage since most Kafka consumers in practice use consumer groups. This will allow for benchmarking more real-life scenarios like spinning up multiple consumers in a consumer group via spawning multiple Trogdor agents (or multiple consumers in one agent if https://issues.apache.org/jira/browse/KAFKA-7514 gets accepted)


> Trogdor - Add Consumer Group Benchmark Specification
> ----------------------------------------------------
>
>                 Key: KAFKA-7515
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7515
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Stanislav Kozlovski
>            Assignee: Stanislav Kozlovski
>            Priority: Minor
>
> Trogdor's `ConsumeBenchWorker` and `ConsumeBenchSpec` currently takes specific topic partitions and assigns a consumer to them ([https://github.com/apache/kafka/blob/509dd95ebbf03681ea680a84b8436814ba3e7541/tools/src/main/java/org/apache/kafka/trogdor/workload/ConsumeBenchWorker.java#L125)]
> It is useful to have functionality that supports consumer group usage since most Kafka consumers in practice subscribe to topics, not specific partitions. Using the `subscribe()` API will also make use of the consumer group, allowing for more flexible benchmark tests (e.g consuming a topic while creating a new partition)
> This will also allow for benchmarking more real-life scenarios like spinning up multiple consumers in a consumer group via spawning multiple Trogdor agents (or multiple consumers in one agent if https://issues.apache.org/jira/browse/KAFKA-7514 gets accepted)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)