[jira] [Comment Edited] (KAFKA-13136) kafka-connect task.max : active task in consumer group is limited by the bigger topic to consume

["raphaelauv (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508032#comment-17508032 ] 

raphaelauv edited comment on KAFKA-13136 at 3/17/22, 8:01 AM:
--------------------------------------------------------------

thank you very much for that explanation , it's very clear :+1

yes we can close that ticket, thank you


was (Author: raphaelauv):
thank you very much for that explaination , it's very clear :+1

yes we can close that ticket, thank you

> kafka-connect task.max : active task in consumer group is limited by the bigger topic to consume
> ------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-13136
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13136
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: raphaelauv
>            Priority: Major
>
> In kafka-connect 2.7
> *The maximum number of active task for a sink connector is equal to the topic with the biggest number of partitions to consume*
> An active task is a task with partitions attributed in the consumer-group of the sink connector
> example :
> With 2 topics where each have 10 partitions ( 20 partitions in total )
> The maximum number of active task is 10 ( if I set task.max at 12 ,there is 10 members of the consumer group consuming partitions and  2 members in the consumer-group that do not have partitions to consume).
> If I add a third topic with 15 partitions to the connector conf then the 12 members of the consumer group are consuming partitions, and then if I set now task.max at 17 only 15 members are active in the consumer-group.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)