[jira] [Created] (KAFKA-10283) Consolidate client-level and consumer-level assignment within ClientState

["Guozhang Wang (Jira)" <ji...@apache.org>]

Guozhang Wang created KAFKA-10283:
-------------------------------------

             Summary: Consolidate client-level and consumer-level assignment within ClientState
                 Key: KAFKA-10283
                 URL: https://issues.apache.org/jira/browse/KAFKA-10283
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Guozhang Wang


In StreamsPartitionAssignor, we do a two-level assignment, one on the client-level, and then after the assignment is done we further decide within the client how to distributed among consumers if there are more.

The {{ClientState}} class is used for book-keeping the assigned tasks, however it is only used for the first level, while for the second level it is done outside of the class and we only keep track of the results in a few maps for logging purposes. This leaves us with a bunch of hierarchical maps, e.g. some on the client level and some on the consumer level.

We would like to consolidate some of these maps into a single data structure for better keeping track of the assignment information, and also for less bug vulnerability causing the assignment information to be inconsistent. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)