[jira] [Created] (KAFKA-5593) Kafka streams not re-balancing when 3 consumer streams are there

["Yogesh BG (JIRA)" <ji...@apache.org>]

Yogesh BG created KAFKA-5593:
--------------------------------

             Summary: Kafka streams not re-balancing when 3 consumer streams are there
                 Key: KAFKA-5593
                 URL: https://issues.apache.org/jira/browse/KAFKA-5593
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Yogesh BG
            Priority: Critical
         Attachments: log1.txt, log2.txt, log3.txt

I have 3 broker nodes, 3 kafka streams

I observe that all 3 consumer streams are part of the group named rtp-kafkastreams. but when i see the data is processed only by one node. 
<data processed log - only in attached log1 file>
DEBUG n.a.a.k.a.AccessLogMetricEnrichmentProcessor - AccessLogMetricEnrichmentProcessor.process

when i do check the partition information shared by each of them i see first node has all partitions like all 8. but in other streams the folder is empty.

<Node 1>
[root@ip-172-31-11-139 ~]# ls /data/kstreams/rtp-kafkastreams
0_0  0_1  0_2  0_3  0_4  0_5  0_6  0_7

<Node 2> and <Node 3> this folder is empty

I tried restarting the other two consumer streams still they won't become the part of the group and re-balance.

I have attached the logs.

Configurations are inside the log file.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)