You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Akshay Sharma (Jira)" <ji...@apache.org> on 2020/07/17 11:55:00 UTC
[jira] [Created] (KAFKA-10285) consumer is not rejoining after
restart of broker.
Akshay Sharma created KAFKA-10285:
-------------------------------------
Summary: consumer is not rejoining after restart of broker.
Key: KAFKA-10285
URL: https://issues.apache.org/jira/browse/KAFKA-10285
Project: Kafka
Issue Type: Bug
Components: clients, consumer
Affects Versions: 2.3.1
Reporter: Akshay Sharma
Running single consumer(which is internally using confluent-kafka-go and librdkafka 1.4.0) with static membership.
Test case
Producer is keep writing to the Kafka and consumer is reading at the same time. when killed Kafka-server(broker), could see error below in broker logs and consumer is not able to rejoin.
*****Broker Logs*********
```
ERROR given member.id 1-b4b3f832-567a-4a17-ba5b-e14fb8cb536d is identified as a known static member 1,but not matching the expected member.id 1-9248bd87-dace-40de-841e-df19c3fe2cd0 (kafka.coordinator.group.GroupMetadata)
```
Analysis.
when consumer without restarting of broker Logs:
[2020-07-17 14:15:50,998] DEBUG Scheduling task auto-leader-rebalance-task with initial delay 300000 ms and period -1000 ms. (kafka.utils.KafkaScheduler)
[2020-07-17 14:15:51,290] DEBUG Accepted connection from /127.0.0.1:46350 on /127.0.0.1:9092 and assigned it to processor 1, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:15:51,290] DEBUG Processor 1 listening to new connection from /127.0.0.1:46350 (kafka.network.Processor)
[2020-07-17 14:15:51,308] DEBUG Accepted connection from /127.0.0.1:46352 on /127.0.0.1:9092 and assigned it to processor 2, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:15:51,309] DEBUG Processor 2 listening to new connection from /127.0.0.1:46352 (kafka.network.Processor)
[2020-07-17 14:15:51,423] DEBUG Accepted connection from /127.0.0.1:42156 on /127.0.1.1:9092 and assigned it to processor 3, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:15:51,425] DEBUG Processor 3 listening to new connection from /127.0.0.1:42156 (kafka.network.Processor)
[2020-07-17 14:15:51,495] DEBUG [Partition test_log-0 broker=0] High watermark updated to (offset=1 segment=[0:416]) (kafka.cluster.Partition)
[2020-07-17 14:15:51,497] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 fetch requests. (kafka.server.ReplicaManager)
[2020-07-17 14:15:51,498] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 producer requests. (kafka.server.ReplicaManager)
[2020-07-17 14:15:51,498] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 DeleteRecordsRequest. (kafka.server.ReplicaManager)
[2020-07-17 14:15:51,501] DEBUG [ReplicaManager broker=0] Produce to local log in 53 ms (kafka.server.ReplicaManager)
[2020-07-17 14:15:52,312] DEBUG Accepted connection from /127.0.0.1:42158 on /127.0.1.1:9092 and assigned it to processor 4, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:15:52,313] DEBUG Processor 4 listening to new connection from /127.0.0.1:42158 (kafka.network.Processor)
[2020-07-17 14:15:54,342] INFO [GroupCoordinator 0]: Preparing to rebalance group 0 in state PreparingRebalance with old generation 0 (__consumer_offsets-48) (reason: Adding new member 1-9248bd87-dace-40de-841e-df19c3fe2cd0 with group instanceid Some(1)) (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:15:54,357] INFO [GroupCoordinator 0]: Stabilized group 0 generation 1 (__consumer_offsets-48) (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:15:54,383] INFO [GroupCoordinator 0]: Assignment received from leader for group 0 for generation 1 (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:15:54,405] DEBUG [Partition __consumer_offsets-48 broker=0] High watermark updated to (offset=1 segment=[0:270]) (kafka.cluster.Partition)
[2020-07-17 14:15:54,405] DEBUG [ReplicaManager broker=0] Request key __consumer_offsets-48 unblocked 0 fetch requests. (kafka.server.ReplicaManager)
[2020-07-17 14:15:54,405] DEBUG [ReplicaManager broker=0] Request key __consumer_offsets-48 unblocked 0 producer requests. (kafka.server.ReplicaManager)
[2020-07-17 14:15:54,405] DEBUG [ReplicaManager broker=0] Request key __consumer_offsets-48 unblocked 0 DeleteRecordsRequest. (kafka.server.ReplicaManager)
[2020-07-17 14:15:54,405] DEBUG [ReplicaManager broker=0] Produce to local log in 3 ms (kafka.server.ReplicaManager)
[2020-07-17 14:15:54,414] DEBUG Accepted connection from /127.0.0.1:42160 on /127.0.1.1:9092 and assigned it to processor 5, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:15:54,415] DEBUG Processor 5 listening to new connection from /127.0.0.1:42160 (kafka.network.Processor)
when killed consumer but broker is still running LOGS:
[2020-07-17 14:18:28,266] INFO [GroupCoordinator 0]: Static member Some(1) with unknown member id rejoins, assigning new member id 1-ce854a05-5c82-42ea-ae45-6f17b2bca9b4, while old member 1-9248bd87-dace-40de-841e-df19c3fe2cd0 will be removed. (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:18:28,267] DEBUG [Partition test_log-0 broker=0] High watermark updated to (offset=22414 segment=[0:8635659]) (kafka.cluster.Partition)
[2020-07-17 14:18:28,267] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 fetch requests. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,267] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 producer requests. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,267] DEBUG [ReplicaManager broker=0] Request key test_log-0 unblocked 0 DeleteRecordsRequest. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,267] DEBUG [ReplicaManager broker=0] Produce to local log in 0 ms (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,269] INFO [GroupCoordinator 0]: Static member joins during Stable stage will not trigger rebalance. (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:18:28,273] DEBUG [Partition test-0 broker=0] High watermark updated to (offset=11776 segment=[0:1764875]) (kafka.cluster.Partition)
[2020-07-17 14:18:28,273] DEBUG [ReplicaManager broker=0] Request key test-0 unblocked 0 fetch requests. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,273] DEBUG [ReplicaManager broker=0] Request key test-0 unblocked 0 producer requests. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,273] DEBUG [ReplicaManager broker=0] Request key test-0 unblocked 0 DeleteRecordsRequest. (kafka.server.ReplicaManager)
[2020-07-17 14:18:28,273] DEBUG [ReplicaManager broker=0] Produce to local log in 0 ms (kafka.server.ReplicaManager)
Again tried killing consumer but broker is still running.
[2020-07-17 14:34:32,645] INFO [GroupCoordinator 0]: Static member Some(1) with unknown member id rejoins, assigning new member id 1-b4b3f832-567a-4a17-ba5b-e14fb8cb536d, while old member 1-ce854a05-5c82-42ea-ae45-6f17b2bca9b4 will be removed. (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:34:32,645] INFO [GroupCoordinator 0]: Static member joins during Stable stage will not trigger rebalance. (kafka.coordinator.group.GroupCoordinator)
Consumer is running now tried killer broker logs
[2020-07-17 14:37:36,534] INFO [GroupMetadataManager brokerId=0] Finished loading offsets and group metadata from __consumer_offsets-45 in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
[2020-07-17 14:37:36,597] DEBUG [GroupMetadataManager brokerId=0] Loaded group metadata GroupMetadata(groupId=0, generation=1, protocolType=Some(consumer), currentState=Stable, members=Map(1-9248bd87-dace-40de-841e-df19c3fe2cd0 -> MemberMetadata(memberId=1-9248bd87-dace-40de-841e-df19c3fe2cd0, groupInstanceId=Some(1), clientId=rdkafka, clientHost=/127.0.0.1, sessionTimeoutMs=1800000, rebalanceTimeoutMs=1800000, supportedProtocols=List(range), ))) with offsets Map() and pending offsets Map() (kafka.coordinator.group.GroupMetadataManager)
[2020-07-17 14:37:36,599] INFO [GroupCoordinator 0]: Loading group metadata for 0 with generation 1 (kafka.coordinator.group.GroupCoordinator)
[2020-07-17 14:37:36,611] INFO [GroupMetadataManager brokerId=0] Finished loading offsets and group metadata from __consumer_offsets-48 in 77 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
[2020-07-17 14:37:39,485] DEBUG Accepted connection from /127.0.0.1:46498 on /127.0.0.1:9092 and assigned it to processor 1, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:37:39,487] DEBUG Processor 1 listening to new connection from /127.0.0.1:46498 (kafka.network.Processor)
[2020-07-17 14:37:40,234] DEBUG Accepted connection from /127.0.0.1:46500 on /127.0.0.1:9092 and assigned it to processor 2, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:37:40,238] DEBUG Processor 2 listening to new connection from /127.0.0.1:46500 (kafka.network.Processor)
[2020-07-17 14:37:41,045] DEBUG Scheduling task auto-leader-rebalance-task with initial delay 300000 ms and period -1000 ms. (kafka.utils.KafkaScheduler)
[2020-07-17 14:37:44,046] DEBUG Accepted connection from /127.0.0.1:42304 on /127.0.1.1:9092 and assigned it to processor 3, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:37:44,047] DEBUG Processor 3 listening to new connection from /127.0.0.1:42304 (kafka.network.Processor)
[2020-07-17 14:37:44,060] DEBUG Created a new full FetchContext with 1 partition(s). Will not try to create a new session. (kafka.server.FetchManager)
[2020-07-17 14:37:44,071] DEBUG Accepted connection from /127.0.0.1:42306 on /127.0.1.1:9092 and assigned it to processor 4, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] (kafka.network.Acceptor)
[2020-07-17 14:37:44,072] DEBUG Processor 4 listening to new connection from /127.0.0.1:42306 (kafka.network.Processor)
[2020-07-17 14:37:45,375] ERROR given member.id 1-b4b3f832-567a-4a17-ba5b-e14fb8cb536d is identified as a known static member 1,but not matching the expected member.id 1-9248bd87-dace-40de-841e-df19c3fe2cd0 (kafka.coordinator.group.GroupMetadata)
1) When consumer is killed without broker restarting , consumer is able to join but everytime group coordinator is assigning him a new member id. Is this expecting?
2) When consumer is running but broker is killed/restarted, groupmeta-datamanager is loading the metadata where i could see the expecting member id is the id which was assigned during first time(inital stage where consumer joined freshly without any restart).Is this expecting? and consumer is not able to join.
*consumer logs*
%7|1594908244.958|RECV|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator/1001: Received HeartbeatResponse (v3, 6 bytes, CorrId 59, rtt 30.92ms)
%7|1594908244.958|HEARTBEAT|rdkafka#consumer-2| [thrd:main]: Group "0" heartbeat error response in state up (join state started, 1 partition(s) assigned): Broker: Static consumer fenced by other consumer with same group.instance.id
%0|1594908244.958|FATAL|rdkafka#consumer-2| [thrd:main]: Fatal error: Broker: Static consumer fenced by other consumer with same group.instance.id: Fatal consumer error: Broker: Static consumer fenced by other consumer with same group.instance.id
%7|1594908244.959|REBALANCE|rdkafka#consumer-2| [thrd:main]: Group "0" is rebalancing in state up (join-state started) with assignment: consumer fenced by newer instance
%7|1594908244.959|PAUSE|rdkafka#consumer-2| [thrd:main]: Library pausing 1 partition(s)
%7|1594908244.959|BARRIER|rdkafka#consumer-2| [thrd:main]: test [0]: rd_kafka_toppar_op_pause_resume:2393: new version barrier v3
%7|1594908244.959|PAUSE|rdkafka#consumer-2| [thrd:main]: Pause test [0] (v3)
%7|1594908244.960|CGRPJOINSTATE|rdkafka#consumer-2| [thrd:main]: Group "0" changed join state started -> wait-unassign (v4, state up)
%7|1594908244.960|BARRIER|rdkafka#consumer-2| [thrd:main]: Group "0": rd_kafka_cgrp_unassign:2476: new version barrier v5
%7|1594908244.960|UNASSIGN|rdkafka#consumer-2| [thrd:main]: Group "0": unassigning 1 partition(s) (v5)
%7|1594908244.960|BARRIER|rdkafka#consumer-2| [thrd:main]: test [0]: rd_kafka_toppar_op_fetch_stop:2334: new version barrier v4
%7|1594908244.961|CONSUMER|rdkafka#consumer-2| [thrd:main]: Stop consuming test [0] (v4)
%7|1594908244.962|DESP|rdkafka#consumer-2| [thrd:main]: Removing (un)desired topic test [0]
%7|1594908244.962|RESUME|rdkafka#consumer-2| [thrd:main]: Library resuming 1 partition(s)
%7|1594908244.962|BARRIER|rdkafka#consumer-2| [thrd:main]: test [0]: rd_kafka_toppar_op_pause_resume:2393: new version barrier v5
%7|1594908244.962|RESUME|rdkafka#consumer-2| [thrd:main]: Resume test [0] (v5)
%7|1594908244.962|UNASSIGN|rdkafka#consumer-2| [thrd:main]: Unassign not done yet (1 wait_unassign, 1 assigned, 0 wait commit, join state wait-unassign): unassign
%7|1594908244.963|OP|rdkafka#consumer-2| [thrd:main]: test [0] received op PAUSE (v3) in fetch-state active (opv2)
%7|1594908244.963|PAUSE|rdkafka#consumer-2| [thrd:main]: Pause test [0]: at offset 43472 (state active, v3)
%7|1594908244.965|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received FetchResponse (v11, 366 bytes, CorrId 13188, rtt 11.97ms)
%7|1594908244.965|FETCH|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Topic test [0] MessageSet size 300, error "Success", MaxOffset 46378, LSO 46378, Ver 2/2
%7|1594908244.965|CONSUME|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Enqueue 2 message(s) (86 bytes, 2 ops) on test [0] fetch queue (qlen 2, v2, last_offset 46377, 0 ctrl msgs, uncompressed)
%7|1594908244.965|FETCHDEC|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: Topic test [0]: fetch decide: updating to version 3 (was 2) at offset 43472 (was 46378)
%7|1594908244.965|FETCH|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Topic test [0] in state active at offset 43472 (0/100000 msgs, 0/1048576 kb queued, opv 3) is not fetchable: paused
%7|1594908244.965|FETCHADD|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Removed test [0] from fetch list (0 entries, opv 3): paused
{"Component_name":"Message-Reader","Instance_id":"1","err":\{"Code":82,"Str":"Fatal consumer error: Broker: Static consumer fenced by other consumer with same group.instance.id"}
%7|1594908244.967|OP|rdkafka#consumer-2| [thrd:main]: test [0] received op FETCH_STOP (v4) in fetch-state active (opv3)
%7|1594908244.967|FETCH|rdkafka#consumer-2| [thrd:main]: Stopping fetch for test [0] in state active (v4)
%7|1594908244.967|PARTSTATE|rdkafka#consumer-2| [thrd:main]: Partition test [0] changed fetch state active -> stopping
%7|1594908244.967|STORETERM|rdkafka#consumer-2| [thrd:main]: test [0]: offset store terminating
%7|1594908244.967|PARTSTATE|rdkafka#consumer-2| [thrd:main]: Partition test [0] changed fetch state stopping -> stopped
%7|1594908244.968|OP|rdkafka#consumer-2| [thrd:main]: test [0] received op PAUSE (v5) in fetch-state stopped (opv4)
%7|1594908244.968|RESUME|rdkafka#consumer-2| [thrd:main]: Not resuming stopped test [0]: at offset 43472 (state stopped, v5)
%7|1594908244.968|CGRPOP|rdkafka#consumer-2| [thrd:main]: Group "0" received op PARTITION_LEAVE in state up (join state wait-unassign, v5) for test [0]
%7|1594908244.968|PARTDEL|rdkafka#consumer-2| [thrd:main]: Group "0": delete test [0]
%7|1594908244.968|CGRPOP|rdkafka#consumer-2| [thrd:main]: Group "0" received op REPLY:FETCH_STOP in state up (join state wait-unassign, v5) for test [0]
%7|1594908244.968|UNASSIGN|rdkafka#consumer-2| [thrd:main]: Group "0": unassign done in state up (join state wait-unassign): without new assignment: FETCH_STOP done
%7|1594908244.968|CGRPJOINSTATE|rdkafka#consumer-2| [thrd:main]: Group "0" changed join state wait-unassign -> init (v5, state up)
%7|1594908245.858|CONNECT|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: broker in state TRY_CONNECT connecting
%7|1594908245.858|STATE|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker changed state TRY_CONNECT -> CONNECT
%7|1594908245.858|BROADCAST|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Broadcasting state change
%7|1594908245.862|CONNECT|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Connecting to ipv4#10.233.121.130:9092 (plaintext) with socket 21
%7|1594908245.863|CONNECT|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Connected to ipv4#10.233.121.130:9092
%7|1594908245.863|CONNECTED|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Connected (#2)
%7|1594908245.863|STATE|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker changed state CONNECT -> APIVERSION_QUERY
%7|1594908245.863|BROADCAST|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Broadcasting state change
%7|1594908245.863|SEND|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Sent ApiVersionRequest (v3, 40 bytes @ 0, CorrId 8)
%7|1594908245.866|RECV|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Received ApiVersionResponse (v3, 6 bytes, CorrId 8, rtt 2.29ms)
%7|1594908245.866|PROTOERR|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Protocol parse failure for ApiVersion v3 at 3/6 (rd_kafka_handle_ApiVersion:1911) (incorrect broker.version.fallback?)
%7|1594908245.868|PROTOERR|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiArrayCnt -1 out of range
%7|1594908245.868|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiVersionRequest v3 failed due to UNSUPPORTED_VERSION: retrying with v0
%7|1594908245.869|SEND|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Sent ApiVersionRequest (v0, 21 bytes @ 0, CorrId 9)
%7|1594908245.870|RECV|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Received ApiVersionResponse (v0, 276 bytes, CorrId 9, rtt 1.18ms)
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker API support:
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Produce (0) Versions 0..7
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Fetch (1) Versions 0..11
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Offset (2) Versions 0..5
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Metadata (3) Versions 0..8
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey LeaderAndIsr (4) Versions 0..2
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey StopReplica (5) Versions 0..1
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey UpdateMetadata (6) Versions 0..5
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey ControlledShutdown (7) Versions 0..2
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey OffsetCommit (8) Versions 0..7
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey OffsetFetch (9) Versions 0..5
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey FindCoordinator (10) Versions 0..2
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey JoinGroup (11) Versions 0..5
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Heartbeat (12) Versions 0..3
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey LeaveGroup (13) Versions 0..2
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey SyncGroup (14) Versions 0..3
%7|1594908245.870|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DescribeGroups (15) Versions 0..3
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey ListGroups (16) Versions 0..2
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey SaslHandshake (17) Versions 0..1
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey ApiVersion (18) Versions 0..2
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey CreateTopics (19) Versions 0..3
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DeleteTopics (20) Versions 0..3
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DeleteRecords (21) Versions 0..1
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey InitProducerId (22) Versions 0..1
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey OffsetForLeaderEpoch (23) Versions 0..3
%7|1594908245.871|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey AddPartitionsToTxn (24) Versions 0..1
%7|1594908245.874|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey AddOffsetsToTxn (25) Versions 0..1
%7|1594908245.874|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey EndTxn (26) Versions 0..1
%7|1594908245.874|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey WriteTxnMarkers (27) Versions 0..0
%7|1594908245.874|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey TxnOffsetCommit (28) Versions 0..2
%7|1594908245.874|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DescribeAcls (29) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey CreateAcls (30) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DeleteAcls (31) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DescribeConfigs (32) Versions 0..2
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey AlterConfigs (33) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey AlterReplicaLogDirs (34) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DescribeLogDirs (35) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey SaslAuthenticate (36) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey CreatePartitions (37) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey CreateDelegationToken (38) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey RenewDelegationToken (39) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey ExpireDelegationToken (40) Versions 0..1
%7|1594908245.877|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DescribeDelegationToken (41) Versions 0..1
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey DeleteGroups (42) Versions 0..1
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Unknown-43? (43) Versions 0..0
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: ApiKey Unknown-44? (44) Versions 0..0
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature MsgVer1: Produce (2..2) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature MsgVer1: Fetch (2..2) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature MsgVer1
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature MsgVer2: Produce (3..3) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature MsgVer2: Fetch (4..4) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature MsgVer2
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature ApiVersion: ApiVersion (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature ApiVersion
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerGroupCoordinator: FindCoordinator (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature BrokerGroupCoordinator
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: FindCoordinator (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature BrokerBalancedConsumer
%7|1594908245.878|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature ThrottleTime: Produce (1..2) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature ThrottleTime: Fetch (1..2) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature ThrottleTime
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature Sasl: JoinGroup (0..0) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature Sasl
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature SaslHandshake: SaslHandshake (0..0) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature SaslHandshake
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature LZ4: FindCoordinator (0..0) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature LZ4
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature OffsetTime: Offset (1..1) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature OffsetTime
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature IdempotentProducer: InitProducerId (0..0) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature IdempotentProducer
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature ZSTD: Produce (7..7) supported by broker
%7|1594908245.879|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature ZSTD: Fetch (10..10) supported by broker
%7|1594908245.880|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature ZSTD
%7|1594908245.880|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature SaslAuthReq: SaslHandshake (1..1) supported by broker
%7|1594908245.880|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Feature SaslAuthReq: SaslAuthenticate (0..0) supported by broker
%7|1594908245.880|APIVERSION|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Enabling feature SaslAuthReq
%7|1594908245.880|STATE|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker changed state APIVERSION_QUERY -> UP
%7|1594908245.880|BROADCAST|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Broadcasting state change
%7|1594908245.880|METADATA|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Skipping metadata refresh of 1 topic(s): connected: already being requested
%7|1594908360.596|METADATA|rdkafka#consumer-2| [thrd:main]: Requesting metadata for 1/1 topics: periodic topic and broker list refresh
%7|1594908360.597|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Request metadata for 1 topic(s): periodic topic and broker list refresh
%7|1594908360.597|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent MetadataRequest (v2, 31 bytes @ 0, CorrId 13189)
%7|1594908360.601|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received MetadataResponse (v2, 153 bytes, CorrId 13189, rtt 3.74ms)
%7|1594908360.602|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ===== Received metadata (for 1 requested topics): periodic topic and broker list refresh =====
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ClusterId: n05vTLn3R0qdkQZQ235wTQ, ControllerId: 1001
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1 brokers, 1 topics
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Broker #0/1: localhost:9092 NodeId 1001
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Topic #0/1: test with 1 partitions
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: Topic test partition 0 Leader 1001
%7|1594908360.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1/1 requested topic(s) seen in metadata
%7|1594908660.597|METADATA|rdkafka#consumer-2| [thrd:main]: Requesting metadata for 1/1 topics: periodic topic and broker list refresh
%7|1594908660.597|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Request metadata for 1 topic(s): periodic topic and broker list refresh
%7|1594908660.598|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent MetadataRequest (v2, 31 bytes @ 0, CorrId 13190)
%7|1594908660.602|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received MetadataResponse (v2, 153 bytes, CorrId 13190, rtt 4.12ms)
%7|1594908660.602|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ===== Received metadata (for 1 requested topics): periodic topic and broker list refresh =====
%7|1594908660.602|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ClusterId: n05vTLn3R0qdkQZQ235wTQ, ControllerId: 1001
%7|1594908660.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1 brokers, 1 topics
%7|1594908660.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Broker #0/1: localhost:9092 NodeId 1001
%7|1594908660.603|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Topic #0/1: test with 1 partitions
%7|1594908660.603|METADATA|rdkafka#consumer-2| [thrd:main]: Topic test partition 0 Leader 1001
%7|1594908660.604|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1/1 requested topic(s) seen in metadata
%7|1594908844.966|BROKERFAIL|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator: failed: err: Local: Broker transport failure: (errno: Connection reset by peer)
%7|1594908844.967|FAIL|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator: Disconnected (after 602775ms in state UP)
%7|1594908844.967|STATE|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator: Broker changed state UP -> DOWN
%7|1594908844.967|BROADCAST|rdkafka#consumer-2| [thrd:GroupCoordinator]: Broadcasting state change
%7|1594908844.967|BUFQ|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator/1001: Purging bufq with 0 buffers
%7|1594908844.967|BUFQ|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator/1001: Purging bufq with 0 buffers
%7|1594908844.967|BUFQ|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator/1001: Updating 0 buffers on connection reset
%7|1594908844.967|METADATA|rdkafka#consumer-2| [thrd:GroupCoordinator]: Requesting metadata for 1/1 topics: broker down
%7|1594908844.967|METADATA|rdkafka#consumer-2| [thrd:GroupCoordinator]: localhost:9092/1001: Request metadata for 1 topic(s): broker down
%7|1594908844.967|STATE|rdkafka#consumer-2| [thrd:GroupCoordinator]: GroupCoordinator: Broker changed state DOWN -> INIT
%7|1594908844.968|BROADCAST|rdkafka#consumer-2| [thrd:GroupCoordinator]: Broadcasting state change
%7|1594908844.968|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent MetadataRequest (v2, 31 bytes @ 0, CorrId 13191)
%7|1594908844.974|CGRPSTATE|rdkafka#consumer-2| [thrd:main]: Group "0" changed state up -> query-coord (v5, join-state init)
%7|1594908844.974|BROADCAST|rdkafka#consumer-2| [thrd:main]: Broadcasting state change
%7|1594908844.974|CGRPQUERY|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0": querying for coordinator: intervaled in state query-coord
%7|1594908844.974|CGRPSTATE|rdkafka#consumer-2| [thrd:main]: Group "0" changed state query-coord -> wait-coord (v5, join-state init)
%7|1594908844.974|BROADCAST|rdkafka#consumer-2| [thrd:main]: Broadcasting state change
%7|1594908844.976|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent FindCoordinatorRequest (v2, 25 bytes @ 0, CorrId 13192)
%7|1594908844.982|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received MetadataResponse (v2, 153 bytes, CorrId 13191, rtt 12.73ms)
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ===== Received metadata (for 1 requested topics): broker down =====
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ClusterId: n05vTLn3R0qdkQZQ235wTQ, ControllerId: 1001
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1 brokers, 1 topics
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Broker #0/1: localhost:9092 NodeId 1001
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Topic #0/1: test with 1 partitions
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: Topic test partition 0 Leader 1001
%7|1594908844.983|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1/1 requested topic(s) seen in metadata
%7|1594908844.988|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received FindCoordinatorResponse (v2, 88 bytes, CorrId 13192, rtt 12.27ms)
%7|1594908844.988|CGRPCOORD|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0" coordinator is localhost:9092 id 1001
%7|1594908844.988|CGRPSTATE|rdkafka#consumer-2| [thrd:main]: Group "0" changed state wait-coord -> wait-broker-transport (v5, join-state init)
%7|1594908844.988|BROADCAST|rdkafka#consumer-2| [thrd:main]: Broadcasting state change
%7|1594908845.871|BROKERFAIL|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: failed: err: Local: Broker transport failure: (errno: Connection reset by peer)
%7|1594908845.871|FAIL|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Disconnected (after 599990ms in state UP)
%7|1594908845.871|STATE|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker changed state UP -> DOWN
%7|1594908845.871|BROADCAST|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Broadcasting state change
%7|1594908845.871|BUFQ|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Purging bufq with 0 buffers
%7|1594908845.871|BUFQ|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Purging bufq with 0 buffers
%7|1594908845.871|BUFQ|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Updating 0 buffers on connection reset
%7|1594908845.871|METADATA|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Requesting metadata for 1/1 topics: broker down
%7|1594908845.871|METADATA|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/1001: Request metadata for 1 topic(s): broker down
%7|1594908845.871|STATE|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: localhost:9092/bootstrap: Broker changed state DOWN -> INIT
%7|1594908845.871|BROADCAST|rdkafka#consumer-2| [thrd:localhost:9092/bootstrap]: Broadcasting state change
%7|1594908845.872|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent MetadataRequest (v2, 31 bytes @ 0, CorrId 13193)
%7|1594908845.876|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received MetadataResponse (v2, 153 bytes, CorrId 13193, rtt 4.91ms)
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ===== Received metadata (for 1 requested topics): broker down =====
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: ClusterId: n05vTLn3R0qdkQZQ235wTQ, ControllerId: 1001
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1 brokers, 1 topics
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Broker #0/1: localhost:9092 NodeId 1001
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Topic #0/1: test with 1 partitions
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: Topic test partition 0 Leader 1001
%7|1594908845.877|METADATA|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: 1/1 requested topic(s) seen in metadata
%7|1594908845.976|CGRPQUERY|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0": querying for coordinator: intervaled in state wait-broker-transport
%7|1594908845.977|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent FindCoordinatorRequest (v2, 25 bytes @ 0, CorrId 13194)
%7|1594908846.018|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received FindCoordinatorResponse (v2, 88 bytes, CorrId 13194, rtt 40.71ms)
%7|1594908846.018|CGRPCOORD|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0" coordinator is localhost:9092 id 1001
%7|1594908846.977|CGRPQUERY|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0": querying for coordinator: intervaled in state wait-broker-transport
%7|1594908846.977|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent FindCoordinatorRequest (v2, 25 bytes @ 0, CorrId 13195)
%7|1594908846.984|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received FindCoordinatorResponse (v2, 88 bytes, CorrId 13195, rtt 7.08ms)
%7|1594908846.985|CGRPCOORD|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0" coordinator is localhost:9092 id 1001
%7|1594908847.977|CGRPQUERY|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0": querying for coordinator: intervaled in state wait-broker-transport
%7|1594908847.977|SEND|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Sent FindCoordinatorRequest (v2, 25 bytes @ 0, CorrId 13196)
%7|1594908847.983|RECV|rdkafka#consumer-2| [thrd:-kafka-0.localhost.default.svc.cluster.lo]: localhost:9092/1001: Received FindCoordinatorResponse (v2, 88 bytes, CorrId 13196, rtt 5.66ms)
%7|1594908847.983|CGRPCOORD|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0" coordinator is localhost:9092 id 1001
%7|1594908848.977|CGRPQUERY|rdkafka#consumer-2| [thrd:main]: localhost:9092/1001: Group "0": querying for coordinator: intervaled in state wait-broker-transport
--
This message was sent by Atlassian Jira
(v8.3.4#803005)