You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Yogesh BG (JIRA)" <ji...@apache.org> on 2017/06/30 11:10:00 UTC
[jira] [Commented] (KAFKA-5545) Kafka Stream not able to
successfully restart over new broker ip
[ https://issues.apache.org/jira/browse/KAFKA-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069923#comment-16069923 ]
Yogesh BG commented on KAFKA-5545:
----------------------------------
11:03:08.216 [pool-1-thread-1] INFO o.a.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.1
11:03:08.216 [pool-1-thread-1] INFO o.a.kafka.common.utils.AppInfoParser - Kafka commitId : e89bffd6b2eff799
11:03:08.216 [pool-1-thread-1] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] State transition from NOT_RUNNING to RUNNING.
11:03:08.216 [pool-1-thread-1] INFO n.a.a.k.t.KStreamTopologyBase - cleanup the kafka streams : oldBootstrap[10.16.0.38:9092] newBootStrap[10.16.0.39:9092].CREATED
11:03:08.218 [pool-1-thread-1] INFO n.a.a.k.t.KStreamTopologyBase - cleanedup the kafka streams : oldBootstrap[10.16.0.38:9092] newBootStrap[10.16.0.39:9092].CREATED
11:03:08.218 [pool-1-thread-1] INFO n.a.a.k.t.KStreamTopologyBase - Completed restart of kafka streams connection to new broker with configuration {pr-metric-enrichment-proc.schedule_interval=5000, metrics-store-proc.trackFailed=true, commit.interval.ms=10000, metrics-store-proc.accumulateBatchRequests=false, pr-metric-kstream-source.useSecurePort=false, metrics-store-proc.maxBatchSizeBytes=5242880, poll.ms=100, pr-metric-kstream-source.vipAddress=metrics-ingestor.analytics.default.16012014.appcito.net, metrics-store-proc.schedule_interval=5000, application.id=rtp-kafkastreams, metrics-store-proc.useSecurePort=false, pr-metric-enrichment-proc.skipKStreamProcess=false, value.serde=class org.apache.kafka.common.serialization.Serdes$ByteBufferSerde, metrics-store-proc.shutdownAwaitSecs=300, state.dir=/data/kstreams, metrics-store-proc.numExecuteConcurrency=16, metrics-store-proc.separateDataStoreThread=true, metrics-store-proc.maxBatchPendingFactor=12, auto.offset.reset=latest, metrics-store-proc.retryFailed=false, metrics-store-proc.maxBatchSize=5000, bootstrap.servers=10.16.0.39:9092, max.poll.records=100, session.timeout.ms=300000, pr-metric-kstream-source.kafka.queue=PR, client.id=ks_0_inst, metrics-store-proc.elastic.search.cluster=metrics-datastore, heartbeat.interval.ms=60000, num.stream.threads=16, metrics-store-proc.writeTimeoutSecs=30, key.serde=class org.apache.kafka.common.serialization.Serdes$StringSerde, metrics-store-proc.vipAddress=metrics-store.analytics.default.16012014.appcito.net, num.standby.replicas=1, metrics-store-proc.maxBatchInterval=5, metrics-store-proc.logFailed=true}
11:03:08.325 [Thread-6] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from CREATED to RUNNING.
11:03:08.333 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Starting
11:03:08.333 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Starting
11:03:08.350 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Starting
11:03:08.351 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Starting
11:03:08.351 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Starting
11:03:08.351 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Starting
11:03:08.351 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Starting
11:03:08.351 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Starting
11:03:08.354 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Starting
11:03:08.354 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Starting
11:03:08.355 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Starting
11:03:08.355 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Starting
11:03:08.355 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Starting
11:03:08.355 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Starting
11:03:08.355 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Starting
11:03:08.355 [Thread-6] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] Started Kafka Stream process
11:03:08.360 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Starting
11:03:08.363 [StreamThread-33] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.375 [StreamThread-33] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.375 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.375 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.375 [StreamThread-33] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from RUNNING to REBALANCING.
11:03:08.375 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Updating suspended tasks to contain active tasks []
11:03:08.375 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Removing all active tasks []
11:03:08.375 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Removing all standby tasks []
11:03:08.375 [StreamThread-33] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.376 [StreamThread-38] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.378 [StreamThread-37] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.378 [StreamThread-39] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.379 [StreamThread-36] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.380 [StreamThread-35] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.385 [StreamThread-41] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.387 [StreamThread-38] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.387 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.387 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.387 [StreamThread-38] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.387 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Updating suspended tasks to contain active tasks []
11:03:08.392 [StreamThread-35] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.392 [StreamThread-39] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.393 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.393 [StreamThread-37] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.393 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.393 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.393 [StreamThread-39] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.393 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.393 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Updating suspended tasks to contain active tasks []
11:03:08.393 [StreamThread-37] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.393 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Removing all active tasks []
11:03:08.393 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Updating suspended tasks to contain active tasks []
11:03:08.393 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Removing all standby tasks []
11:03:08.393 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Removing all active tasks []
11:03:08.393 [StreamThread-39] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.393 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Removing all standby tasks []
11:03:08.394 [StreamThread-37] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.392 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.394 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.394 [StreamThread-35] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.395 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Updating suspended tasks to contain active tasks []
11:03:08.395 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Removing all active tasks []
11:03:08.395 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Removing all standby tasks []
11:03:08.396 [StreamThread-35] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.396 [StreamThread-36] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.396 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.396 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.396 [StreamThread-36] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.396 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Updating suspended tasks to contain active tasks []
11:03:08.396 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Removing all active tasks []
11:03:08.397 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Removing all standby tasks []
11:03:08.397 [StreamThread-36] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.398 [StreamThread-41] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.398 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.399 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.399 [StreamThread-41] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.399 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Updating suspended tasks to contain active tasks []
11:03:08.399 [StreamThread-34] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.399 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Removing all active tasks []
11:03:08.400 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Removing all standby tasks []
11:03:08.400 [StreamThread-41] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.403 [StreamThread-34] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.404 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.404 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.404 [StreamThread-34] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.404 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Updating suspended tasks to contain active tasks []
11:03:08.404 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Removing all active tasks []
11:03:08.404 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Removing all standby tasks []
11:03:08.405 [StreamThread-34] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.412 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Removing all active tasks []
11:03:08.412 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Removing all standby tasks []
11:03:08.412 [StreamThread-38] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.416 [StreamThread-47] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.421 [StreamThread-43] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.429 [StreamThread-48] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.430 [StreamThread-47] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.430 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.430 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.430 [StreamThread-47] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.430 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Updating suspended tasks to contain active tasks []
11:03:08.430 [StreamThread-40] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.430 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Removing all active tasks []
11:03:08.431 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Removing all standby tasks []
11:03:08.431 [StreamThread-42] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.431 [StreamThread-47] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.433 [StreamThread-44] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.435 [StreamThread-45] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.435 [StreamThread-46] INFO o.a.k.c.c.i.AbstractCoordinator - Discovered coordinator 10.16.0.39:9092 (id: 2147483647 rack: null) for group rtp-kafkastreams.
11:03:08.443 [StreamThread-48] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.443 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.443 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.443 [StreamThread-48] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.443 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Updating suspended tasks to contain active tasks []
11:03:08.443 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Removing all active tasks []
11:03:08.444 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Removing all standby tasks []
11:03:08.444 [StreamThread-48] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.447 [StreamThread-43] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.447 [StreamThread-43] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Updating suspended tasks to contain active tasks []
11:03:08.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Removing all active tasks []
11:03:08.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Removing all standby tasks []
11:03:08.447 [StreamThread-43] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.455 [StreamThread-46] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.455 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.456 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.456 [StreamThread-46] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.456 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Updating suspended tasks to contain active tasks []
11:03:08.456 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Removing all active tasks []
11:03:08.456 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Removing all standby tasks []
11:03:08.456 [StreamThread-46] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.463 [StreamThread-42] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.463 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.463 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.463 [StreamThread-42] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.463 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Updating suspended tasks to contain active tasks []
11:03:08.463 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Removing all active tasks []
11:03:08.463 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Removing all standby tasks []
11:03:08.463 [StreamThread-42] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.472 [StreamThread-40] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.472 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.472 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.472 [StreamThread-40] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.472 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Updating suspended tasks to contain active tasks []
11:03:08.472 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Removing all active tasks []
11:03:08.473 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Removing all standby tasks []
11:03:08.473 [StreamThread-40] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.474 [StreamThread-44] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.474 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.474 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.474 [StreamThread-44] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.474 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Updating suspended tasks to contain active tasks []
11:03:08.474 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Removing all active tasks []
11:03:08.474 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Removing all standby tasks []
11:03:08.474 [StreamThread-44] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:08.478 [StreamThread-45] INFO o.a.k.c.c.i.ConsumerCoordinator - Revoking previously assigned partitions [] for group rtp-kafkastreams
11:03:08.478 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance.
11:03:08.478 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] State transition from RUNNING to PARTITIONS_REVOKED.
11:03:08.478 [StreamThread-45] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:08.478 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Updating suspended tasks to contain active tasks []
11:03:08.479 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Removing all active tasks []
11:03:08.479 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Removing all standby tasks []
11:03:08.479 [StreamThread-45] INFO o.a.k.c.c.i.AbstractCoordinator - (Re-)joining group rtp-kafkastreams
11:03:33.403 [StreamThread-44] INFO o.a.k.s.p.i.StreamPartitionAssignor - stream-thread [StreamThread-44] Constructed client metadata {297b62d4-e9f4-445a-9955-7bc3a0a2e73d=ClientMetadata{hostInfo=null, consumers=[ks_0_inst-StreamThread-45-consumer-a78daf41-9442-43b9-bfeb-15813b464196, ks_0_inst-StreamThread-41-consumer-41b087b6-0582-4169-aad6-0c6256b8c9b2, ks_0_inst-StreamThread-48-consumer-81f718cf-3023-4dae-8553-08013fc219dc, ks_0_inst-StreamThread-37-consumer-77a8dddf-1749-45e3-b3bb-97e23ab0b581, ks_0_inst-StreamThread-36-consumer-e516ea51-1d53-4a78-b735-439965a209c5, ks_0_inst-StreamThread-38-consumer-7d03fc3e-c6d5-4f84-a57c-c73844ab20aa, ks_0_inst-StreamThread-43-consumer-133ec3f2-3621-4320-b1de-be223b9d66c1, ks_0_inst-StreamThread-34-consumer-80d24a76-1520-481b-9fc1-3d9581ae8a01, ks_0_inst-StreamThread-47-consumer-cd622da4-61e6-4415-95cb-b55ca89eb65f, ks_0_inst-StreamThread-39-consumer-b6645a07-c963-447f-be4c-dea0c28757b6, ks_0_inst-StreamThread-40-consumer-942d9ed6-24fa-4b0b-8ebb-ae7ce16ba217, ks_0_inst-StreamThread-42-consumer-001e4ec3-20c7-4dcf-90ea-70d86d014bd9, ks_0_inst-StreamThread-33-consumer-b582c44a-2f47-428c-9a43-bdcc6f7e2d34, ks_0_inst-StreamThread-46-consumer-349e56a4-c31d-437d-8a40-e86bde3186f3, ks_0_inst-StreamThread-35-consumer-2e4f4d27-5098-41cf-a730-dc157bd4d4a1, ks_0_inst-StreamThread-44-consumer-46fb1f72-3c33-4c75-8239-165d19ca1742], state=[activeTasks: ([]) assignedTasks: ([]) prevActiveTasks: ([]) prevAssignedTasks: ([]) capacity: 16.0 cost: 0.0]}} from the member subscriptions.
11:03:33.404 [StreamThread-44] INFO o.a.k.s.p.i.StreamPartitionAssignor - stream-thread [StreamThread-44] Completed validating internal topics in partition assignor
11:03:33.404 [StreamThread-44] INFO o.a.k.s.p.i.StreamPartitionAssignor - stream-thread [StreamThread-44] Completed validating internal topics in partition assignor
11:03:33.405 [StreamThread-44] INFO o.a.k.s.p.i.StreamPartitionAssignor - stream-thread [StreamThread-44] Assigned tasks to clients as {297b62d4-e9f4-445a-9955-7bc3a0a2e73d=[activeTasks: ([0_0, 0_1, 0_2, 0_3, 0_4, 0_5, 0_6, 0_7]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4, 0_5, 0_6, 0_7]) prevActiveTasks: ([]) prevAssignedTasks: ([]) capacity: 16.0 cost: 4.0]}.
11:03:33.421 [StreamThread-44] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.421 [StreamThread-48] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.421 [StreamThread-44] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.421 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.421 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.421 [StreamThread-48] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-2] for group rtp-kafkastreams
11:03:33.422 [StreamThread-44] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.422 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] at state PARTITIONS_REVOKED: new partitions [PR-2] assigned at the end of consumer rebalance.
11:03:33.424 [StreamThread-41] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.424 [StreamThread-37] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.424 [StreamThread-45] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.424 [StreamThread-40] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.424 [StreamThread-46] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.426 [StreamThread-35] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.426 [StreamThread-39] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.424 [StreamThread-42] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.426 [StreamThread-33] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.429 [StreamThread-36] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.429 [StreamThread-34] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.430 [StreamThread-38] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.430 [StreamThread-43] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.434 [StreamThread-39] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.430 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.435 [StreamThread-35] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.434 [StreamThread-46] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.434 [StreamThread-45] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-0] for group rtp-kafkastreams
11:03:33.433 [StreamThread-40] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.436 [StreamThread-36] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-4] for group rtp-kafkastreams
11:03:33.433 [StreamThread-41] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-1] for group rtp-kafkastreams
11:03:33.430 [StreamThread-37] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-3] for group rtp-kafkastreams
11:03:33.430 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.436 [StreamThread-33] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.438 [StreamThread-34] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-7] for group rtp-kafkastreams
11:03:33.438 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.435 [StreamThread-42] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.439 [StreamThread-43] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-6] for group rtp-kafkastreams
11:03:33.435 [StreamThread-47] INFO o.a.k.c.c.i.AbstractCoordinator - Successfully joined group rtp-kafkastreams with generation 125
11:03:33.438 [StreamThread-38] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [PR-5] for group rtp-kafkastreams
11:03:33.440 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.440 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.441 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.440 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] at state PARTITIONS_REVOKED: new partitions [PR-0] assigned at the end of consumer rebalance.
11:03:33.441 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] at state PARTITIONS_REVOKED: new partitions [PR-1] assigned at the end of consumer rebalance.
11:03:33.441 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] at state PARTITIONS_REVOKED: new partitions [PR-3] assigned at the end of consumer rebalance.
11:03:33.441 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] at state PARTITIONS_REVOKED: new partitions [PR-4] assigned at the end of consumer rebalance.
11:03:33.442 [StreamThread-48] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.442 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.442 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.442 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.443 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] at state PARTITIONS_REVOKED: new partitions [PR-6] assigned at the end of consumer rebalance.
11:03:33.444 [StreamThread-47] INFO o.a.k.c.c.i.ConsumerCoordinator - Setting newly assigned partitions [] for group rtp-kafkastreams
11:03:33.444 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] at state PARTITIONS_REVOKED: new partitions [PR-7] assigned at the end of consumer rebalance.
11:03:33.444 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] at state PARTITIONS_REVOKED: new partitions [PR-5] assigned at the end of consumer rebalance.
11:03:33.444 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.445 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.445 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.445 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.445 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.445 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.446 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.446 [StreamThread-39] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.446 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.447 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.446 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.447 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.447 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.447 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] at state PARTITIONS_REVOKED: new partitions [] assigned at the end of consumer rebalance.
11:03:33.449 [StreamThread-36] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.449 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.450 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS.
11:03:33.450 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Creating active task 0_4 with assigned partitions [PR-4]
11:03:33.451 [StreamThread-35] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.451 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Creating active task 0_2 with assigned partitions [PR-2]
11:03:33.452 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.452 [StreamThread-38] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.453 [StreamThread-34] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.453 [StreamThread-42] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.453 [StreamThread-43] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.453 [StreamThread-33] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.453 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.453 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Creating active task 0_6 with assigned partitions [PR-6]
11:03:33.454 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Creating active task 0_7 with assigned partitions [PR-7]
11:03:33.454 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Creating active task 0_5 with assigned partitions [PR-5]
11:03:33.454 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.455 [StreamThread-41] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.455 [StreamThread-37] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.455 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Creating active task 0_1 with assigned partitions [PR-1]
11:03:33.455 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Creating active task 0_3 with assigned partitions [PR-3]
11:03:33.455 [StreamThread-45] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.456 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Creating active task 0_0 with assigned partitions [PR-0]
11:03:33.456 [StreamThread-40] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.456 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.456 [StreamThread-46] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.457 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.457 [StreamThread-47] INFO o.apache.kafka.streams.KafkaStreams - stream-client [ks_0_inst] State transition from REBALANCING to REBALANCING.
11:03:33.457 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] State transition from ASSIGNING_PARTITIONS to RUNNING.
11:03:33.540 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.551 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.558 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.558 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.558 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.558 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.559 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Committing all tasks because the commit interval 10000ms has elapsed
11:03:33.559 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Committing all tasks because the commit interval 10000ms has elapsed
11:03:34.463 [StreamThread-34] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_7. Will retry.
org.apache.kafka.streams.errors.LockException: task [0_7] Failed to lock the state directory for task 0_7
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
11:03:33.441 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] at state PARTITIONS_REVOKED: new partitions [PR-3] assigned at t
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.
jar:na]
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependen
cies.jar:na]
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-depen
dencies.jar:na]
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-depen
dencies.jar:na]
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:n
a]
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
11:03:34.463 [StreamThread-36] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_4. Will retry.
org.apache.kafka.streams.errors.LockException: task [0_4] Failed to lock the state directory for task 0_4
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependenci
es.jar:na]
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na
]
at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencie
s.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-wi
th-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.
jar:na]
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:2
> Kafka Stream not able to successfully restart over new broker ip
> ----------------------------------------------------------------
>
> Key: KAFKA-5545
> URL: https://issues.apache.org/jira/browse/KAFKA-5545
> Project: Kafka
> Issue Type: Bug
> Reporter: Yogesh BG
> Priority: Critical
>
> Hi
> I have one kafka broker and one kafka stream application
> initially kafka stream connected and starts processing data. Then i restart the broker. When broker restarts new ip will be assigned.
> In kafka stream i have a 5min interval thread which checks if broker ip changed and if changed, we cleanup the stream, rebuild topology(tried with reusing topology) and start the stream again. I end up with the following exceptions.
> 11:04:08.032 [StreamThread-38] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-38] Creating active task 0_5 with assigned partitions [PR-5]
> 11:04:08.033 [StreamThread-41] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-41] Creating active task 0_1 with assigned partitions [PR-1]
> 11:04:08.036 [StreamThread-34] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-34] Creating active task 0_7 with assigned partitions [PR-7]
> 11:04:08.036 [StreamThread-37] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-37] Creating active task 0_3 with assigned partitions [PR-3]
> 11:04:08.036 [StreamThread-45] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-45] Creating active task 0_0 with assigned partitions [PR-0]
> 11:04:08.037 [StreamThread-36] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-36] Creating active task 0_4 with assigned partitions [PR-4]
> 11:04:08.037 [StreamThread-43] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-43] Creating active task 0_6 with assigned partitions [PR-6]
> 11:04:08.038 [StreamThread-48] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-48] Creating active task 0_2 with assigned partitions [PR-2]
> 11:04:09.034 [StreamThread-38] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_5. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_5] Failed to lock the state directory for task 0_5
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.035 [StreamThread-41] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_1. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_1] Failed to lock the state directory for task 0_1
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.037 [StreamThread-37] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_3. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_3] Failed to lock the state directory for task 0_3
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.039 [StreamThread-34] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_7. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_7] Failed to lock the state directory for task 0_7
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.039 [StreamThread-43] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_6. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_6] Failed to lock the state directory for task 0_6
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.039 [StreamThread-45] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_0. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_0] Failed to lock the state directory for task 0_0
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.039 [StreamThread-36] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_4. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_4] Failed to lock the state directory for task 0_4
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:09.039 [StreamThread-48] WARN o.a.k.s.p.internals.StreamThread - Could not create task 0_2. Will retry.
> org.apache.kafka.streams.errors.LockException: task [0_2] Failed to lock the state directory for task 0_2
> at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:100) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:73) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:108) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) ~[rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) [rtp-kafkastreams-1.0-SNAPSHOT-jar-with-dependencies.jar:na]
> 11:04:13.642 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Committing all tasks because the commit interval 10000ms has elapsed
> 11:04:13.642 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Committing all tasks because the commit interval 10000ms has elapsed
> 11:04:13.642 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Committing all tasks because the commit interval 10000ms has elapsed
> 11:04:13.642 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Committing all tasks because the commit interval 10000ms has ela
> ]
> psed
> 11:04:13.646 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:13.648 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:13.655 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:13.660 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.663 [StreamThread-42] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-42] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.663 [StreamThread-46] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-46] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.663 [StreamThread-47] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-47] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.663 [StreamThread-44] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-44] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.671 [StreamThread-33] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-33] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.676 [StreamThread-40] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-40] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.677 [StreamThread-39] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-39] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:23.682 [StreamThread-35] INFO o.a.k.s.p.internals.StreamThread - stream-thread [StreamThread-35] Committing all tasks because the commit interval 10000ms has ela
> psed
> 11:04:29.025 [pool-4-thread-1]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)