You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Victor van den Hoven (Jira)" <ji...@apache.org> on 2021/06/29 07:51:00 UTC
[jira] [Updated] (KAFKA-13009) Metrics recorder is re-initialised
with different task
[ https://issues.apache.org/jira/browse/KAFKA-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Victor van den Hoven updated KAFKA-13009:
-----------------------------------------
Description:
When starting my Kafka Stream application, I get in the Logs:
[SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED[SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED2021-06-29 07:35:58.258 ERROR 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Encountered the following exception during processing and the thread is going to shut down:
java.lang.IllegalStateException: Metrics recorder is re-initialised with different task: previous task is -1_-1 whereas current task is 0_1. *{color:#FF0000}This is a bug in Kafka Streams. Please open a bug report under [https://issues.apache.org/jira/projects/KAFKA/issues] at{color}* org.apache.kafka.streams.state.internals.metrics.RocksDBMetricsRecorder.init(RocksDBMetricsRecorder.java:137) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:252) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:74) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.lambda$init$1(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:883) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.init(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.ProcessorStateManager.registerStateStores(ProcessorStateManager.java:201) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StateManagerUtil.registerStateStores(StateManagerUtil.java:103) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StandbyTask.initializeIfNeeded(StandbyTask.java:93) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.TaskManager.tryToCompleteRestoration(TaskManager.java:473) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.initializeAndRestorePhase(StreamThread.java:728) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:625) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:553) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:512) ~[kafka-streams-2.7.0.jar!/:na]
2021-06-29 07:35:58.259 INFO 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from PARTITIONS_ASSIGNED to PENDING_SHUTDOWN2021-06-29 07:35:58.259 INFO 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Shutting down
After this the application shuts down!
was:
When starting my Kafka Stream application, I get in the Logs:
[SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED[SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED2021-06-29 07:35:58.258 ERROR 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Encountered the following exception during processing and the thread is going to shut down:
java.lang.IllegalStateException: Metrics recorder is re-initialised with different task: previous task is -1_-1 whereas current task is 0_1. This is a bug in Kafka Streams. Please open a bug report under https://issues.apache.org/jira/projects/KAFKA/issues at org.apache.kafka.streams.state.internals.metrics.RocksDBMetricsRecorder.init(RocksDBMetricsRecorder.java:137) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:252) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:74) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.lambda$init$1(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:883) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.init(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.ProcessorStateManager.registerStateStores(ProcessorStateManager.java:201) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StateManagerUtil.registerStateStores(StateManagerUtil.java:103) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StandbyTask.initializeIfNeeded(StandbyTask.java:93) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.TaskManager.tryToCompleteRestoration(TaskManager.java:473) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.initializeAndRestorePhase(StreamThread.java:728) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:625) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:553) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:512) ~[kafka-streams-2.7.0.jar!/:na]
2021-06-29 07:35:58.259 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from PARTITIONS_ASSIGNED to PENDING_SHUTDOWN2021-06-29 07:35:58.259 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Shutting down
After this the application shuts down!
> Metrics recorder is re-initialised with different task
> ------------------------------------------------------
>
> Key: KAFKA-13009
> URL: https://issues.apache.org/jira/browse/KAFKA-13009
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 2.7.0
> Environment: Docker container
> Reporter: Victor van den Hoven
> Priority: Major
>
> When starting my Kafka Stream application, I get in the Logs:
>
> [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED[SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED2021-06-29 07:35:58.258 ERROR 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Encountered the following exception during processing and the thread is going to shut down:
> java.lang.IllegalStateException: Metrics recorder is re-initialised with different task: previous task is -1_-1 whereas current task is 0_1. *{color:#FF0000}This is a bug in Kafka Streams. Please open a bug report under [https://issues.apache.org/jira/projects/KAFKA/issues] at{color}* org.apache.kafka.streams.state.internals.metrics.RocksDBMetricsRecorder.init(RocksDBMetricsRecorder.java:137) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:252) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:74) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:55) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.lambda$init$1(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:883) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.init(MeteredKeyValueStore.java:120) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.ProcessorStateManager.registerStateStores(ProcessorStateManager.java:201) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StateManagerUtil.registerStateStores(StateManagerUtil.java:103) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StandbyTask.initializeIfNeeded(StandbyTask.java:93) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.TaskManager.tryToCompleteRestoration(TaskManager.java:473) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.initializeAndRestorePhase(StreamThread.java:728) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:625) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:553) ~[kafka-streams-2.7.0.jar!/:na] at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:512) ~[kafka-streams-2.7.0.jar!/:na]
> 2021-06-29 07:35:58.259 INFO 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] State transition from PARTITIONS_ASSIGNED to PENDING_SHUTDOWN2021-06-29 07:35:58.259 INFO 1 — [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [SmartMeterActionService-e0d0f403-87c7-4502-b1be-875d544899e2-StreamThread-1] Shutting down
>
> After this the application shuts down!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)