You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2020/05/06 18:50:00 UTC
[jira] [Resolved] (KAFKA-8858) Kafka Streams - Failed to Rebalance
Error and stream consumer stuck for some reason
[ https://issues.apache.org/jira/browse/KAFKA-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sophie Blee-Goldman resolved KAFKA-8858.
----------------------------------------
Assignee: Guozhang Wang
Resolution: Duplicate
> Kafka Streams - Failed to Rebalance Error and stream consumer stuck for some reason
> -----------------------------------------------------------------------------------
>
> Key: KAFKA-8858
> URL: https://issues.apache.org/jira/browse/KAFKA-8858
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 2.1.1
> Environment: Apache Kafka 2.1.1
> Reporter: Ante B.
> Assignee: Guozhang Wang
> Priority: Major
> Labels: Stream, consumer, corrupt, offset, rebalance, transactions
>
> I have a basic Kafka Streams application that reads from a {{topic}}, performs a rolling aggregate, and performs a join to publish to an {{agg_topic}}. Our project has the timeout failure in Kafka 2.1.1 env and we don't know the reason yet.
> Our stream consumer stuck for some reason.
> After we changed our group id to another one it became normal. So seems offset data for this consumer is corrupted.
> Can you help us please to resolve this problem to be able to revert us to the previous consumer name because we have many inconveniences due to this.
> Ping me pls if you will need some additional info.
> Our temporary workaround is to disable the {{exactly_once}} config which skips the initializing transactional state. Also offset reseted for corrupted partition, with no effect.
> Full problem description in log:
> {code:java}
> [2019-08-30 14:20:02.168] [abc-streamer-StreamThread-21] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread [abc-streamer-StreamThread-21] Error caught during partition assignment, will abort the current process and re-throw at the end of rebalance: {}
> org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional state in 60000ms.
> [2019-08-30 14:21:35.407] [abc-streamer-StreamThread-14] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread [abc-streamer-StreamThread-14] Error caught during partition assignment, will abort the current process and re-throw at the end of rebalance: {}
> org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional state in 60000ms.
> [2019-08-30 14:22:58.487] [abc-streamer-StreamThread-13] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread [abc-streamer-StreamThread-13] Error caught during partition assignment, will abort the current process and re-throw at the end of rebalance: {}
> org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional state in 60000ms.
> {noformat}
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)