You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "John Roesler (JIRA)" <ji...@apache.org> on 2018/08/13 20:00:02 UTC
[jira] [Updated] (KAFKA-7284) Producer getting fenced may cause
Streams to shut down
[ https://issues.apache.org/jira/browse/KAFKA-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Roesler updated KAFKA-7284:
--------------------------------
Issue Type: Bug (was: Improvement)
> Producer getting fenced may cause Streams to shut down
> ------------------------------------------------------
>
> Key: KAFKA-7284
> URL: https://issues.apache.org/jira/browse/KAFKA-7284
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 2.0.0
> Reporter: John Roesler
> Assignee: John Roesler
> Priority: Critical
>
> As part of the investigation, I will determine what other versions are affected.
>
> In StreamTask, we catch a `ProducerFencedException` and throw a `TaskMigratedException`. However, in this case, the `RecordCollectorImpl` is throwing a `StreamsException`, caused by `KafkaException` caused by `ProducerFencedException`.
> In response to a TaskMigratedException, we would rebalance, but when we get a StreamsException, streams shuts itself down.
> In other words, we intended to do a rebalance in response to a producer fence, but actually, we shut down (when the fence happens inside the record collector).
> Coincidentally, Guozhang noticed and fixed this in a recent PR: [https://github.com/apache/kafka/pull/5428/files#diff-4e5612eeba09dabf30d0b8430f269ff6]
>
> The scope of this ticket is to extract that fix and associated tests, and send a separate PR to trunk and 2.0, and also to determine what other versions, if any, are affected.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)