You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Bill Bejeck (JIRA)" <ji...@apache.org> on 2018/07/20 18:24:00 UTC
[jira] [Created] (KAFKA-7190) Under low traffic conditions purging
repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID
Bill Bejeck created KAFKA-7190:
----------------------------------
Summary: Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID
Key: KAFKA-7190
URL: https://issues.apache.org/jira/browse/KAFKA-7190
Project: Kafka
Issue Type: Improvement
Components: core, streams
Affects Versions: 1.1.1, 1.1.0
Reporter: Bill Bejeck
When a streams application has little traffic, then it is possible that consumer purging would delete
even the last message sent by a producer (i.e., all the messages sent by
this producer have been consumed and committed), and as a result, the broker
would delete that producer's ID. The next time when this producer tries to
send, it will get this UNKNOWN_PRODUCER_ID error code, but in this case,
this error is retriable: the producer would just get a new producer id and
retries, and then this time it will succeed.
Possible fixes could be on the broker side, i.e., delaying the deletion of the produderIDs for a more extended period or on the streams side developing a more conservative approach to deleting offsets from repartition topics
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)