You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mark Payne (Jira)" <ji...@apache.org> on 2021/03/23 17:53:00 UTC
[jira] [Created] (NIFI-8357) ConsumeKafka(Record)_2_0,
ConsumeKafka(Record)_2_6 do not reconnect if using statically assigned
partitions
Mark Payne created NIFI-8357:
--------------------------------
Summary: ConsumeKafka(Record)_2_0, ConsumeKafka(Record)_2_6 do not reconnect if using statically assigned partitions
Key: NIFI-8357
URL: https://issues.apache.org/jira/browse/NIFI-8357
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Reporter: Mark Payne
Assignee: Mark Payne
Fix For: 1.14.0
If using statically assigned partitions in ConsumeKafka_2_0, ConsumeKafkaRecord_2_0, ConsumeKafka_2_6, or ConsumeKafkaRecord_2_6 (via adding {{partitions.}}{{<hostname}}> properties), when a client connection fails, it recreates connections but does not properly assign the partitions. As a result, the consumer stops consuming data from its partition(s), and the Kafka client that gets created gets leaked. This can slowly build up to leaking many of these connections and potentially could exhaust heap or cause IOException: too many open files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)