You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2018/05/07 03:29:00 UTC

[jira] [Created] (FLINK-9303) Unassign partitions from Kafka client if partitions become unavailable

Tzu-Li (Gordon) Tai created FLINK-9303:
------------------------------------------

             Summary: Unassign partitions from Kafka client if partitions become unavailable
                 Key: FLINK-9303
                 URL: https://issues.apache.org/jira/browse/FLINK-9303
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
            Reporter: Tzu-Li (Gordon) Tai
             Fix For: 1.6.0


Originally reported in ML:
[http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dynamically-deleting-kafka-topics-does-not-remove-partitions-from-kafkaConsumer-td19946.html]

The problem is that the Kafka consumer has no notion of "closed" partitions at the moment, so statically assigned partitions to the Kafka client is never removed and is always continuously requested for records.

This causes LOG noises as reported in the reported mail thread.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)