[jira] [Created] (FLINK-10774) connection leak when partition discovery is disabled and open throws exception

["Steven Zhen Wu (JIRA)" <ji...@apache.org>]

Steven Zhen Wu created FLINK-10774:
--------------------------------------

             Summary: connection leak when partition discovery is disabled and open throws exception
                 Key: FLINK-10774
                 URL: https://issues.apache.org/jira/browse/FLINK-10774
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.6.2, 1.5.5, 1.4.2
            Reporter: Steven Zhen Wu
            Assignee: Steven Zhen Wu


Here is the scenario to reproduce the issue
 * partition discovery is disabled
 * open method throws an exception (e.g. when broker SSL authorization denies request)

In this scenario, run method won't be executed. As a result, _partitionDiscoverer.close()_ won't be called. that caused the connection leak, because KafkaConsumer is initialized but not closed. That has caused outage that brought down our Kafka cluster, when a high-parallelism job got into a restart/failure loop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)