You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Randall Hauch (JIRA)" <ji...@apache.org> on 2017/11/28 17:52:00 UTC

[jira] [Created] (KAFKA-6279) Connect metrics do not get cleaned up for a source connector that doesn't stop properly

Randall Hauch created KAFKA-6279:
------------------------------------

             Summary: Connect metrics do not get cleaned up for a source connector that doesn't stop properly
                 Key: KAFKA-6279
                 URL: https://issues.apache.org/jira/browse/KAFKA-6279
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
    Affects Versions: 1.0.0
            Reporter: Randall Hauch
            Assignee: Randall Hauch


Connect will call {{stop()}} on a source task to signal that it should "_stop trying to poll for new data 
and interrupt any outstanding poll() requests_" (see the [JavaDoc|http://kafka.apache.org/10/javadoc/org/apache/kafka/connect/source/SourceTask.html#stop--] for this method).

Unfortunately, not all connectors properly adhere to this expectation. Since the metrics for the source task are cleaned up only when the worker source task's thread completes, a task whose {{poll()}} method blocks forever will current prevent its thread from completing. So, we need to change how the metrics are cleaned up to ensure this always happens.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)