You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Burak Yavuz (JIRA)" <ji...@apache.org> on 2017/02/28 22:03:45 UTC

[jira] [Created] (SPARK-19774) StreamExecution should call stop() on sources when a stream fails

Burak Yavuz created SPARK-19774:
-----------------------------------

             Summary: StreamExecution should call stop() on sources when a stream fails
                 Key: SPARK-19774
                 URL: https://issues.apache.org/jira/browse/SPARK-19774
             Project: Spark
          Issue Type: Bug
          Components: Structured Streaming
    Affects Versions: 2.1.0, 2.0.2
            Reporter: Burak Yavuz
            Assignee: Burak Yavuz


We call stop() on a Structured Streaming Source only when the stream is shutdown when a user calls streamingQuery.stop(). We should actually stop all sources when the stream fails as well, otherwise we may leak resources, e.g. connections to Kafka.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org