You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/04/02 00:35:00 UTC
[jira] [Commented] (SPARK-31324) StreamingQuery stop() timeout
exception should include the stream ID
[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17073273#comment-17073273 ]
Dongjoon Hyun commented on SPARK-31324:
---------------------------------------
Hi, [~mukulmurthy]. Please use the version on `master` branch which is `3.1.0-SNAPSHOT` now. Since this JIRA issue is `Improvement`, Apache Spark doesn't allow backporting.
> StreamingQuery stop() timeout exception should include the stream ID
> --------------------------------------------------------------------
>
> Key: SPARK-31324
> URL: https://issues.apache.org/jira/browse/SPARK-31324
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.1.0
> Reporter: Mukul Murthy
> Priority: Trivial
>
> [https://github.com/apache/spark/pull/26771/|https://github.com/apache/spark/pull/26771/files] added a conf to set a timeout when stop()ing streams; if the stream does not terminate in this time, an exception is thrown. Having hit this issue once in production, it would be nice to have the stream ID in the error message.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org