You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/08/16 22:50:00 UTC

[jira] [Commented] (SPARK-42962) Allow access to stopped streaming queries

    [ https://issues.apache.org/jira/browse/SPARK-42962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17755295#comment-17755295 ] 

Raghu Angadi commented on SPARK-42962:
--------------------------------------

This is done. Stopped queries are accessible for an hour.

> Allow access to stopped streaming queries
> -----------------------------------------
>
>                 Key: SPARK-42962
>                 URL: https://issues.apache.org/jira/browse/SPARK-42962
>             Project: Spark
>          Issue Type: Task
>          Components: Connect, Structured Streaming
>    Affects Versions: 3.5.0
>            Reporter: Raghu Angadi
>            Priority: Major
>
> In Spark connect, when a query is stopped, the client can't access it anymore. That implies they can not fetch any information about the query after that. 
> The server might have to cache the queries for some time (upto the time the session is closed). 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org