You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/31 10:20:00 UTC

[jira] [Commented] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query

    [ https://issues.apache.org/jira/browse/SPARK-37797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467183#comment-17467183 ] 

ramakrishna chilaka commented on SPARK-37797:
---------------------------------------------

[~hyukjin.kwon] Can you please check this. Thanks.

> Spark Thrift Server's query timeout doesn't cancel the synchronous query 
> -------------------------------------------------------------------------
>
>                 Key: SPARK-37797
>                 URL: https://issues.apache.org/jira/browse/SPARK-37797
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.2.0
>            Reporter: ramakrishna chilaka
>            Priority: Major
>
> override protected def cleanup(): Unit = {
>     if (runInBackground) {
>       val backgroundHandle = getBackgroundHandle()
>       if (backgroundHandle != null) {
>         logInfo("NFER: background handle is " + backgroundHandle.toString)
>         backgroundHandle.cancel(true)
>       } else {
>         logInfo("NFER: background handle is null")
>       }
>     } else {
>       logInfo("NFER: not running in background")
>     }
>     // RDDs will be cleaned automatically upon garbage collection.
>     if (statementId != null) {
>       sqlContext.sparkContext.cancelJobGroup(statementId)
>     }
>   }
> ^^^ cleanup only happens when the thread is running in the background. sync queries are not executed in background.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org