You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/31 10:20:00 UTC
[jira] [Commented] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query
[ https://issues.apache.org/jira/browse/SPARK-37797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467183#comment-17467183 ]
ramakrishna chilaka commented on SPARK-37797:
---------------------------------------------
[~hyukjin.kwon] Can you please check this. Thanks.
> Spark Thrift Server's query timeout doesn't cancel the synchronous query
> -------------------------------------------------------------------------
>
> Key: SPARK-37797
> URL: https://issues.apache.org/jira/browse/SPARK-37797
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: ramakrishna chilaka
> Priority: Major
>
> override protected def cleanup(): Unit = {
> if (runInBackground) {
> val backgroundHandle = getBackgroundHandle()
> if (backgroundHandle != null) {
> logInfo("NFER: background handle is " + backgroundHandle.toString)
> backgroundHandle.cancel(true)
> } else {
> logInfo("NFER: background handle is null")
> }
> } else {
> logInfo("NFER: not running in background")
> }
> // RDDs will be cleaned automatically upon garbage collection.
> if (statementId != null) {
> sqlContext.sparkContext.cancelJobGroup(statementId)
> }
> }
> ^^^ cleanup only happens when the thread is running in the background. sync queries are not executed in background.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org