You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/02/07 11:34:00 UTC

[jira] [Commented] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

    [ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488049#comment-17488049 ] 

Apache Spark commented on SPARK-38129:
--------------------------------------

User 'weixiuli' has created a pull request for this issue:
https://github.com/apache/spark/pull/35425

> Adaptively enable timeout for BroadcastQueryStageExec
> -----------------------------------------------------
>
>                 Key: SPARK-38129
>                 URL: https://issues.apache.org/jira/browse/SPARK-38129
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.2.0, 3.2.1
>            Reporter: weixiuli
>            Priority: Major
>
> We should disable timeout for BroadcastQueryStageExec when it comes from shuffle query stages which runtime statistics are usually correct in AQE, but should enable timeout for it when it comes from others which statistics may be incorrect, and keep it the same as non-AQE.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org