[jira] [Commented] (SPARK-24757) Improve error message for broadcast timeouts

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16535817#comment-16535817 ] 

Apache Spark commented on SPARK-24757:
--------------------------------------

User 'MaxGekk' has created a pull request for this issue:
https://github.com/apache/spark/pull/21727

> Improve error message for broadcast timeouts
> --------------------------------------------
>
>                 Key: SPARK-24757
>                 URL: https://issues.apache.org/jira/browse/SPARK-24757
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.3.1
>            Reporter: Maxim Gekk
>            Priority: Trivial
>
> Currently, the TimeoutException that is thrown on broadcast joins doesn't give any clues to user how to resolve the issue. Need to provide such help to users by pointing out two config parameters: *spark.sql.broadcastTimeout* and *spark.sql.autoBroadcastJoinThreshold*.
> The ticket aims to handle the TimeoutException there: https://github.com/apache/spark/blob/b7a036b75b8a1d287ac014b85e90d555753064c9/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/BroadcastExchangeExec.scala#L143



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org