You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/07 20:18:00 UTC
[jira] [Resolved] (SPARK-24757) Improve error message for broadcast
timeouts
[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Herman van Hovell resolved SPARK-24757.
---------------------------------------
Resolution: Fixed
Assignee: Maxim Gekk
Fix Version/s: 2.4.0
> Improve error message for broadcast timeouts
> --------------------------------------------
>
> Key: SPARK-24757
> URL: https://issues.apache.org/jira/browse/SPARK-24757
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Maxim Gekk
> Assignee: Maxim Gekk
> Priority: Trivial
> Fix For: 2.4.0
>
>
> Currently, the TimeoutException that is thrown on broadcast joins doesn't give any clues to user how to resolve the issue. Need to provide such help to users by pointing out two config parameters: *spark.sql.broadcastTimeout* and *spark.sql.autoBroadcastJoinThreshold*.
> The ticket aims to handle the TimeoutException there: https://github.com/apache/spark/blob/b7a036b75b8a1d287ac014b85e90d555753064c9/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/BroadcastExchangeExec.scala#L143
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org