You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/07 15:51:00 UTC

[jira] [Created] (SPARK-24757) Improve error message for broadcast timeouts

Maxim Gekk created SPARK-24757:
----------------------------------

             Summary: Improve error message for broadcast timeouts
                 Key: SPARK-24757
                 URL: https://issues.apache.org/jira/browse/SPARK-24757
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: Maxim Gekk


Currently, the TimeoutException that is thrown on broadcast joins doesn't give any clues to user how to resolve the issue. Need to provide such help to users by pointing out two config parameters: *spark.sql.broadcastTimeout* and *spark.sql.autoBroadcastJoinThreshold*.

The ticket aims to handle the TimeoutException there: https://github.com/apache/spark/blob/b7a036b75b8a1d287ac014b85e90d555753064c9/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/BroadcastExchangeExec.scala#L143



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org