You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Eugene Koifman (Jira)" <ji...@apache.org> on 2021/12/23 01:18:00 UTC

[jira] [Created] (SPARK-37717) Improve logging in BroadcastExchangeExec

Eugene Koifman created SPARK-37717:
--------------------------------------

             Summary: Improve logging in BroadcastExchangeExec
                 Key: SPARK-37717
                 URL: https://issues.apache.org/jira/browse/SPARK-37717
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.6
            Reporter: Eugene Koifman


The logging and errors from inside
{code:java}

override lazy val relationFuture: Future[broadcast.Broadcast[Any]] = {
  SQLExecution.withThreadLocalCaptured[broadcast.Broadcast[Any]](
    session, BroadcastExchangeExec.executionContext) {
        try {
.....
        } {code}
are hard to relate to the right join in a plan with lost of Broadcast joins.
Spark UI displays {noformat}BroadcastExchangeExec.runId{noformat} but it's not in the logs.




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org