You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/04/02 08:01:00 UTC
[jira] [Assigned] (SPARK-38772) Formatting the log plan in AdaptiveSparkPlanExec
[ https://issues.apache.org/jira/browse/SPARK-38772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-38772:
------------------------------------
Assignee: Apache Spark
> Formatting the log plan in AdaptiveSparkPlanExec
> ------------------------------------------------
>
> Key: SPARK-38772
> URL: https://issues.apache.org/jira/browse/SPARK-38772
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Yuming Wang
> Assignee: Apache Spark
> Priority: Major
>
> {code:java}
> 12:08:36.876 ERROR org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanExec: Plan changed from SortMergeJoin [key#13], [a#23], Inner
> :- Sort [key#13 ASC NULLS FIRST], false, 0
> : +- ShuffleQueryStage 0
> : +- Exchange hashpartitioning(key#13, 5), ENSURE_REQUIREMENTS, [id=#110]
> : +- *(1) Filter (isnotnull(value#14) AND (value#14 = 1))
> : +- *(1) SerializeFromObject [knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData, true])).key AS key#13, staticinvoke(class org.apache.spark.unsafe.types.UTF8String, StringType, fromString, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData, true])).value, true, false, true) AS value#14]
> : +- Scan[obj#12]
> +- Sort [a#23 ASC NULLS FIRST], false, 0
> +- ShuffleQueryStage 1
> +- Exchange hashpartitioning(a#23, 5), ENSURE_REQUIREMENTS, [id=#129]
> +- *(2) SerializeFromObject [knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData2, true])).a AS a#23, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData2, true])).b AS b#24]
> +- Scan[obj#22]
> to BroadcastHashJoin [key#13], [a#23], Inner, BuildLeft, false
> :- BroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, false] as bigint)),false), [id=#145]
> : +- ShuffleQueryStage 0
> : +- Exchange hashpartitioning(key#13, 5), ENSURE_REQUIREMENTS, [id=#110]
> : +- *(1) Filter (isnotnull(value#14) AND (value#14 = 1))
> : +- *(1) SerializeFromObject [knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData, true])).key AS key#13, staticinvoke(class org.apache.spark.unsafe.types.UTF8String, StringType, fromString, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData, true])).value, true, false, true) AS value#14]
> : +- Scan[obj#12]
> +- ShuffleQueryStage 1
> +- Exchange hashpartitioning(a#23, 5), ENSURE_REQUIREMENTS, [id=#129]
> +- *(2) SerializeFromObject [knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData2, true])).a AS a#23, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.test.SQLTestData$TestData2, true])).b AS b#24]
> +- Scan[obj#22]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org