You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/06/20 15:35:00 UTC
[jira] [Commented] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556429#comment-17556429 ]
Bruce Robbins commented on SPARK-39525:
---------------------------------------
Just like the GeneratorFunctionSuites issue, when I apply the propose fix for SPARK-39520 ([this PR|https://github.com/apache/spark/pull/36925]), the issue resolves on my laptop.
> AdaptiveQueryExecSuite fails with Scala 2.13
> --------------------------------------------
>
> Key: SPARK-39525
> URL: https://issues.apache.org/jira/browse/SPARK-39525
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> https://github.com/apache/spark/runs/6912247429?check_suite_focus=true
> {code}
> 2022-06-16T05:29:18.0189547Z [0m[[0m[0minfo[0m] [0m[0m[31m- SPARK-36020: Check logical link in remove redundant projects *** FAILED *** (33 milliseconds)[0m[0m
> 2022-06-16T05:29:18.0663300Z [0m[[0m[0minfo[0m] [0m[0m[31m java.lang.RuntimeException: Once strategy's idempotence is broken for batch Infer Filters[0m[0m
> 2022-06-16T05:29:18.0665308Z [0m[[0m[0minfo[0m] [0m[0m[31m Project [key#126270L, c#126279L, key#126280L, c#126291L] Project [key#126270L, c#126279L, key#126280L, c#126291L][0m[0m
> 2022-06-16T05:29:18.0666871Z [0m[[0m[0minfo[0m] [0m[0m[31m +- Join Inner, (key#126270L = key#126280L) +- Join Inner, (key#126270L = key#126280L)[0m[0m
> 2022-06-16T05:29:18.0668143Z [0m[[0m[0minfo[0m] [0m[0m[31m :- Filter isnotnull(key#126270L) :- Filter isnotnull(key#126270L)[0m[0m
> 2022-06-16T05:29:18.0669257Z [0m[[0m[0minfo[0m] [0m[0m[31m : +- Project [c#126279L, key#126270L] : +- Project [c#126279L, key#126270L][0m[0m
> 2022-06-16T05:29:18.0670509Z [0m[[0m[0minfo[0m] [0m[0m[31m : +- Generate explode(c#126273), [1], false, [c#126279L] : +- Generate explode(c#126273), [1], false, [c#126279L][0m[0m
> 2022-06-16T05:29:18.0671748Z [0m[[0m[0minfo[0m] [0m[0m[31m! : +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273)) : +- Filter isnotnull(c#126273)[0m[0m
> 2022-06-16T05:29:18.0673102Z [0m[[0m[0minfo[0m] [0m[0m[31m! : +- Project [(id#126268L % 10) AS key#126270L, array(id#126268L, (id#126268L + 1), (id#126268L + 3)) AS c#126273] : +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))[0m[0m
> 2022-06-16T05:29:18.0674808Z [0m[[0m[0minfo[0m] [0m[0m[31m! : +- Filter (cast((id#126268L * 2) as int) > 1) : +- Project [(id#126268L % 10) AS key#126270L, array(id#126268L, (id#126268L + 1), (id#126268L + 3)) AS c#126273][0m[0m
> 2022-06-16T05:29:18.0676143Z [0m[[0m[0minfo[0m] [0m[0m[31m! : +- Range (0, 10, step=1, splits=Some(2)) : +- Filter (cast((id#126268L * 2) as int) > 1)[0m[0m
> 2022-06-16T05:29:18.0677658Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Filter isnotnull(key#126280L) : +- Range (0, 10, step=1, splits=Some(2))[0m[0m
> 2022-06-16T05:29:18.0678838Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Project [c#126291L, key#126270L AS key#126280L] +- Filter isnotnull(key#126280L)[0m[0m
> 2022-06-16T05:29:18.0680092Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Generate explode(c#126273), [1], false, [c#126291L] +- Project [c#126291L, key#126270L AS key#126280L][0m[0m
> 2022-06-16T05:29:18.0681365Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273)) +- Generate explode(c#126273), [1], false, [c#126291L][0m[0m
> 2022-06-16T05:29:18.0687264Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Project [(id#126290L % 10) AS key#126270L, array(id#126290L, (id#126290L + 1), (id#126290L + 3)) AS c#126273] +- Filter isnotnull(c#126273)[0m[0m
> 2022-06-16T05:29:18.0688660Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Range (0, 10, step=1, splits=Some(2)) +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))[0m[0m
> 2022-06-16T05:29:18.0690609Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Project [(id#126290L % 10) AS key#126270L, array(id#126290L, (id#126290L + 1), (id#126290L + 3)) AS c#126273][0m[0m
> 2022-06-16T05:29:18.0704834Z [0m[[0m[0minfo[0m] [0m[0m[31m! +- Range (0, 10, step=1, splits=Some(2))[0m[0m
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org