You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/06/22 10:45:00 UTC

[jira] [Assigned] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

     [ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon reassigned SPARK-39525:
------------------------------------

    Assignee: Bruce Robbins

> AdaptiveQueryExecSuite fails with Scala 2.13
> --------------------------------------------
>
>                 Key: SPARK-39525
>                 URL: https://issues.apache.org/jira/browse/SPARK-39525
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.4.0
>            Reporter: Hyukjin Kwon
>            Assignee: Bruce Robbins
>            Priority: Major
>
> https://github.com/apache/spark/runs/6912247429?check_suite_focus=true
> {code}
> 2022-06-16T05:29:18.0189547Z [info] - SPARK-36020: Check logical link in remove redundant projects *** FAILED *** (33 milliseconds)
> 2022-06-16T05:29:18.0663300Z [info]   java.lang.RuntimeException: Once strategy's idempotence is broken for batch Infer Filters
> 2022-06-16T05:29:18.0665308Z [info]  Project [key#126270L, c#126279L, key#126280L, c#126291L]                                                                          Project [key#126270L, c#126279L, key#126280L, c#126291L]
> 2022-06-16T05:29:18.0666871Z [info]  +- Join Inner, (key#126270L = key#126280L)                                                                                        +- Join Inner, (key#126270L = key#126280L)
> 2022-06-16T05:29:18.0668143Z [info]     :- Filter isnotnull(key#126270L)                                                                                                  :- Filter isnotnull(key#126270L)
> 2022-06-16T05:29:18.0669257Z [info]     :  +- Project [c#126279L, key#126270L]                                                                                            :  +- Project [c#126279L, key#126270L]
> 2022-06-16T05:29:18.0670509Z [info]     :     +- Generate explode(c#126273), [1], false, [c#126279L]                                                                      :     +- Generate explode(c#126273), [1], false, [c#126279L]
> 2022-06-16T05:29:18.0671748Z [info] !   :        +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))                                                           :        +- Filter isnotnull(c#126273)
> 2022-06-16T05:29:18.0673102Z [info] !   :           +- Project [(id#126268L % 10) AS key#126270L, array(id#126268L, (id#126268L + 1), (id#126268L + 3)) AS c#126273]      :           +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))
> 2022-06-16T05:29:18.0674808Z [info] !   :              +- Filter (cast((id#126268L * 2) as int) > 1)                                                                      :              +- Project [(id#126268L % 10) AS key#126270L, array(id#126268L, (id#126268L + 1), (id#126268L + 3)) AS c#126273]
> 2022-06-16T05:29:18.0676143Z [info] !   :                 +- Range (0, 10, step=1, splits=Some(2))                                                                        :                 +- Filter (cast((id#126268L * 2) as int) > 1)
> 2022-06-16T05:29:18.0677658Z [info] !   +- Filter isnotnull(key#126280L)                                                                                                  :                    +- Range (0, 10, step=1, splits=Some(2))
> 2022-06-16T05:29:18.0678838Z [info] !      +- Project [c#126291L, key#126270L AS key#126280L]                                                                             +- Filter isnotnull(key#126280L)
> 2022-06-16T05:29:18.0680092Z [info] !         +- Generate explode(c#126273), [1], false, [c#126291L]                                                                         +- Project [c#126291L, key#126270L AS key#126280L]
> 2022-06-16T05:29:18.0681365Z [info] !            +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))                                                                 +- Generate explode(c#126273), [1], false, [c#126291L]
> 2022-06-16T05:29:18.0687264Z [info] !               +- Project [(id#126290L % 10) AS key#126270L, array(id#126290L, (id#126290L + 1), (id#126290L + 3)) AS c#126273]               +- Filter isnotnull(c#126273)
> 2022-06-16T05:29:18.0688660Z [info] !                  +- Range (0, 10, step=1, splits=Some(2))                                                                                       +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))
> 2022-06-16T05:29:18.0690609Z [info] !                                                                                                                                                    +- Project [(id#126290L % 10) AS key#126270L, array(id#126290L, (id#126290L + 1), (id#126290L + 3)) AS c#126273]
> 2022-06-16T05:29:18.0704834Z [info] !                                                                                                                                                       +- Range (0, 10, step=1, splits=Some(2))
> {code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org