You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/06/20 15:54:00 UTC
[jira] [Commented] (SPARK-39518) Plan stability test is broken with Scala 2.13
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556433#comment-17556433 ]
Bruce Robbins commented on SPARK-39518:
---------------------------------------
As with the GeneratorFunctionsSuite and AdaptiveQueryExecSuite issues, when I apply the propose fix for SPARK-39520 (this PR), the issue resolves on my laptop.
I won't yet resolve this one, because I found that this suite is sometimes sensitive to where it is run.
> Plan stability test is broken with Scala 2.13
> ---------------------------------------------
>
> Key: SPARK-39518
> URL: https://issues.apache.org/jira/browse/SPARK-39518
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> https://github.com/apache/spark/runs/6930230844?check_suite_focus=true
> {code}
> - check simplified (tpcds-v1.4/q89) *** FAILED *** (118 milliseconds)
> [info] Plans did not match:
> [info] last approved simplified plan: /home/runner/work/spark/spark/sql/core/src/test/resources/tpcds-plan-stability/approved-plans-v1_4/q89/simplified.txt
> [info] last approved explain plan: /home/runner/work/spark/spark/sql/core/src/test/resources/tpcds-plan-stability/approved-plans-v1_4/q89/explain.txt
> [info]
> [info] TakeOrderedAndProject [sum_sales,avg_monthly_sales,s_store_name,i_category,i_class,i_brand,s_company_name,d_moy]
> [info] WholeStageCodegen (7)
> [info] Project [i_category,i_class,i_brand,s_store_name,s_company_name,d_moy,sum_sales,avg_monthly_sales]
> [info] Filter [avg_monthly_sales,sum_sales]
> [info] InputAdapter
> [info] Window [_w0,i_category,i_brand,s_store_name,s_company_name]
> [info] WholeStageCodegen (6)
> [info] Sort [i_category,i_brand,s_store_name,s_company_name]
> [info] InputAdapter
> [info] Exchange [i_category,i_brand,s_store_name,s_company_name] #1
> [info] WholeStageCodegen (5)
> [info] HashAggregate [i_category,i_class,i_brand,s_store_name,s_company_name,d_moy,sum] [sum(UnscaledValue(ss_sales_price)),sum_sales,_w0,sum]
> [info] InputAdapter
> [info] Exchange [i_category,i_class,i_brand,s_store_name,s_company_name,d_moy] #2
> [info] WholeStageCodegen (4)
> [info] HashAggregate [i_category,i_class,i_brand,s_store_name,s_company_name,d_moy,ss_sales_price] [sum,sum]
> [info] Project [i_brand,i_class,i_category,ss_sales_price,d_moy,s_store_name,s_company_name]
> [info] BroadcastHashJoin [ss_store_sk,s_store_sk]
> [info] Project [i_brand,i_class,i_category,ss_store_sk,ss_sales_price,d_moy]
> [info] BroadcastHashJoin [ss_sold_date_sk,d_date_sk]
> [info] Project [i_brand,i_class,i_category,ss_store_sk,ss_sales_price,ss_sold_date_sk]
> [info] BroadcastHashJoin [i_item_sk,ss_item_sk]
> [info] Filter [i_category,i_class,i_item_sk]
> [info] ColumnarToRow
> [info] InputAdapter
> [info] Scan parquet default.item [i_item_sk,i_brand,i_class,i_category]
> [info] InputAdapter
> [info] BroadcastExchange #3
> [info] WholeStageCodegen (1)
> [info] InputAdapter
> [info] Scan parquet default.item [i_item_sk,i_brand,i_class,i_category]
> [info] InputAdapter
> [info] BroadcastExchange #3
> [info] WholeStageCodegen (1)
> [info] Filter [ss_item_sk,ss_store_sk]
> [info] ColumnarToRow
> [info] InputAdapter
> [info] Scan parquet default.store_sales [ss_item_sk,ss_store_sk,ss_sales_price,ss_sold_date_sk]
> [info] SubqueryBroadcast [d_date_sk] #1
> [info] BroadcastExchange #4
> [info] WholeStageCodegen (1)
> [info] Project [d_date_sk,d_moy]
> [info] Filter [d_year,d_date_sk]
> [info] ColumnarToRow
> [info] InputAdapter
> [info] Scan parquet default.date_dim [d_date_sk,d_year,d_moy]
> [info] InputAdapter
> [info] ReusedExchange [d_date_sk,d_moy] #4
> [info] InputAdapter
> [info] BroadcastExchange #5
> [info] WholeStageCodegen (3)
> [info] Filter [s_store_sk]
> [info] ColumnarToRow
> [info] InputAdapter
> [info] Scan parquet default.store [s_store_sk,s_store_name,s_company_name] (PlanStabilitySuite.scala:158)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org