[jira] [Closed] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

["Reynold Xin (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reynold Xin closed SPARK-11873.
-------------------------------
    Resolution: Auto Closed

Marking as auto closed since the code path has changed quite a bit.


> Regression for TPC-DS query 63 when used with decimal datatype and windows function
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-11873
>                 URL: https://issues.apache.org/jira/browse/SPARK-11873
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.5.0
>            Reporter: Dileep Kumar
>              Labels: perfomance
>         Attachments: 63.1.1, 63.1.5, 63.decimal_schema, 63.decimal_schema_windows_function, 63.double_schema, 98.1.1, 98.1.5, decimal_schema.sql, double_schema.sql
>
>
> When running the TPC-DS based queries for benchmarking spark found that query 63 (after making it similar to original query) show different behavior compared to other queries eg. q98 which has similar function.
> Here are performance numbers(execution time in seconds):
> 	1.1 Baseline	1.5	1.5 + Decimal
> q63	27	26	38
> q98	18	26	24
> As you can see q63 is showing regression compared to similar query. I am attaching the both version of queries and affected schemas. When adding the windows function back this is the only query seem to be slower than 1.1 in 1.5.
> I have attached the both version of schema and queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org