[jira] [Updated] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

["Dileep Kumar (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dileep Kumar updated SPARK-11873:
---------------------------------
    Attachment: 63.1.1
                98.1.1
                63.1.5
                98.1.5
                decimal_schema.sql
                double_schema.sql

> Regression for TPC-DS query 63 when used with decimal datatype and windows function
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-11873
>                 URL: https://issues.apache.org/jira/browse/SPARK-11873
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.5.0
>            Reporter: Dileep Kumar
>              Labels: perfomance
>         Attachments: 63.1.1, 63.1.5, 98.1.1, 98.1.5, decimal_schema.sql, double_schema.sql
>
>
> When running the TPC-DS based queries for benchmarking spark found that query 63 (after making it similar to original query) show different behavior compared to other queries eg. q98 which has similar function.
> Here are performance numbers:
> 	1.1 Baseline	1.5	1.5 + Decimal
> q63	27	26	38
> q98	18	26	24
> As you can see q63 is showing regression compared to similar query. I am attaching the both version of queries and affected schemas. When adding the windows function back this is the only query seem to be slower than 1.1 in 1.5.
> I have attached the both version of schema and queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org