[jira] [Created] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

["JESSE CHEN (JIRA)" <ji...@apache.org>]

JESSE CHEN created SPARK-13858:
----------------------------------

             Summary: TPCDS query 21 returns wrong results compared to TPC official result set 
                 Key: SPARK-13858
                 URL: https://issues.apache.org/jira/browse/SPARK-13858
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.6.0
            Reporter: JESSE CHEN


Majority of the TPCDS queries ran faster in 1.6.0 than in 1.4.1, average about 9% faster. There are a few degraded, and one that is definitely not within error margin is query 66.

Query 66 in 1.4.1: 699 seconds
Query 66 in 1.6.0: 918 seconds

30% worse.

Collected the physical plans from both versions - drastic difference maybe partially from using Tungsten in 1.6, but anything else at play here?

Please see plans here:

https://ibm.box.com/spark-sql-q66-debug-160plan
https://ibm.box.com/spark-sql-q66-debug-141plan





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org