You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "JESSE CHEN (JIRA)" <ji...@apache.org> on 2016/03/14 18:48:33 UTC
[jira] [Created] (SPARK-13859) TPCDS query 24b returns wrong
results compared to TPC official result set
JESSE CHEN created SPARK-13859:
----------------------------------
Summary: TPCDS query 24b returns wrong results compared to TPC official result set
Key: SPARK-13859
URL: https://issues.apache.org/jira/browse/SPARK-13859
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.6.0
Reporter: JESSE CHEN
Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to official result set. This is at 1GB SF (validation run).
SparkSQL missing at least one row (grep for AAAAAAAAABDAAAAA) ; I believe 2 other rows are missing as well.
Actual results:
[null,AAAAAAAAAABDAAAA,2565,1922]
[null,AAAAAAAAAAHDAAAA,2956,2052]
[null,AAAAAAAAAALAAAAA,2042,1793]
[null,AAAAAAAAACGCAAAA,2373,1771]
[null,AAAAAAAAACKCAAAA,2321,1856]
[null,AAAAAAAAACOBAAAA,1504,1397]
[null,AAAAAAAAADKBAAAA,1820,2163]
[null,AAAAAAAAAEADAAAA,2631,1965]
[null,AAAAAAAAAEOCAAAA,1659,1798]
[null,AAAAAAAAAFACAAAA,1965,1705]
[null,AAAAAAAAAFADAAAA,1769,1313]
[null,AAAAAAAAAHDEAAAA,2700,1985]
[null,AAAAAAAAAHHAAAAA,1578,1082]
[null,AAAAAAAAAIECAAAA,1756,1804]
[null,AAAAAAAAAIMCAAAA,3603,2951]
[null,AAAAAAAAAJACAAAA,2109,1989]
[null,AAAAAAAAAJKBAAAA,2573,3540]
[null,AAAAAAAAALBEAAAA,3458,2992]
[null,AAAAAAAAALCEAAAA,1720,1810]
[null,AAAAAAAAALECAAAA,2569,1946]
[null,AAAAAAAAALNBAAAA,2552,1750]
[null,AAAAAAAAANFEAAAA,2022,2269]
[null,AAAAAAAAAOIBAAAA,2982,2540]
[null,AAAAAAAAAPJBAAAA,2344,2593]
[null,AAAAAAAABAPDAAAA,2182,2787]
[null,AAAAAAAABDCEAAAA,2844,2069]
[null,AAAAAAAABDDDAAAA,2417,2537]
[null,AAAAAAAABDJAAAAA,1584,1666]
[null,AAAAAAAABEODAAAA,2141,2649]
[null,AAAAAAAABFCCAAAA,2745,2020]
[null,AAAAAAAABFMBAAAA,1642,1364]
[null,AAAAAAAABHPCAAAA,1923,1780]
[null,AAAAAAAABIDBAAAA,1956,2836]
[null,AAAAAAAABIGBAAAA,2023,2344]
[null,AAAAAAAABIJBAAAA,1977,2728]
[null,AAAAAAAABJFEAAAA,1891,2390]
[null,AAAAAAAABLDEAAAA,1983,1797]
[null,AAAAAAAABNIDAAAA,2485,2324]
[null,AAAAAAAABNLDAAAA,2385,2786]
[null,AAAAAAAABOMBAAAA,2291,2092]
[null,AAAAAAAACAAAAAAA,2233,2560]
[null,AAAAAAAACBCDAAAA,1540,2012]
[null,AAAAAAAACBIAAAAA,2394,2122]
[null,AAAAAAAACBPBAAAA,1790,1661]
[null,AAAAAAAACCMDAAAA,2654,2691]
[null,AAAAAAAACDBCAAAA,1804,2072]
[null,AAAAAAAACFEAAAAA,1941,1567]
[null,AAAAAAAACGFDAAAA,2123,2265]
[null,AAAAAAAACHPCAAAA,2933,2174]
[null,AAAAAAAACIGDAAAA,2618,2399]
[null,AAAAAAAACJCBAAAA,2728,2367]
[null,AAAAAAAACJLAAAAA,1350,1732]
[null,AAAAAAAACLAEAAAA,2578,2329]
[null,AAAAAAAACLGAAAAA,1842,1588]
[null,AAAAAAAACLLBAAAA,3418,2657]
[null,AAAAAAAACLOBAAAA,3115,2560]
[null,AAAAAAAACMADAAAA,1991,2243]
[null,AAAAAAAACMJAAAAA,1261,1855]
[null,AAAAAAAACMLAAAAA,3288,2753]
[null,AAAAAAAACMPDAAAA,1320,1676]
[null,AAAAAAAACNGBAAAA,2340,2118]
[null,AAAAAAAACNHDAAAA,3519,3348]
[null,AAAAAAAACNPCAAAA,2561,1948]
[null,AAAAAAAADCPCAAAA,2664,2627]
[null,AAAAAAAADDHAAAAA,1313,1926]
[null,AAAAAAAADDNDAAAA,1109,835]
[null,AAAAAAAADEAAAAAA,2141,1847]
[null,AAAAAAAADEJAAAAA,3142,2723]
[null,AAAAAAAADFKBAAAA,1470,1650]
[null,AAAAAAAADGCCAAAA,2113,2331]
[null,AAAAAAAADGFCAAAA,2201,2928]
[null,AAAAAAAADHPAAAAA,2467,2133]
[null,AAAAAAAADMBAAAAA,3085,2087]
[null,AAAAAAAADPABAAAA,3494,3081]
[null,AAAAAAAAEAECAAAA,2133,2148]
[null,AAAAAAAAEAPAAAAA,1560,1275]
[null,AAAAAAAAECGCAAAA,2815,3307]
[null,AAAAAAAAEDPDAAAA,2731,1883]
[null,AAAAAAAAEEECAAAA,2024,1902]
[null,AAAAAAAAEEMCAAAA,2624,2387]
[null,AAAAAAAAEFFAAAAA,2047,1878]
[null,AAAAAAAAEGJAAAAA,2403,2633]
[null,AAAAAAAAEGMAAAAA,2784,2772]
[null,AAAAAAAAEGOCAAAA,2389,1753]
[null,AAAAAAAAEHFDAAAA,1940,1420]
[null,AAAAAAAAEHLBAAAA,2320,2057]
[null,AAAAAAAAEHPAAAAA,1898,1853]
[null,AAAAAAAAEIPBAAAA,2930,2326]
[null,AAAAAAAAEJAEAAAA,2582,1836]
[null,AAAAAAAAEJIBAAAA,2257,1681]
[null,AAAAAAAAEJJAAAAA,2791,1941]
[null,AAAAAAAAEJJDAAAA,3410,2405]
[null,AAAAAAAAEJNCAAAA,2472,2067]
[null,AAAAAAAAEJPDAAAA,1219,1229]
[null,AAAAAAAAEKEBAAAA,2047,1713]
[null,AAAAAAAAEMEAAAAA,2502,1897]
[null,AAAAAAAAEMKCAAAA,2362,2042]
[null,AAAAAAAAENACAAAA,2011,1909]
[null,AAAAAAAAENFBAAAA,2507,2162]
[null,AAAAAAAAENODAAAA,3371,2709]
Expected results:
+----------------------+------------------+------------+-----------+
| W_WAREHOUSE_NAME | I_ITEM_ID | INV_BEFORE | INV_AFTER |
+----------------------+------------------+------------+-----------+
| Bad cards must make. | AAAAAAAAAACDAAAA | 1889 | 2168 |
| Bad cards must make. | AAAAAAAAAAHDAAAA | 2739 | 2039 |
| Bad cards must make. | AAAAAAAAABDAAAAA | 1717 | 1782 |
| Bad cards must make. | AAAAAAAAACGCAAAA | 2296 | 2276 |
| Bad cards must make. | AAAAAAAAACKCAAAA | 2443 | 1878 |
| Bad cards must make. | AAAAAAAAACOBAAAA | 2705 | 2428 |
| Bad cards must make. | AAAAAAAAADGBAAAA | 2242 | 2759 |
| Bad cards must make. | AAAAAAAAADKBAAAA | 2138 | 2456 |
| Bad cards must make. | AAAAAAAAAEADAAAA | 2914 | 2237 |
| Bad cards must make. | AAAAAAAAAEOCAAAA | 1797 | 2073 |
| Bad cards must make. | AAAAAAAAAFACAAAA | 2058 | 2734 |
| Bad cards must make. | AAAAAAAAAFADAAAA | 2173 | 2515 |
| Bad cards must make. | AAAAAAAAAFDCAAAA | 2309 | 2277 |
| Bad cards must make. | AAAAAAAAAGIDAAAA | 1864 | 2197 |
| Bad cards must make. | AAAAAAAAAHDEAAAA | 2483 | 2077 |
| Bad cards must make. | AAAAAAAAAHJBAAAA | 2904 | 3312 |
| Bad cards must make. | AAAAAAAAAIECAAAA | 2239 | 2526 |
| Bad cards must make. | AAAAAAAAAIMCAAAA | 1948 | 2693 |
| Bad cards must make. | AAAAAAAAAJKBAAAA | 2184 | 2190 |
| Bad cards must make. | AAAAAAAAALECAAAA | 2539 | 3052 |
| Bad cards must make. | AAAAAAAAALNBAAAA | 1406 | 1728 |
| Bad cards must make. | AAAAAAAAAMPBAAAA | 3450 | 3033 |
| Bad cards must make. | AAAAAAAAANFEAAAA | 2255 | 1517 |
| Bad cards must make. | AAAAAAAAAPLAAAAA | 1465 | 1227 |
| Bad cards must make. | AAAAAAAABBIDAAAA | 2822 | 2125 |
| Bad cards must make. | AAAAAAAABDCEAAAA | 2068 | 2187 |
| Bad cards must make. | AAAAAAAABEFDAAAA | 1023 | 1510 |
| Bad cards must make. | AAAAAAAABFNAAAAA | 1962 | 2719 |
| Bad cards must make. | AAAAAAAABFOCAAAA | 2392 | 2520 |
| Bad cards must make. | AAAAAAAABHPCAAAA | 2945 | 3058 |
| Bad cards must make. | AAAAAAAABIDBAAAA | 1746 | 1706 |
| Bad cards must make. | AAAAAAAABJFEAAAA | 2458 | 2647 |
| Bad cards must make. | AAAAAAAABKFAAAAA | 3152 | 2529 |
| Bad cards must make. | AAAAAAAABLDEAAAA | 2439 | 2899 |
| Bad cards must make. | AAAAAAAABNHBAAAA | 2254 | 2117 |
| Bad cards must make. | AAAAAAAABNLAAAAA | 2552 | 2608 |
| Bad cards must make. | AAAAAAAABNLDAAAA | 3103 | 2489 |
| Bad cards must make. | AAAAAAAABNMCAAAA | 1752 | 2078 |
| Bad cards must make. | AAAAAAAABOCCAAAA | 1697 | 1547 |
| Bad cards must make. | AAAAAAAACAAAAAAA | 2736 | 1937 |
| Bad cards must make. | AAAAAAAACAJCAAAA | 1921 | 1806 |
| Bad cards must make. | AAAAAAAACBFAAAAA | 1237 | 1460 |
| Bad cards must make. | AAAAAAAACBIAAAAA | 2157 | 1915 |
| Bad cards must make. | AAAAAAAACBPBAAAA | 3220 | 2970 |
| Bad cards must make. | AAAAAAAACCABAAAA | 1167 | 1704 |
| Bad cards must make. | AAAAAAAACCMDAAAA | 2057 | 2563 |
| Bad cards must make. | AAAAAAAACDBCAAAA | 2017 | 1494 |
| Bad cards must make. | AAAAAAAACGFDAAAA | 2811 | 3027 |
| Bad cards must make. | AAAAAAAACHHDAAAA | 2589 | 1935 |
| Bad cards must make. | AAAAAAAACJDCAAAA | 1299 | 1807 |
| Bad cards must make. | AAAAAAAACKHAAAAA | 1484 | 2158 |
| Bad cards must make. | AAAAAAAACLKAAAAA | 2743 | 2910 |
| Bad cards must make. | AAAAAAAACMJAAAAA | 1345 | 1776 |
| Bad cards must make. | AAAAAAAACMLAAAAA | 1869 | 2372 |
| Bad cards must make. | AAAAAAAACMPDAAAA | 1480 | 2177 |
| Bad cards must make. | AAAAAAAACNBBAAAA | 2914 | 2373 |
| Bad cards must make. | AAAAAAAACNEBAAAA | 2170 | 2456 |
| Bad cards must make. | AAAAAAAACNFAAAAA | 2854 | 2071 |
| Bad cards must make. | AAAAAAAACNGBAAAA | 1830 | 2659 |
| Bad cards must make. | AAAAAAAACNHDAAAA | 1507 | 1643 |
| Bad cards must make. | AAAAAAAACNPCAAAA | 2756 | 2402 |
| Bad cards must make. | AAAAAAAADCBEAAAA | 2403 | 2684 |
| Bad cards must make. | AAAAAAAADCPCAAAA | 2112 | 1881 |
| Bad cards must make. | AAAAAAAADDNDAAAA | 3404 | 2652 |
| Bad cards must make. | AAAAAAAADEJDAAAA | 1719 | 1822 |
| Bad cards must make. | AAAAAAAADFLAAAAA | 3242 | 2344 |
| Bad cards must make. | AAAAAAAADGCCAAAA | 2435 | 2159 |
| Bad cards must make. | AAAAAAAADGFCAAAA | 2350 | 1867 |
| Bad cards must make. | AAAAAAAADGGBAAAA | 2686 | 3567 |
| Bad cards must make. | AAAAAAAADGKAAAAA | 2927 | 2595 |
| Bad cards must make. | AAAAAAAADHPAAAAA | 2639 | 2216 |
| Bad cards must make. | AAAAAAAADKPDAAAA | 2476 | 3512 |
| Bad cards must make. | AAAAAAAADMBAAAAA | 2472 | 2301 |
| Bad cards must make. | AAAAAAAADNLBAAAA | 2792 | 2077 |
| Bad cards must make. | AAAAAAAADPABAAAA | 1719 | 1667 |
| Bad cards must make. | AAAAAAAAEAICAAAA | 1420 | 2094 |
| Bad cards must make. | AAAAAAAAEAPAAAAA | 1875 | 2244 |
| Bad cards must make. | AAAAAAAAEBCEAAAA | 2241 | 1924 |
| Bad cards must make. | AAAAAAAAEBPCAAAA | 2544 | 2281 |
| Bad cards must make. | AAAAAAAAECGCAAAA | 2039 | 1848 |
| Bad cards must make. | AAAAAAAAEDOCAAAA | 2401 | 1770 |
| Bad cards must make. | AAAAAAAAEDPDAAAA | 3041 | 2119 |
| Bad cards must make. | AAAAAAAAEGGBAAAA | 2717 | 2032 |
| Bad cards must make. | AAAAAAAAEGJAAAAA | 2996 | 2092 |
| Bad cards must make. | AAAAAAAAEGMAAAAA | 3051 | 2982 |
| Bad cards must make. | AAAAAAAAEGOCAAAA | 2086 | 1958 |
| Bad cards must make. | AAAAAAAAEHECAAAA | 1993 | 1498 |
| Bad cards must make. | AAAAAAAAEHFDAAAA | 2217 | 2151 |
| Bad cards must make. | AAAAAAAAEHLBAAAA | 1417 | 2034 |
| Bad cards must make. | AAAAAAAAEIDEAAAA | 1804 | 1474 |
| Bad cards must make. | AAAAAAAAEJAEAAAA | 2287 | 2006 |
| Bad cards must make. | AAAAAAAAEJJDAAAA | 2080 | 1660 |
| Bad cards must make. | AAAAAAAAEJPDAAAA | 1788 | 2188 |
| Bad cards must make. | AAAAAAAAEKCAAAAA | 2451 | 2182 |
| Bad cards must make. | AAAAAAAAENFBAAAA | 2123 | 2294 |
| Bad cards must make. | AAAAAAAAEONAAAAA | 2706 | 1887 |
| Bad cards must make. | AAAAAAAAEPHCAAAA | 1332 | 1209 |
| Bad cards must make. | AAAAAAAAEPKCAAAA | 2445 | 1824 |
| Bad cards must make. | AAAAAAAAFAKBAAAA | 843 | 1256 |
| Bad cards must make. | AAAAAAAAFALDAAAA | 2391 | 2019 |
+----------------------+------------------+------------+-----------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org