You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Peter Vary (JIRA)" <ji...@apache.org> on 2017/08/17 13:48:00 UTC
[jira] [Created] (HIVE-17346)
TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing
every time
Peter Vary created HIVE-17346:
---------------------------------
Summary: TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time
Key: HIVE-17346
URL: https://issues.apache.org/jira/browse/HIVE-17346
Project: Hive
Issue Type: Sub-task
Components: Test
Reporter: Peter Vary
Assignee: Peter Vary
The TestMiniSparkOnYarnCliDriver.testCliDriver - spark_dynamic_partition_pruning is failing with this diff:
{code}
Client Execution succeeded but contained differences (error code = 1) after executing spark_dynamic_partition_pruning.q
714c714
< filterExpr: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
---
> filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
717c717
< predicate: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
---
> predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
749c749
< filterExpr: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
---
> filterExpr: ds is not null (type: boolean)
751,752c751,753
< Filter Operator
< predicate: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
---
> Select Operator
> expressions: ds (type: string)
> outputColumnNames: _col0
754,756c755,758
< Select Operator
< expressions: ds (type: string)
< outputColumnNames: _col0
---
> Reduce Output Operator
> key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> sort order: +
> Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
758,762d759
< Reduce Output Operator
< key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
< sort order: +
< Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
< Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
767c764
<
Output was too long and had to be truncated...
{code}
I think it is caused by:
HIVE-17148 - Incorrect result for Hive join query with COALESCE in WHERE condition
[~allgoodok]: Am I right? Is it an intended change and only the golden file regeneration is needed?
Thanks,
Peter
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)