You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Peter Vary (JIRA)" <ji...@apache.org> on 2017/08/17 14:15:01 UTC
[jira] [Updated] (HIVE-17346)
TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing
every time
[ https://issues.apache.org/jira/browse/HIVE-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Vary updated HIVE-17346:
------------------------------
Attachment: HIVE-17346.patch
Here is the patch, if only golden file regeneration is needed
> TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time
> -----------------------------------------------------------------------------------
>
> Key: HIVE-17346
> URL: https://issues.apache.org/jira/browse/HIVE-17346
> Project: Hive
> Issue Type: Sub-task
> Components: Test
> Reporter: Peter Vary
> Assignee: Peter Vary
> Attachments: HIVE-17346.patch
>
>
> The TestMiniSparkOnYarnCliDriver.testCliDriver - spark_dynamic_partition_pruning is failing with this diff:
> {code}
> Client Execution succeeded but contained differences (error code = 1) after executing spark_dynamic_partition_pruning.q
> 714c714
> < filterExpr: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
> ---
> > filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
> 717c717
> < predicate: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
> ---
> > predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
> 749c749
> < filterExpr: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
> ---
> > filterExpr: ds is not null (type: boolean)
> 751,752c751,753
> < Filter Operator
> < predicate: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
> ---
> > Select Operator
> > expressions: ds (type: string)
> > outputColumnNames: _col0
> 754,756c755,758
> < Select Operator
> < expressions: ds (type: string)
> < outputColumnNames: _col0
> ---
> > Reduce Output Operator
> > key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> > sort order: +
> > Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> 758,762d759
> < Reduce Output Operator
> < key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> < sort order: +
> < Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> < Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
> 767c764
> <
> Output was too long and had to be truncated...
> {code}
> I think it is caused by:
> HIVE-17148 - Incorrect result for Hive join query with COALESCE in WHERE condition
> [~allgoodok]: Am I right? Is it an intended change and only the golden file regeneration is needed?
> Thanks,
> Peter
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)