You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Peter Vary (JIRA)" <ji...@apache.org> on 2017/08/17 13:48:00 UTC

[jira] [Assigned] (HIVE-17346) TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time

     [ https://issues.apache.org/jira/browse/HIVE-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Vary reassigned HIVE-17346:
---------------------------------


> TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-17346
>                 URL: https://issues.apache.org/jira/browse/HIVE-17346
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Test
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>
> The TestMiniSparkOnYarnCliDriver.testCliDriver - spark_dynamic_partition_pruning is failing with this diff:
> {code}
> Client Execution succeeded but contained differences (error code = 1) after executing spark_dynamic_partition_pruning.q 
> 714c714
> <                   filterExpr: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
> ---
> >                   filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
> 717c717
> <                     predicate: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null) (type: boolean)
> ---
> >                     predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
> 749c749
> <                   filterExpr: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
> ---
> >                   filterExpr: ds is not null (type: boolean)
> 751,752c751,753
> <                   Filter Operator
> <                     predicate: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0'))) + 10)) is not null (type: boolean)
> ---
> >                   Select Operator
> >                     expressions: ds (type: string)
> >                     outputColumnNames: _col0
> 754,756c755,758
> <                     Select Operator
> <                       expressions: ds (type: string)
> <                       outputColumnNames: _col0
> ---
> >                     Reduce Output Operator
> >                       key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> >                       sort order: +
> >                       Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> 758,762d759
> <                       Reduce Output Operator
> <                         key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> <                         sort order: +
> <                         Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)), '0'))) + 10)) (type: bigint)
> <                         Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
> 767c764
> <          
> Output was too long and had to be truncated...
> {code}
> I think it is caused by:
> HIVE-17148 - Incorrect result for Hive join query with COALESCE in WHERE condition
> [~allgoodok]: Am I right? Is it an intended change and only the golden file regeneration is needed?
> Thanks,
> Peter



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)