You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2013/11/23 09:17:35 UTC

[jira] [Commented] (HIVE-5876) Split elimination in ORC breaks for partitioned tables

    [ https://issues.apache.org/jira/browse/HIVE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13830617#comment-13830617 ] 

Hive QA commented on HIVE-5876:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12615421/HIVE-5876.1.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 4680 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationComplexExpr
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationLargeMaxSplit
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationSmallMaxSplit
{noformat}

Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/415/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/415/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12615421

> Split elimination in ORC breaks for partitioned tables
> ------------------------------------------------------
>
>                 Key: HIVE-5876
>                 URL: https://issues.apache.org/jira/browse/HIVE-5876
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>         Attachments: HIVE-5876.1.patch
>
>
> HIVE-5632 eliminates ORC stripes from split computation that do not satisfy SARG condition. SARG expression can also refer to partition columns. But partition column will not be contained in the column names list in ORC file. This was causing ArrayIndexOutOfBoundException in split elimination logic when used with partitioned tables. The fix is to ignore evaluation of partition column expressions in split elimination.



--
This message was sent by Atlassian JIRA
(v6.1#6144)