You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2013/08/29 07:07:51 UTC

[jira] [Commented] (HIVE-5102) ORC getSplits should create splits based the stripes

    [ https://issues.apache.org/jira/browse/HIVE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753305#comment-13753305 ] 

Hive QA commented on HIVE-5102:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12600472/HIVE-5102.D12579.1.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 2907 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testFileGenerator
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/554/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/554/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.
                
> ORC getSplits should create splits based the stripes 
> -----------------------------------------------------
>
>                 Key: HIVE-5102
>                 URL: https://issues.apache.org/jira/browse/HIVE-5102
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: HIVE-5102.D12579.1.patch
>
>
> Currently ORC inherits getSplits from FileFormat, which basically makes a split per an HDFS block. This can create too little parallelism and would be better done by having getSplits look at the file footer and create splits based on the stripes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira