[jira] [Commented] (HIVE-4788) RCFile and bzip2 compression not working

["Hive QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100627#comment-14100627 ] 

Hive QA commented on HIVE-4788:
-------------------------------



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12662453/HIVE-4788.2.patch.txt

{color:green}SUCCESS:{color} +1 5820 tests passed

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/378/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/378/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-378/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12662453

> RCFile and bzip2 compression not working
> ----------------------------------------
>
>                 Key: HIVE-4788
>                 URL: https://issues.apache.org/jira/browse/HIVE-4788
>             Project: Hive
>          Issue Type: Bug
>          Components: Compression
>    Affects Versions: 0.10.0
>         Environment: CDH4.2
>            Reporter: Johndee Burks
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-4788.1.patch.txt, HIVE-4788.2.patch.txt
>
>
> The issue is that Bzip2 compressed rcfile data is encountering an error when being queried even the most simple query "select *". The issue is easily reproducible using the following. 
> Create a table and load the sample data below. 
> DDL: create table source_data (a string, b string) row format delimited fields terminated by ',';
> Sample data: 
> apple,sauce 
> Test: 
> Do the following and you should receive the error listed below for the rcfile table with bz2 compression. 
> create table rc_nobz2 (a string, b string) stored as rcfile; 
> insert into table rc_nobz2 select * from source_txt; 
> SET io.seqfile.compression.type=BLOCK; 
> SET hive.exec.compress.output=true; 
> SET mapred.compress.map.output=true; 
> SET mapred.output.compress=true; 
> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.BZip2Codec; 
> create table rc_bz2 (a string, b string) stored as rcfile; 
> insert into table rc_bz2 select * from source_txt; 
> hive> select * from rc_bz2; 
> Failed with exception java.io.IOException:java.io.IOException: Stream is not BZip2 formatted: expected 'h' as first byte but got '￿' 
> hive> select * from rc_nobz2; 
> apple	sauce



--
This message was sent by Atlassian JIRA
(v6.2#6252)