You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Tomas Hudik (JIRA)" <ji...@apache.org> on 2015/06/04 20:06:38 UTC

[jira] [Created] (HADOOP-12063) tar.gz compression doesn't produce correct output

Tomas Hudik created HADOOP-12063:
------------------------------------

             Summary: tar.gz compression doesn't produce correct output
                 Key: HADOOP-12063
                 URL: https://issues.apache.org/jira/browse/HADOOP-12063
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.4.0
            Reporter: Tomas Hudik


I'm not completely sure whether this is the right place to put this issue since Pig is involved, however, Pig leave decompression of tar.gz to   hadoop-common.

How to reproduce the issue: 

# simple file (file1) with arbitrary text lines put into in1 in HDFS
# same file (file1) compressed by tar -cvzf file1.tar.gz file put into in2 in HDFS
# issue simple pig commands in pig:
{quote}
raw = load 'in1/' USING TextLoader AS (line: bytearray);
dump raw;
{quote}
run for both (compressed and uncompressed file)
# in case of compressed version you will get strange 1st line
{quote}
a0000644000570000001440000000002512534073736011260 0ustar loadhadoopusersa
...
{quote}







--
This message was sent by Atlassian JIRA
(v6.3.4#6332)