You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "jack li (JIRA)" <ji...@apache.org> on 2012/07/31 08:39:33 UTC

[jira] [Created] (FLUME-1409) hdfs sink and compress

jack li created FLUME-1409:
------------------------------

             Summary: hdfs sink  and compress 
                 Key: FLUME-1409
                 URL: https://issues.apache.org/jira/browse/FLUME-1409
             Project: Flume
          Issue Type: Question
         Environment: rhel 5.7 jdk1.6   flume-ng 1.3 
            Reporter: jack li


1,Using LZO,lzop,compression type, you can see the appropriate compressed files in hdfs. But When I use "hadoop fs -text filesname"   Reports That:
12/07/31 14:24:18 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/31 14:24:18 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 4537f94556c9ba71ffca316514e0c0101f76b63b]
text: Invalid LZO header  
2,When I Change Type to gzip and  get the file from hdfs，"gzip -d filename" ,Reports "gzip: nginx.1343711863138.gz: not in gzip format"   

How to do it ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira