You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by ravikumar visweswara <ta...@gmail.com> on 2011/12/31 23:16:34 UTC

how to compress log files with snappy compression

Hello All,

Is there a way to compress my text log files in snappy format on Mac OSX
and Linux before or while pushing to hdfs?

I dont want to run another map job to do the compression.

-R

Re: how to compress log files with snappy compression

Posted by Mathias Herberts <ma...@gmail.com>.

write a simple java class that creates a snappy compressed seqfile.
On Dec 31, 2011 11:17 PM, "ravikumar visweswara" <ta...@gmail.com>
wrote:

> Hello All,
>
> Is there a way to compress my text log files in snappy format on Mac OSX
> and Linux before or while pushing to hdfs?
>
> I dont want to run another map job to do the compression.
>
> -R
>