You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Corbin Hoenes <co...@tynt.com> on 2010/07/20 01:21:12 UTC

compressed ChukwaStorage?

Is there a way to add compression to ChukwaStorage?

Re: compressed ChukwaStorage?

Posted by James Seigel <ja...@tynt.com>.
Sounds like an interesting patch. LZO?


Sent from my mobile. Please excuse the typos.

On 2010-07-19, at 5:21 PM, "Corbin Hoenes" <co...@tynt.com> wrote:

> Is there a way to add compression to ChukwaStorage?

Re: compressed ChukwaStorage?

Posted by Jerome Boulon <jb...@netflix.com>.
Yes and it's easy:

So assuming that you have your codec like this:
CompressionCodec my codec = ....
Then do:

                seqFileWriter = SequenceFile.createWriter(conf, newOutputStr,
                        ChukwaArchiveKey.class, ChunkImpl.class,
                        SequenceFile.CompressionType.BLOCK, codec);

That's what I'm using in honu.
/Jerome.
http://github.com/jboulon/honu


On 7/19/10 4:21 PM, "Corbin Hoenes" <co...@tynt.com> wrote:

Is there a way to add compression to ChukwaStorage?