You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by Corbin Hoenes <co...@tynt.com> on 2010/07/20 01:21:12 UTC
compressed ChukwaStorage?
Is there a way to add compression to ChukwaStorage?
Re: compressed ChukwaStorage?
Posted by James Seigel <ja...@tynt.com>.
Sounds like an interesting patch. LZO?
Sent from my mobile. Please excuse the typos.
On 2010-07-19, at 5:21 PM, "Corbin Hoenes" <co...@tynt.com> wrote:
> Is there a way to add compression to ChukwaStorage?
Re: compressed ChukwaStorage?
Posted by Jerome Boulon <jb...@netflix.com>.
Yes and it's easy:
So assuming that you have your codec like this:
CompressionCodec my codec = ....
Then do:
seqFileWriter = SequenceFile.createWriter(conf, newOutputStr,
ChukwaArchiveKey.class, ChunkImpl.class,
SequenceFile.CompressionType.BLOCK, codec);
That's what I'm using in honu.
/Jerome.
http://github.com/jboulon/honu
On 7/19/10 4:21 PM, "Corbin Hoenes" <co...@tynt.com> wrote:
Is there a way to add compression to ChukwaStorage?