You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Patricio Echagüe <pa...@gmail.com> on 2012/04/03 03:18:01 UTC
Trying to enable snappy compression
Hi all, I wanted to double check if Kafka compression (snappy) works with
0.7.0 version. I'm setting the codec in my producer but after running two
tests, one without compresion and one with compression, I don't see any
difference in the log file size nor JConsole.
The messages I send contain a lot of repetitive characters.
What would a better way to test compression be?
Thanks
Re: Trying to enable snappy compression
Posted by Patricio Echagüe <pa...@gmail.com>.
Oh I see. Thanks.
On Mon, Apr 2, 2012 at 6:23 PM, Joe Stein <cr...@gmail.com> wrote:
> Patricio, the snappy compression was committed after the 0.7 release was
> cut.
>
> it is in the trunk though if you want to run off that. Or you can apply
> the patch to 0.7 https://issues.apache.org/jira/browse/KAFKA-187 too
>
> It might be time to cut 0.7.1 with fixes and this (maybe other changes)
> since 0.8 still is some time away (typing out loud).
>
> On Mon, Apr 2, 2012 at 9:18 PM, Patricio Echagüe <patricioe@gmail.com
> >wrote:
>
> > Hi all, I wanted to double check if Kafka compression (snappy) works with
> > 0.7.0 version. I'm setting the codec in my producer but after running two
> > tests, one without compresion and one with compression, I don't see any
> > difference in the log file size nor JConsole.
> >
> > The messages I send contain a lot of repetitive characters.
> >
> > What would a better way to test compression be?
> >
> > Thanks
> >
>
>
>
> --
>
> /*
> Joe Stein
> http://www.linkedin.com/in/charmalloc
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> */
>
Re: Trying to enable snappy compression
Posted by Joe Stein <cr...@gmail.com>.
Patricio, the snappy compression was committed after the 0.7 release was
cut.
it is in the trunk though if you want to run off that. Or you can apply
the patch to 0.7 https://issues.apache.org/jira/browse/KAFKA-187 too
It might be time to cut 0.7.1 with fixes and this (maybe other changes)
since 0.8 still is some time away (typing out loud).
On Mon, Apr 2, 2012 at 9:18 PM, Patricio Echagüe <pa...@gmail.com>wrote:
> Hi all, I wanted to double check if Kafka compression (snappy) works with
> 0.7.0 version. I'm setting the codec in my producer but after running two
> tests, one without compresion and one with compression, I don't see any
> difference in the log file size nor JConsole.
>
> The messages I send contain a lot of repetitive characters.
>
> What would a better way to test compression be?
>
> Thanks
>
--
/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/