You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Peter Haidinyak <ph...@local.com> on 2011/03/08 00:18:51 UTC
LZO Compression
Hi,
When you are setting up LZO Compression for HBase to you need to modify the Hadoop configuration to use LZO or can HBase compress independent of Hadoop?
Thanks
-Pete
RE: LZO Compression
Posted by Peter Haidinyak <ph...@local.com>.
Thanks, I'll give it a try again.
-Pete
-----Original Message-----
From: Ryan Rawson [mailto:ryanobjc@gmail.com]
Sent: Monday, March 07, 2011 3:43 PM
To: user@hbase.apache.org
Cc: Peter Haidinyak
Subject: Re: LZO Compression
That is correct. The latest is here iirc:
https://github.com/toddlipcon/hadoop-lzo
It's pretty trivial to build and deploy. Make sure you have the base
lzo libs on all your machines (that bit me once).
-ryan
On Mon, Mar 7, 2011 at 3:38 PM, Peter Haidinyak <ph...@local.com> wrote:
> I've been told that I should build the jars and native libraries and then deploy these to the cluster.
>
> -Pete
>
> -----Original Message-----
> From: Ryan Rawson [mailto:ryanobjc@gmail.com]
> Sent: Monday, March 07, 2011 3:23 PM
> To: user@hbase.apache.org
> Cc: Peter Haidinyak
> Subject: Re: LZO Compression
>
> Just copy in the hadoop-gpl-compression*.jar and the
> native/Linux*/libgplcompression* to every node and you can use 'LZO'
> compression type in your tables without doing anything else.
>
> -ryan
>
> On Mon, Mar 7, 2011 at 3:18 PM, Peter Haidinyak <ph...@local.com> wrote:
>> Hi,
>> When you are setting up LZO Compression for HBase to you need to modify the Hadoop configuration to use LZO or can HBase compress independent of Hadoop?
>>
>> Thanks
>>
>> -Pete
>>
>
Re: LZO Compression
Posted by Ryan Rawson <ry...@gmail.com>.
That is correct. The latest is here iirc:
https://github.com/toddlipcon/hadoop-lzo
It's pretty trivial to build and deploy. Make sure you have the base
lzo libs on all your machines (that bit me once).
-ryan
On Mon, Mar 7, 2011 at 3:38 PM, Peter Haidinyak <ph...@local.com> wrote:
> I've been told that I should build the jars and native libraries and then deploy these to the cluster.
>
> -Pete
>
> -----Original Message-----
> From: Ryan Rawson [mailto:ryanobjc@gmail.com]
> Sent: Monday, March 07, 2011 3:23 PM
> To: user@hbase.apache.org
> Cc: Peter Haidinyak
> Subject: Re: LZO Compression
>
> Just copy in the hadoop-gpl-compression*.jar and the
> native/Linux*/libgplcompression* to every node and you can use 'LZO'
> compression type in your tables without doing anything else.
>
> -ryan
>
> On Mon, Mar 7, 2011 at 3:18 PM, Peter Haidinyak <ph...@local.com> wrote:
>> Hi,
>> When you are setting up LZO Compression for HBase to you need to modify the Hadoop configuration to use LZO or can HBase compress independent of Hadoop?
>>
>> Thanks
>>
>> -Pete
>>
>
RE: LZO Compression
Posted by Peter Haidinyak <ph...@local.com>.
I've been told that I should build the jars and native libraries and then deploy these to the cluster.
-Pete
-----Original Message-----
From: Ryan Rawson [mailto:ryanobjc@gmail.com]
Sent: Monday, March 07, 2011 3:23 PM
To: user@hbase.apache.org
Cc: Peter Haidinyak
Subject: Re: LZO Compression
Just copy in the hadoop-gpl-compression*.jar and the
native/Linux*/libgplcompression* to every node and you can use 'LZO'
compression type in your tables without doing anything else.
-ryan
On Mon, Mar 7, 2011 at 3:18 PM, Peter Haidinyak <ph...@local.com> wrote:
> Hi,
> When you are setting up LZO Compression for HBase to you need to modify the Hadoop configuration to use LZO or can HBase compress independent of Hadoop?
>
> Thanks
>
> -Pete
>
Re: LZO Compression
Posted by Ryan Rawson <ry...@gmail.com>.
Just copy in the hadoop-gpl-compression*.jar and the
native/Linux*/libgplcompression* to every node and you can use 'LZO'
compression type in your tables without doing anything else.
-ryan
On Mon, Mar 7, 2011 at 3:18 PM, Peter Haidinyak <ph...@local.com> wrote:
> Hi,
> When you are setting up LZO Compression for HBase to you need to modify the Hadoop configuration to use LZO or can HBase compress independent of Hadoop?
>
> Thanks
>
> -Pete
>