You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Peter Haidinyak <ph...@local.com> on 2011/02/11 20:00:03 UTC
LZO Compression
HBase version: 0.89.20100924+28
Hadoop version: 0.20.2+737
Howdy,
My boss compiled kevinweil-hadoop-lzo-0e70051 and created a jar 'hadoop-lzo-0.4.9.jar'
He also gave me an rpm 'lzo-2.04-1.el4.rf.i386.rpm' which is installed into /usr/local/lib.
I have LD_LIBRARY_PAT pointing to this directory plus I added it to the /etc/ld.so.conf file.
When I run hbase a make a table use LZO compression I get the following error.
2011-02-11 10:50:33,317 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader: Could not load native gpl library
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path
My questions are
1. Are the two items I was given compatible?
2. If so, what could I be doing wrong?
Thanks
-Pete
Re: LZO Compression
Posted by Todd Lipcon <to...@cloudera.com>.
Also sounds like you didn't install the libgplcompression.so shared library
which gets built by LZO. You need that on your java library path.
You can use this to build an RPM that puts it all in the right places when
you're using CDH
https://github.com/toddlipcon/hadoop-lzo-packager
-Todd
On Fri, Feb 11, 2011 at 11:22 AM, Ryan Rawson <ry...@gmail.com> wrote:
> the .so has to be the same machine arch as your java binary. meaning
> if you are using 64bit java your lib should also be 64 bit.
>
> -ryan
>
> On Fri, Feb 11, 2011 at 11:00 AM, Peter Haidinyak <ph...@local.com>
> wrote:
> > HBase version: 0.89.20100924+28
> > Hadoop version: 0.20.2+737
> >
> > Howdy,
> > My boss compiled kevinweil-hadoop-lzo-0e70051 and created a jar
> 'hadoop-lzo-0.4.9.jar'
> > He also gave me an rpm 'lzo-2.04-1.el4.rf.i386.rpm' which is installed
> into /usr/local/lib.
> > I have LD_LIBRARY_PAT pointing to this directory plus I added it to the
> /etc/ld.so.conf file.
> >
> > When I run hbase a make a table use LZO compression I get the following
> error.
> >
> > 2011-02-11 10:50:33,317 ERROR
> com.hadoop.compression.lzo.GPLNativeCodeLoader: Could not load native gpl
> library
> > java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path
> >
> >
> > My questions are
> >
> > 1. Are the two items I was given compatible?
> > 2. If so, what could I be doing wrong?
> >
> > Thanks
> >
> > -Pete
> >
> >
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: LZO Compression
Posted by Ryan Rawson <ry...@gmail.com>.
the .so has to be the same machine arch as your java binary. meaning
if you are using 64bit java your lib should also be 64 bit.
-ryan
On Fri, Feb 11, 2011 at 11:00 AM, Peter Haidinyak <ph...@local.com> wrote:
> HBase version: 0.89.20100924+28
> Hadoop version: 0.20.2+737
>
> Howdy,
> My boss compiled kevinweil-hadoop-lzo-0e70051 and created a jar 'hadoop-lzo-0.4.9.jar'
> He also gave me an rpm 'lzo-2.04-1.el4.rf.i386.rpm' which is installed into /usr/local/lib.
> I have LD_LIBRARY_PAT pointing to this directory plus I added it to the /etc/ld.so.conf file.
>
> When I run hbase a make a table use LZO compression I get the following error.
>
> 2011-02-11 10:50:33,317 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader: Could not load native gpl library
> java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path
>
>
> My questions are
>
> 1. Are the two items I was given compatible?
> 2. If so, what could I be doing wrong?
>
> Thanks
>
> -Pete
>
>