You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Peter Haidinyak <ph...@local.com> on 2011/01/25 21:34:19 UTC
Building LZO jar
Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
[ivy:resolve] confs: [common]
Would anyone have a pre-build 32bit LZO jar available?
Thanks
-Pete
Re: Building LZO jar
Posted by Todd Lipcon <to...@cloudera.com>.
GitHub Pull Requests happily accepted! :-D
-Todd
On Thu, Jan 27, 2011 at 12:40 AM, Friso van Vollenhoven <
fvanvollenhoven@xebia.com> wrote:
> Ah, I see. It's an undocumented feature...
>
> Thanks Lars.
>
>
> On 27 jan 2011, at 08:21, Lars George wrote:
>
> > Hi Friso,
> >
> > See
> https://github.com/toddlipcon/hadoop-lzo-packager/blob/master/run.sh#L127-133
> >
> > Todd's is the most current AFAIK.
> >
> > Lars
> >
> > On Wed, Jan 26, 2011 at 2:14 PM, Friso van Vollenhoven
> > <fv...@xebia.com> wrote:
> >> Hi Lars,
> >>
> >> The readme for this talks about the LZO from Google Code and using svn
> to get it. Does it also work with the more recent versions on Github?
> >>
> >> I usually build these things manually and move things around myself.
> Also because I always try to provide one hadoop+hbase binary + source dist
> internally that has all the native libs for Linux and OSX, so it also works
> for the local installs on dev machines...
> >>
> >>
> >> Friso
> >>
> >>
> >>
> >> On 26 jan 2011, at 12:38, Lars George wrote:
> >>
> >>> I agree with Friso, using Todd's LZO Packager this is really easy:
> >>> https://github.com/toddlipcon/hadoop-lzo-packager
> >>>
> >>> Lars
> >>>
> >>>
> >>> On Wed, Jan 26, 2011 at 10:41 AM, Friso van Vollenhoven
> >>> <fv...@xebia.com> wrote:
> >>>> Are you sure it is not a problem with the network on your side?
> Clicking the link and downloading that jar works fine for me.
> >>>>
> >>>> I don't think jar files are either 32 or 64 bit, but the native
> libraries that go with LZO are. I would recommend building them on your
> target platform/architecture and not use libs that are built elsewhere.
> >>>>
> >>>>
> >>>> Friso
> >>>>
> >>>>
> >>>>
> >>>> On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
> >>>>
> >>>>> Hi, I am kind of in a pickle right now. I enabled LZO compression on
> a table without having the correct lzo jar. Now HBase doesn't startup
> because of the missing jar. I am trying to build the LZO jar but Ivy, for
> some reason, can't connect to
> >>>>>
> >>>>>
> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
> >>>>>
> >>>>> to download the jar. I have tried running the build in offline mode
> but the Ivy gets stuck at..
> >>>>>
> >>>>> ivy-resolve-common:
> >>>>> [ivy:resolve] :: resolving dependencies ::
> com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
> >>>>> [ivy:resolve] confs: [common]
> >>>>>
> >>>>> Would anyone have a pre-build 32bit LZO jar available?
> >>>>>
> >>>>> Thanks
> >>>>>
> >>>>> -Pete
> >>>>
> >>>>
> >>
> >>
>
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: Building LZO jar
Posted by Friso van Vollenhoven <fv...@xebia.com>.
Ah, I see. It's an undocumented feature...
Thanks Lars.
On 27 jan 2011, at 08:21, Lars George wrote:
> Hi Friso,
>
> See https://github.com/toddlipcon/hadoop-lzo-packager/blob/master/run.sh#L127-133
>
> Todd's is the most current AFAIK.
>
> Lars
>
> On Wed, Jan 26, 2011 at 2:14 PM, Friso van Vollenhoven
> <fv...@xebia.com> wrote:
>> Hi Lars,
>>
>> The readme for this talks about the LZO from Google Code and using svn to get it. Does it also work with the more recent versions on Github?
>>
>> I usually build these things manually and move things around myself. Also because I always try to provide one hadoop+hbase binary + source dist internally that has all the native libs for Linux and OSX, so it also works for the local installs on dev machines...
>>
>>
>> Friso
>>
>>
>>
>> On 26 jan 2011, at 12:38, Lars George wrote:
>>
>>> I agree with Friso, using Todd's LZO Packager this is really easy:
>>> https://github.com/toddlipcon/hadoop-lzo-packager
>>>
>>> Lars
>>>
>>>
>>> On Wed, Jan 26, 2011 at 10:41 AM, Friso van Vollenhoven
>>> <fv...@xebia.com> wrote:
>>>> Are you sure it is not a problem with the network on your side? Clicking the link and downloading that jar works fine for me.
>>>>
>>>> I don't think jar files are either 32 or 64 bit, but the native libraries that go with LZO are. I would recommend building them on your target platform/architecture and not use libs that are built elsewhere.
>>>>
>>>>
>>>> Friso
>>>>
>>>>
>>>>
>>>> On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
>>>>
>>>>> Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
>>>>>
>>>>> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>>>>>
>>>>> to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
>>>>>
>>>>> ivy-resolve-common:
>>>>> [ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
>>>>> [ivy:resolve] confs: [common]
>>>>>
>>>>> Would anyone have a pre-build 32bit LZO jar available?
>>>>>
>>>>> Thanks
>>>>>
>>>>> -Pete
>>>>
>>>>
>>
>>
Re: Building LZO jar
Posted by Lars George <la...@gmail.com>.
Hi Friso,
See https://github.com/toddlipcon/hadoop-lzo-packager/blob/master/run.sh#L127-133
Todd's is the most current AFAIK.
Lars
On Wed, Jan 26, 2011 at 2:14 PM, Friso van Vollenhoven
<fv...@xebia.com> wrote:
> Hi Lars,
>
> The readme for this talks about the LZO from Google Code and using svn to get it. Does it also work with the more recent versions on Github?
>
> I usually build these things manually and move things around myself. Also because I always try to provide one hadoop+hbase binary + source dist internally that has all the native libs for Linux and OSX, so it also works for the local installs on dev machines...
>
>
> Friso
>
>
>
> On 26 jan 2011, at 12:38, Lars George wrote:
>
>> I agree with Friso, using Todd's LZO Packager this is really easy:
>> https://github.com/toddlipcon/hadoop-lzo-packager
>>
>> Lars
>>
>>
>> On Wed, Jan 26, 2011 at 10:41 AM, Friso van Vollenhoven
>> <fv...@xebia.com> wrote:
>>> Are you sure it is not a problem with the network on your side? Clicking the link and downloading that jar works fine for me.
>>>
>>> I don't think jar files are either 32 or 64 bit, but the native libraries that go with LZO are. I would recommend building them on your target platform/architecture and not use libs that are built elsewhere.
>>>
>>>
>>> Friso
>>>
>>>
>>>
>>> On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
>>>
>>>> Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
>>>>
>>>> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>>>>
>>>> to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
>>>>
>>>> ivy-resolve-common:
>>>> [ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
>>>> [ivy:resolve] confs: [common]
>>>>
>>>> Would anyone have a pre-build 32bit LZO jar available?
>>>>
>>>> Thanks
>>>>
>>>> -Pete
>>>
>>>
>
>
Re: Building LZO jar
Posted by Friso van Vollenhoven <fv...@xebia.com>.
Hi Lars,
The readme for this talks about the LZO from Google Code and using svn to get it. Does it also work with the more recent versions on Github?
I usually build these things manually and move things around myself. Also because I always try to provide one hadoop+hbase binary + source dist internally that has all the native libs for Linux and OSX, so it also works for the local installs on dev machines...
Friso
On 26 jan 2011, at 12:38, Lars George wrote:
> I agree with Friso, using Todd's LZO Packager this is really easy:
> https://github.com/toddlipcon/hadoop-lzo-packager
>
> Lars
>
>
> On Wed, Jan 26, 2011 at 10:41 AM, Friso van Vollenhoven
> <fv...@xebia.com> wrote:
>> Are you sure it is not a problem with the network on your side? Clicking the link and downloading that jar works fine for me.
>>
>> I don't think jar files are either 32 or 64 bit, but the native libraries that go with LZO are. I would recommend building them on your target platform/architecture and not use libs that are built elsewhere.
>>
>>
>> Friso
>>
>>
>>
>> On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
>>
>>> Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
>>>
>>> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>>>
>>> to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
>>>
>>> ivy-resolve-common:
>>> [ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
>>> [ivy:resolve] confs: [common]
>>>
>>> Would anyone have a pre-build 32bit LZO jar available?
>>>
>>> Thanks
>>>
>>> -Pete
>>
>>
Re: Building LZO jar
Posted by Lars George <la...@gmail.com>.
I agree with Friso, using Todd's LZO Packager this is really easy:
https://github.com/toddlipcon/hadoop-lzo-packager
Lars
On Wed, Jan 26, 2011 at 10:41 AM, Friso van Vollenhoven
<fv...@xebia.com> wrote:
> Are you sure it is not a problem with the network on your side? Clicking the link and downloading that jar works fine for me.
>
> I don't think jar files are either 32 or 64 bit, but the native libraries that go with LZO are. I would recommend building them on your target platform/architecture and not use libs that are built elsewhere.
>
>
> Friso
>
>
>
> On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
>
>> Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
>>
>> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>>
>> to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
>>
>> ivy-resolve-common:
>> [ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
>> [ivy:resolve] confs: [common]
>>
>> Would anyone have a pre-build 32bit LZO jar available?
>>
>> Thanks
>>
>> -Pete
>
>
Re: Building LZO jar
Posted by Friso van Vollenhoven <fv...@xebia.com>.
Are you sure it is not a problem with the network on your side? Clicking the link and downloading that jar works fine for me.
I don't think jar files are either 32 or 64 bit, but the native libraries that go with LZO are. I would recommend building them on your target platform/architecture and not use libs that are built elsewhere.
Friso
On 25 jan 2011, at 21:34, Peter Haidinyak wrote:
> Hi, I am kind of in a pickle right now. I enabled LZO compression on a table without having the correct lzo jar. Now HBase doesn't startup because of the missing jar. I am trying to build the LZO jar but Ivy, for some reason, can't connect to
>
> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
>
> to download the jar. I have tried running the build in offline mode but the Ivy gets stuck at..
>
> ivy-resolve-common:
> [ivy:resolve] :: resolving dependencies :: com.hadoop.gplcompression#Hadoop-GPL-Compression;working@caiss01a
> [ivy:resolve] confs: [common]
>
> Would anyone have a pre-build 32bit LZO jar available?
>
> Thanks
>
> -Pete