You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2013/02/08 18:38:28 UTC
BigTop 0.3.0 vs make hadoop-deb
Hi,
I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
files because I'm not able to compile them manually.
However, seems that bigtop is not able too ;)
First, the script try to retrieve the 1.0.1 version of hadoop, but
it's no more available in the website. I was able to find it in
another folder and I placed it into the dl folder.
Now, it's failing on the parsechangelog part of the script :(
http://pastebin.com/aaPyWt7M
Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
1.0.3 (the one I need) and got the exact same error.
Thanks,
JM
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Roman,
I have Hadoop 1.0.3 installed and my goal was to get BigTop compiling
the fuse hdfs drivers. Since BigTop 0.3.0 is coming with 1.0.x, that's
the one I tried...
JM
2013/2/10, Roman Shaposhnik <ro...@shaposhnik.org>:
> Hi Jean-Marc!
>
> sorry I can't help you much with the problem you're experiencing,
> but is there any reason you're interested in Bigtop 0.3.0 codeline?
>
> Thanks,
> Roman.
>
> On Fri, Feb 8, 2013 at 9:38 AM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
>> Hi,
>>
>> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
>> files because I'm not able to compile them manually.
>>
>> However, seems that bigtop is not able too ;)
>>
>> First, the script try to retrieve the 1.0.1 version of hadoop, but
>> it's no more available in the website. I was able to find it in
>> another folder and I placed it into the dl folder.
>>
>> Now, it's failing on the parsechangelog part of the script :(
>>
>> http://pastebin.com/aaPyWt7M
>>
>> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
>> 1.0.3 (the one I need) and got the exact same error.
>>
>> Thanks,
>>
>> JM
>
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Hi Jean-Marc!
sorry I can't help you much with the problem you're experiencing,
but is there any reason you're interested in Bigtop 0.3.0 codeline?
Thanks,
Roman.
On Fri, Feb 8, 2013 at 9:38 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> Hi,
>
> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
> files because I'm not able to compile them manually.
>
> However, seems that bigtop is not able too ;)
>
> First, the script try to retrieve the 1.0.1 version of hadoop, but
> it's no more available in the website. I was able to find it in
> another folder and I placed it into the dl folder.
>
> Now, it's failing on the parsechangelog part of the script :(
>
> http://pastebin.com/aaPyWt7M
>
> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
> 1.0.3 (the one I need) and got the exact same error.
>
> Thanks,
>
> JM
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I tried to reconfigure my local to en_CA using dpkg-reconfigure
locales and it's going better but still failing.
I have to install libzip-dev which was not listed in the README.
With libzip-dev and the local changed, it's making way more but it's
failing at this:
[exec] /home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libtool:
3212: /home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libtool:
install_prog+=cp: not found
and
[exec] /home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libtool:
3232: /home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libtool:
files+= /home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libhadoop.la:
not found
I have libtool in this folder, so I'm not sure what is missing now.
libhadoop.la also is thereé
jmspaggi@buldo:~/bigtop-0.3.0-incubating$ ll
/home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libhadoop.la
-rw-r--r-- 1 jmspaggi jmspaggi 1018 Feb 13 11:58
/home/jmspaggi/bigtop-0.3.0-incubating/output/hadoop/hadoop-1.0.1/build/native/Linux-amd64-64/libhadoop.la
Regarding 1.0.1 vs 1.0.3, I understand why it's trying to use 1.0.1.
Should BigTop try to get 1.0.1 from another location? Or should it try
to get 1.0.2, then 1.0.3 and so on, if the previous one is not
available?
JM
2013/2/12, Roman Shaposhnik <ro...@shaposhnik.org>:
> On Tue, Feb 12, 2013 at 7:10 AM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
>> @Bruno: I think also that it's the issue. If I have time I will give
>> it a try and change the local...
>
> Please do let us know what happens. Better yet, could you please
> create a JIRA and record your experience over there? That way
> we can benefit from it some time down the road.
>
>> @Doug: I don't see version 1.1.0 anywhere :( It's all 1.0.x... x
>> beeing 1 for BigTop, but 4 for the last hadoop release.
>> @Mark: Exact. It's trying to take a version which doesn't exist. Maybe
>> the script should try to retreive the most recent 1.0.x version
>> instead of a fixed one?
>
> Bigtop releases guarantee a certain bill of materials -- in that we can't
> retroactively change the source of the bits. We can, however, provide
> those fixes in the branch-0.3. -- send us a patch!
>
> Thanks,
> Roman.
>
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Tue, Feb 12, 2013 at 7:10 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> @Bruno: I think also that it's the issue. If I have time I will give
> it a try and change the local...
Please do let us know what happens. Better yet, could you please
create a JIRA and record your experience over there? That way
we can benefit from it some time down the road.
> @Doug: I don't see version 1.1.0 anywhere :( It's all 1.0.x... x
> beeing 1 for BigTop, but 4 for the last hadoop release.
> @Mark: Exact. It's trying to take a version which doesn't exist. Maybe
> the script should try to retreive the most recent 1.0.x version
> instead of a fixed one?
Bigtop releases guarantee a certain bill of materials -- in that we can't
retroactively change the source of the bits. We can, however, provide
those fixes in the branch-0.3. -- send us a patch!
Thanks,
Roman.
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
@Bruno: I think also that it's the issue. If I have time I will give
it a try and change the local...
@Doug: I don't see version 1.1.0 anywhere :( It's all 1.0.x... x
beeing 1 for BigTop, but 4 for the last hadoop release.
@Mark: Exact. It's trying to take a version which doesn't exist. Maybe
the script should try to retreive the most recent 1.0.x version
instead of a fixed one?
2013/2/12, Mark Grover <gr...@gmail.com>:
> I did notice that the Hadoop mirror Bigtop 0.3.0 was referring to is no
> longer around.
>
> On Tue, Feb 12, 2013 at 5:26 AM, Doug Chang
> <do...@stanfordalumni.org>wrote:
>
>> Bigtop version is: hadoop-1.0.1 from cd
>> /home/jmspaggi/bigtop-0.3.0-incubating/build/hadoop//deb/hadoop-1.0.1 &&
>> \
>>
>> the dpkg version is: dpkg-buildpackage: version source 1.0.1-1
>>
>> versions still not matched 1.1.0 != 1.0.1-1
>>
>> maybe change bigtop.mk hadoop version to 1.0.1-1?
>>
>>
>> On Tue, Feb 12, 2013 at 12:50 AM, Bruno Mahé <bm...@apache.org> wrote:
>>
>>> On 02/08/2013 09:38 AM, Jean-Marc Spaggiari wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
>>>> files because I'm not able to compile them manually.
>>>>
>>>> However, seems that bigtop is not able too ;)
>>>>
>>>> First, the script try to retrieve the 1.0.1 version of hadoop, but
>>>> it's no more available in the website. I was able to find it in
>>>> another folder and I placed it into the dl folder.
>>>>
>>>> Now, it's failing on the parsechangelog part of the script :(
>>>>
>>>> http://pastebin.com/aaPyWt7M
>>>>
>>>> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
>>>> 1.0.3 (the one I need) and got the exact same error.
>>>>
>>>> Thanks,
>>>>
>>>> JM
>>>>
>>>>
>>>
>>> Hi Jean-Marc,
>>>
>>> This ought to work, so there must be some issue somewhere.
>>> The only thing I found from googling around is some reference to the
>>> french locale not being parsed correctly by the deb scripts.
>>>
>>> So could you try setting your locale in english so dates do not contain
>>> accents?
>>>
>>>
>>> Thanks,
>>> Bruno
>>>
>>
>>
>
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Mark Grover <gr...@gmail.com>.
I did notice that the Hadoop mirror Bigtop 0.3.0 was referring to is no
longer around.
On Tue, Feb 12, 2013 at 5:26 AM, Doug Chang <do...@stanfordalumni.org>wrote:
> Bigtop version is: hadoop-1.0.1 from cd
> /home/jmspaggi/bigtop-0.3.0-incubating/build/hadoop//deb/hadoop-1.0.1 && \
>
> the dpkg version is: dpkg-buildpackage: version source 1.0.1-1
>
> versions still not matched 1.1.0 != 1.0.1-1
>
> maybe change bigtop.mk hadoop version to 1.0.1-1?
>
>
> On Tue, Feb 12, 2013 at 12:50 AM, Bruno Mahé <bm...@apache.org> wrote:
>
>> On 02/08/2013 09:38 AM, Jean-Marc Spaggiari wrote:
>>
>>> Hi,
>>>
>>> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
>>> files because I'm not able to compile them manually.
>>>
>>> However, seems that bigtop is not able too ;)
>>>
>>> First, the script try to retrieve the 1.0.1 version of hadoop, but
>>> it's no more available in the website. I was able to find it in
>>> another folder and I placed it into the dl folder.
>>>
>>> Now, it's failing on the parsechangelog part of the script :(
>>>
>>> http://pastebin.com/aaPyWt7M
>>>
>>> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
>>> 1.0.3 (the one I need) and got the exact same error.
>>>
>>> Thanks,
>>>
>>> JM
>>>
>>>
>>
>> Hi Jean-Marc,
>>
>> This ought to work, so there must be some issue somewhere.
>> The only thing I found from googling around is some reference to the
>> french locale not being parsed correctly by the deb scripts.
>>
>> So could you try setting your locale in english so dates do not contain
>> accents?
>>
>>
>> Thanks,
>> Bruno
>>
>
>
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Doug Chang <do...@stanfordalumni.org>.
Bigtop version is: hadoop-1.0.1 from cd
/home/jmspaggi/bigtop-0.3.0-incubating/build/hadoop//deb/hadoop-1.0.1 && \
the dpkg version is: dpkg-buildpackage: version source 1.0.1-1
versions still not matched 1.1.0 != 1.0.1-1
maybe change bigtop.mk hadoop version to 1.0.1-1?
On Tue, Feb 12, 2013 at 12:50 AM, Bruno Mahé <bm...@apache.org> wrote:
> On 02/08/2013 09:38 AM, Jean-Marc Spaggiari wrote:
>
>> Hi,
>>
>> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
>> files because I'm not able to compile them manually.
>>
>> However, seems that bigtop is not able too ;)
>>
>> First, the script try to retrieve the 1.0.1 version of hadoop, but
>> it's no more available in the website. I was able to find it in
>> another folder and I placed it into the dl folder.
>>
>> Now, it's failing on the parsechangelog part of the script :(
>>
>> http://pastebin.com/aaPyWt7M
>>
>> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
>> 1.0.3 (the one I need) and got the exact same error.
>>
>> Thanks,
>>
>> JM
>>
>>
>
> Hi Jean-Marc,
>
> This ought to work, so there must be some issue somewhere.
> The only thing I found from googling around is some reference to the
> french locale not being parsed correctly by the deb scripts.
>
> So could you try setting your locale in english so dates do not contain
> accents?
>
>
> Thanks,
> Bruno
>
Re: BigTop 0.3.0 vs make hadoop-deb
Posted by Bruno Mahé <bm...@apache.org>.
On 02/08/2013 09:38 AM, Jean-Marc Spaggiari wrote:
> Hi,
>
> I'm trying to bild hadoop-deb with bigtop 0.3.0 to get the libdfs
> files because I'm not able to compile them manually.
>
> However, seems that bigtop is not able too ;)
>
> First, the script try to retrieve the 1.0.1 version of hadoop, but
> it's no more available in the website. I was able to find it in
> another folder and I placed it into the dl folder.
>
> Now, it's failing on the parsechangelog part of the script :(
>
> http://pastebin.com/aaPyWt7M
>
> Any idea how I can fix that? I tried to replace the 1.0.1 jar by the
> 1.0.3 (the one I need) and got the exact same error.
>
> Thanks,
>
> JM
>
Hi Jean-Marc,
This ought to work, so there must be some issue somewhere.
The only thing I found from googling around is some reference to the
french locale not being parsed correctly by the deb scripts.
So could you try setting your locale in english so dates do not contain
accents?
Thanks,
Bruno