You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by Jim Donahue <jd...@adobe.com> on 2012/12/18 18:25:54 UTC
More on problem building Mesos hadoop 0.20.205.0 on Mac OS
The problem building Hadoop 0.20.205.0 is a Java 7 problem. Here's the details (with a patched version):
http://svn.apache.org/viewvc?view=revision&revision=1349441
I wanted to add code to my install script to drop this patch into place before building Hadoop, but I ran into another little thing. In the TUTORIAL.sh script that does the Hadoop build, it checks to see if the directory is already populated and doesn't do the "untar" step if the directory already exists — this is just what I want to be able to slip in my update. However, the Makefile.am file for Hadoop always removes the directory before starting — making it impossible to have the patch survive when you do "make hadoop-0.20.205.0"
It seems that the right thing to do would be remove the "rm" from the Makefile.am.
Thanks,
Jim Donahue
RE: Problem building hadoop-0.20.205.0 on Amazon Linux
Posted by Jim Donahue <jd...@adobe.com>.
Thanks!
Jim
-----Original Message-----
From: Vinod Kone [mailto:vinod@twitter.com]
Sent: Wednesday, February 06, 2013 2:29 PM
To: mesos-dev@incubator.apache.org
Subject: Re: Problem building hadoop-0.20.205.0 on Amazon Linux
FYI, the patch has been committed to trunk.
@vinodkone
On Wed, Feb 6, 2013 at 10:20 AM, Vinod Kone <vi...@twitter.com> wrote:
> Hi Jim,
>
> Looks like we forgot to commit that patch! Will submit it shortly to the
> trunk. Thanks for letting us know.
>
> Meanwhile, I'm attaching the patch with this email. If you place it in
> 'mesos/hadoop' directory, it should get you going. Let me know if that
> unblocks you.
>
> Vinod
>
>
> @vinodkone
>
>
> On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
>> hadoop-0.20.205.0. The error I'm getting is "we seem to be missing
>> hadoop-7698-1.patch."
>>
>> Thanks,
>>
>> Jim
>>
>
>
Re: Problem building hadoop-0.20.205.0 on Amazon Linux
Posted by Vinod Kone <vi...@twitter.com>.
FYI, the patch has been committed to trunk.
@vinodkone
On Wed, Feb 6, 2013 at 10:20 AM, Vinod Kone <vi...@twitter.com> wrote:
> Hi Jim,
>
> Looks like we forgot to commit that patch! Will submit it shortly to the
> trunk. Thanks for letting us know.
>
> Meanwhile, I'm attaching the patch with this email. If you place it in
> 'mesos/hadoop' directory, it should get you going. Let me know if that
> unblocks you.
>
> Vinod
>
>
> @vinodkone
>
>
> On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
>> hadoop-0.20.205.0. The error I'm getting is "we seem to be missing
>> hadoop-7698-1.patch."
>>
>> Thanks,
>>
>> Jim
>>
>
>
Re: Problem building hadoop-0.20.205.0 on Amazon Linux
Posted by Vinod Kone <vi...@twitter.com>.
Hi Jim,
Looks like we forgot to commit that patch! Will submit it shortly to the
trunk. Thanks for letting us know.
Meanwhile, I'm attaching the patch with this email. If you place it in
'mesos/hadoop' directory, it should get you going. Let me know if that
unblocks you.
Vinod
@vinodkone
On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:
> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
> hadoop-0.20.205.0. The error I'm getting is "we seem to be missing
> hadoop-7698-1.patch."
>
> Thanks,
>
> Jim
>
Problem building hadoop-0.20.205.0 on Amazon Linux
Posted by Jim Donahue <jd...@adobe.com>.
I'm trying to build Mesos trunk on Amazon Linux and it fails to build hadoop-0.20.205.0. The error I'm getting is "we seem to be missing hadoop-7698-1.patch."
Thanks,
Jim
RE: Problem building trunk on Amazon Linux
Posted by Jim Donahue <jd...@adobe.com>.
Looks like I'm past it -- thanks!
And, yes, Amazon Linux (64-bit) doesn't have libunwind. So it'd be really nice to turn off the perftools build.
Jim
-----Original Message-----
From: Benjamin Mahler [mailto:bmahler@twitter.com]
Sent: Wednesday, January 09, 2013 12:36 PM
To: mesos-dev@incubator.apache.org
Subject: Re: Problem building trunk on Amazon Linux
Unfortunately, it appears a file was missed during a commit to the svn
trunk.
$ cd mesos
$ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/
Let me know if that works for you.
On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:
> I had a build script that worked, but I guess things changed ... :-(
>
> I had to add --enable-frame-pointers to the arguments to ./configure,
> which got me past a problem building gperftools. But now I'm stuck with
> the following message:
>
> No rule to make target 'gperftools-2.0-stamp' needed by
> 'gperftools-2.0/libprofiler.la
>
> Hunting around on the web, I can't find any obvious fix. Any way I can
> just turn off the building of gperftools, since I don't think I need it?
>
> Thanks,
>
> Jim Donahue
> Adobe Systems
>
>
Re: Problem building trunk on Amazon Linux
Posted by Benjamin Mahler <bm...@twitter.com>.
Also, given you had to provide --enable-frame-pointers, it sounds like
Amazon Linux doesn't have libunwind? Is your distribution 64 bit?
I didn't encounter issues on Ubuntu or CentOS, so I originally excluded the
ability to turn off perftools, out of optimism. Since Amazon Linux has
issues, I'll consider adding this.
On Wed, Jan 9, 2013 at 12:35 PM, Benjamin Mahler <bm...@twitter.com>wrote:
> Unfortunately, it appears a file was missed during a commit to the svn
> trunk.
>
> $ cd mesos
> $ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/
>
> Let me know if that works for you.
>
> On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I had a build script that worked, but I guess things changed ... :-(
>>
>> I had to add --enable-frame-pointers to the arguments to ./configure,
>> which got me past a problem building gperftools. But now I'm stuck with
>> the following message:
>>
>> No rule to make target 'gperftools-2.0-stamp' needed by
>> 'gperftools-2.0/libprofiler.la
>>
>> Hunting around on the web, I can't find any obvious fix. Any way I can
>> just turn off the building of gperftools, since I don't think I need it?
>>
>> Thanks,
>>
>> Jim Donahue
>> Adobe Systems
>>
>>
>
Re: Problem building trunk on Amazon Linux
Posted by Benjamin Mahler <bm...@twitter.com>.
Unfortunately, it appears a file was missed during a commit to the svn
trunk.
$ cd mesos
$ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/
Let me know if that works for you.
On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:
> I had a build script that worked, but I guess things changed ... :-(
>
> I had to add --enable-frame-pointers to the arguments to ./configure,
> which got me past a problem building gperftools. But now I'm stuck with
> the following message:
>
> No rule to make target 'gperftools-2.0-stamp' needed by
> 'gperftools-2.0/libprofiler.la
>
> Hunting around on the web, I can't find any obvious fix. Any way I can
> just turn off the building of gperftools, since I don't think I need it?
>
> Thanks,
>
> Jim Donahue
> Adobe Systems
>
>
Problem building trunk on Amazon Linux
Posted by Jim Donahue <jd...@adobe.com>.
I had a build script that worked, but I guess things changed ... :-(
I had to add --enable-frame-pointers to the arguments to ./configure, which got me past a problem building gperftools. But now I'm stuck with the following message:
No rule to make target 'gperftools-2.0-stamp' needed by 'gperftools-2.0/libprofiler.la
Hunting around on the web, I can't find any obvious fix. Any way I can just turn off the building of gperftools, since I don't think I need it?
Thanks,
Jim Donahue
Adobe Systems