You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by Jim Donahue <jd...@adobe.com> on 2012/12/17 20:45:22 UTC

Problem building Mesos hadoop 0.20.205.0 on Mac OS

I decided I'd see if I could get through the entire Mesos/Hadoop build on my new Mac OS machine and ran into this while attempting to run

Make hadoop-0.20.305.0

after building Mesos (from trunk).

Thanks,

Jim Donahue
Adobe


compile:
     [echo] contrib: gridmix
    [javac] /usr/local/var/mesos/hadoop/hadoop-0.20.205.0/src/contrib/build-contrib.xml:185: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
    [javac] Compiling 31 source files to /usr/local/var/mesos/hadoop/hadoop-0.20.205.0/build/contrib/gridmix/classes
    [javac] /usr/local/var/mesos/hadoop/hadoop-0.20.205.0/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Gridmix.java:396: error: type argument ? extends T is not within bounds of type-variable E
    [javac]   private <T> String getEnumValues(Enum<? extends T>[] e) {
    [javac]                                         ^
    [javac]   where T,E are type-variables:
    [javac]     T extends Object declared in method <T>getEnumValues(Enum<? extends T>[])
    [javac]     E extends Enum<E> declared in class Enum
    [javac] /usr/local/var/mesos/hadoop/hadoop-0.20.205.0/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Gridmix.java:399: error: type argument ? extends T is not within bounds of type-variable E
    [javac]     for (Enum<? extends T> v : e) {
    [javac]               ^
    [javac]   where T,E are type-variables:
    [javac]     T extends Object declared in method <T>getEnumValues(Enum<? extends T>[])
    [javac]     E extends Enum<E> declared in class Enum
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 2 errors

BUILD FAILED
/usr/local/var/mesos/hadoop/hadoop-0.20.205.0/build.xml:659: The following error occurred while executing this line:
/usr/local/var/mesos/hadoop/hadoop-0.20.205.0/src/contrib/build.xml:30: The following error occurred while executing this line:
/usr/local/var/mesos/hadoop/hadoop-0.20.205.0/src/contrib/build-contrib.xml:185: Compile failed; see the compiler error output for details.

RE: Problem building hadoop-0.20.205.0 on Amazon Linux

Posted by Jim Donahue <jd...@adobe.com>.
Thanks!

Jim

-----Original Message-----
From: Vinod Kone [mailto:vinod@twitter.com] 
Sent: Wednesday, February 06, 2013 2:29 PM
To: mesos-dev@incubator.apache.org
Subject: Re: Problem building hadoop-0.20.205.0 on Amazon Linux

FYI, the patch has been committed to trunk.


@vinodkone


On Wed, Feb 6, 2013 at 10:20 AM, Vinod Kone <vi...@twitter.com> wrote:

> Hi Jim,
>
> Looks like we forgot to commit that patch! Will submit it shortly to the
> trunk. Thanks for letting us know.
>
> Meanwhile, I'm attaching the patch with this email. If you place it in
> 'mesos/hadoop' directory, it should get you going. Let me know if that
> unblocks you.
>
> Vinod
>
>
> @vinodkone
>
>
> On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
>> hadoop-0.20.205.0.  The error I'm getting is "we seem to be missing
>> hadoop-7698-1.patch."
>>
>> Thanks,
>>
>> Jim
>>
>
>

Re: Problem building hadoop-0.20.205.0 on Amazon Linux

Posted by Vinod Kone <vi...@twitter.com>.
FYI, the patch has been committed to trunk.


@vinodkone


On Wed, Feb 6, 2013 at 10:20 AM, Vinod Kone <vi...@twitter.com> wrote:

> Hi Jim,
>
> Looks like we forgot to commit that patch! Will submit it shortly to the
> trunk. Thanks for letting us know.
>
> Meanwhile, I'm attaching the patch with this email. If you place it in
> 'mesos/hadoop' directory, it should get you going. Let me know if that
> unblocks you.
>
> Vinod
>
>
> @vinodkone
>
>
> On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
>> hadoop-0.20.205.0.  The error I'm getting is "we seem to be missing
>> hadoop-7698-1.patch."
>>
>> Thanks,
>>
>> Jim
>>
>
>

Re: Problem building hadoop-0.20.205.0 on Amazon Linux

Posted by Vinod Kone <vi...@twitter.com>.
Hi Jim,

Looks like we forgot to commit that patch! Will submit it shortly to the
trunk. Thanks for letting us know.

Meanwhile, I'm attaching the patch with this email. If you place it in
'mesos/hadoop' directory, it should get you going. Let me know if that
unblocks you.

Vinod


@vinodkone


On Wed, Feb 6, 2013 at 10:09 AM, Jim Donahue <jd...@adobe.com> wrote:

> I'm trying to build Mesos trunk on Amazon Linux and it fails to build
> hadoop-0.20.205.0.  The error I'm getting is "we seem to be missing
> hadoop-7698-1.patch."
>
> Thanks,
>
> Jim
>

Problem building hadoop-0.20.205.0 on Amazon Linux

Posted by Jim Donahue <jd...@adobe.com>.
I'm trying to build Mesos trunk on Amazon Linux and it fails to build hadoop-0.20.205.0.  The error I'm getting is "we seem to be missing hadoop-7698-1.patch."

Thanks,

Jim

RE: Problem building trunk on Amazon Linux

Posted by Jim Donahue <jd...@adobe.com>.
Looks like I'm past it -- thanks!

And, yes, Amazon Linux (64-bit) doesn't have libunwind. So it'd be really nice to turn off the perftools build.


Jim

-----Original Message-----
From: Benjamin Mahler [mailto:bmahler@twitter.com] 
Sent: Wednesday, January 09, 2013 12:36 PM
To: mesos-dev@incubator.apache.org
Subject: Re: Problem building trunk on Amazon Linux

Unfortunately, it appears a file was missed during a commit to the svn
trunk.

$ cd mesos
$ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/

Let me know if that works for you.

On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:

> I had a build script that worked, but I guess things changed ... :-(
>
> I had to add --enable-frame-pointers to the arguments to ./configure,
> which got me past a problem building gperftools.  But now I'm stuck with
> the following message:
>
>         No rule to make target 'gperftools-2.0-stamp' needed by
> 'gperftools-2.0/libprofiler.la
>
> Hunting around on the web, I can't find any obvious fix.  Any way I can
> just turn off the building of gperftools, since I don't think I need it?
>
> Thanks,
>
> Jim Donahue
> Adobe Systems
>
>

Re: Problem building trunk on Amazon Linux

Posted by Benjamin Mahler <bm...@twitter.com>.
Also, given you had to provide --enable-frame-pointers, it sounds like
Amazon Linux doesn't have libunwind? Is your distribution 64 bit?

I didn't encounter issues on Ubuntu or CentOS, so I originally excluded the
ability to turn off perftools, out of optimism. Since Amazon Linux has
issues, I'll consider adding this.

On Wed, Jan 9, 2013 at 12:35 PM, Benjamin Mahler <bm...@twitter.com>wrote:

> Unfortunately, it appears a file was missed during a commit to the svn
> trunk.
>
> $ cd mesos
> $ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/
>
> Let me know if that works for you.
>
> On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:
>
>> I had a build script that worked, but I guess things changed ... :-(
>>
>> I had to add --enable-frame-pointers to the arguments to ./configure,
>> which got me past a problem building gperftools.  But now I'm stuck with
>> the following message:
>>
>>         No rule to make target 'gperftools-2.0-stamp' needed by
>> 'gperftools-2.0/libprofiler.la
>>
>> Hunting around on the web, I can't find any obvious fix.  Any way I can
>> just turn off the building of gperftools, since I don't think I need it?
>>
>> Thanks,
>>
>> Jim Donahue
>> Adobe Systems
>>
>>
>

Re: Problem building trunk on Amazon Linux

Posted by Benjamin Mahler <bm...@twitter.com>.
Unfortunately, it appears a file was missed during a commit to the svn
trunk.

$ cd mesos
$ cp third_party/libprocess/third_party/gperftools-2.0.tar.gz third_party/

Let me know if that works for you.

On Wed, Jan 9, 2013 at 12:30 PM, Jim Donahue <jd...@adobe.com> wrote:

> I had a build script that worked, but I guess things changed ... :-(
>
> I had to add --enable-frame-pointers to the arguments to ./configure,
> which got me past a problem building gperftools.  But now I'm stuck with
> the following message:
>
>         No rule to make target 'gperftools-2.0-stamp' needed by
> 'gperftools-2.0/libprofiler.la
>
> Hunting around on the web, I can't find any obvious fix.  Any way I can
> just turn off the building of gperftools, since I don't think I need it?
>
> Thanks,
>
> Jim Donahue
> Adobe Systems
>
>

Problem building trunk on Amazon Linux

Posted by Jim Donahue <jd...@adobe.com>.
I had a build script that worked, but I guess things changed ... :-(

I had to add --enable-frame-pointers to the arguments to ./configure, which got me past a problem building gperftools.  But now I'm stuck with the following message:

	No rule to make target 'gperftools-2.0-stamp' needed by 'gperftools-2.0/libprofiler.la

Hunting around on the web, I can't find any obvious fix.  Any way I can just turn off the building of gperftools, since I don't think I need it?

Thanks,

Jim Donahue
Adobe Systems

More on problem building Mesos hadoop 0.20.205.0 on Mac OS

Posted by Jim Donahue <jd...@adobe.com>.
The problem building Hadoop 0.20.205.0 is a Java 7 problem.  Here's the details (with a patched version):

http://svn.apache.org/viewvc?view=revision&revision=1349441

I wanted to add code to my install script to drop this patch into place before building Hadoop, but I ran into another little thing.  In the TUTORIAL.sh script that does the Hadoop build, it checks to see if the directory is already populated and doesn't do the "untar" step if the directory already exists — this is just what I want to be able to slip in my update.  However, the Makefile.am file for Hadoop always removes the directory before starting — making it impossible to have the patch survive when you do "make hadoop-0.20.205.0"

It seems that the right thing to do would be remove the "rm" from the Makefile.am.

Thanks,

Jim Donahue