You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Robert Evans <ev...@yahoo-inc.com> on 2011/08/29 18:18:43 UTC

Trunk and 0.23 build failing with clean .m2 directory

I am getting the following errors when I try to build either trunk or 0.23
with a clean maven cache.  I don't get any errors if I use my old cache.

[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
hadoop-yarn-common ---
[INFO] Compiling 2 source files to
/home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
common/target/classes
[INFO]             
[INFO] 
------------------------------------------------------------------------
[INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
[INFO] 
------------------------------------------------------------------------
[INFO] 
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.714s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.323s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.001s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.025s]
[INFO] Apache Hadoop Alfredo ............................. SUCCESS [0.067s]
[INFO] Apache Hadoop Common .............................. SUCCESS [2.117s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.001s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [1.419s]
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.001s]
[INFO] hadoop-yarn-api ................................... SUCCESS [7.019s]
[INFO] hadoop-yarn-common ................................ SUCCESS [2.181s]
[INFO] hadoop-yarn-server-common ......................... FAILURE [0.058s]
[INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
[INFO] hadoop-yarn-server-tests .......................... SKIPPED
[INFO] hadoop-yarn-server ................................ SKIPPED
[INFO] hadoop-yarn ....................................... SKIPPED
[INFO] hadoop-mapreduce-client-core ...................... SKIPPED
[INFO] hadoop-mapreduce-client-common .................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
[INFO] hadoop-mapreduce-client-app ....................... SKIPPED
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client ........................... SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] Apache Hadoop Main ................................ SKIPPED
[INFO] 
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] 
------------------------------------------------------------------------
[INFO] Total time: 14.938s
[INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
[INFO] Final Memory: 29M/207M
[INFO] 
------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hadoop-yarn-server-common: Could
not resolve dependencies for project
org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure to
find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshot was
cached in the local repository, resolution will not be reattempted until the
update interval of local apache.snapshot mirror has elapsed or updates are
forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
on
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <goals> -rf :hadoop-yarn-server-common


Is anyone looking into this yet?

--Bobby


Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Robert Evans <ev...@yahoo-inc.com>.
DONE I filed HADOOP-7589 and uploaded my patch to it.  Alejandro, could you take a quick look at the patch because you appear to be the maven expert.

Thanks,

Bobby Evans

On 8/29/11 12:39 PM, "Mahadev Konar" <ma...@hortonworks.com> wrote:

Bobby,
 You are right. The test-patch uses mvn compile. Please file a jira.
It should be a minor change:

thanks
mahadev

On Mon, Aug 29, 2011 at 10:34 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Thanks Alejandro,
>
> That really clears things up. Is the a JIRA you know of to change test-patch to do mvn test -DskipTests instead of mvn compile?  If not I can file one and do the work.  Test-patch failed for me because of this.
>
> --Bobby
>
> On 8/29/11 12:21 PM, "Alejandro Abdelnur" <tu...@cloudera.com> wrote:
>
> The reason for this failure is because of how Maven reactor/dependency
> resolution works (IMO a bug).
>
> Maven reactor/dependency resolution is smart enough to create the classpath
> using the classes from all modules being built.
>
> However, this smartness falls short just a bit. The dependencies are
> resolved using the deepest maven phase used by current mvn invocation. If
> you are doing 'mvn compile' you don't get to the test compile phase.  This
> means that the TEST classes are not resolved from the build but from the
> cache/repo.
>
> The solution is to run 'mvn test -DskipTests' instead 'mvn compile'. This
> will include the TEST classes from the build.
>
> The same when creating the eclipse profile, run 'mvn test -DskipTests
> eclipse:eclipse'
>
> Thanks.
>
> Alejandro
>
> On Mon, Aug 29, 2011 at 9:59 AM, Ravi Prakash <ra...@gmail.com> wrote:
>
>> Yeah I've seen this before. Sometimes I had to descend into child
>> directories to mvn install them, before I could maven install parents. I'm
>> hoping/guessing that issue is fixed now
>>
>> On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans <ev...@yahoo-inc.com>
>> wrote:
>>
>> > Wow this is odd install works just fine, but compile fails unless I do an
>> > install first (I found this trying to run test-patch).
>> >
>> > $mvn --version
>> > Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
>> > Maven home: /home/evans/bin/maven
>> > Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
>> > Java home: /home/evans/bin/jdk1.6.0/jre
>> > Default locale: en_US, platform encoding: UTF-8
>> > OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family:
>> > "unix"
>> >
>> > Has anyone else seen this, or is there something messed up with my
>> machine?
>> >
>> > Thanks,
>> >
>> > Bobby
>> >
>> > On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>> >
>> > I am getting the following errors when I try to build either trunk or
>> 0.23
>> > with a clean maven cache.  I don't get any errors if I use my old cache.
>> >
>> > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
>> > hadoop-yarn-common ---
>> > [INFO] Compiling 2 source files to
>> >
>> >
>> /home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
>> > common/target/classes
>> > [INFO]
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Reactor Summary:
>> > [INFO]
>> > [INFO] Apache Hadoop Project POM ......................... SUCCESS
>> [0.714s]
>> > [INFO] Apache Hadoop Annotations ......................... SUCCESS
>> [0.323s]
>> > [INFO] Apache Hadoop Project Dist POM .................... SUCCESS
>> [0.001s]
>> > [INFO] Apache Hadoop Assemblies .......................... SUCCESS
>> [0.025s]
>> > [INFO] Apache Hadoop Alfredo ............................. SUCCESS
>> [0.067s]
>> > [INFO] Apache Hadoop Common .............................. SUCCESS
>> [2.117s]
>> > [INFO] Apache Hadoop Common Project ...................... SUCCESS
>> [0.001s]
>> > [INFO] Apache Hadoop HDFS ................................ SUCCESS
>> [1.419s]
>> > [INFO] Apache Hadoop HDFS Project ........................ SUCCESS
>> [0.001s]
>> > [INFO] hadoop-yarn-api ................................... SUCCESS
>> [7.019s]
>> > [INFO] hadoop-yarn-common ................................ SUCCESS
>> [2.181s]
>> > [INFO] hadoop-yarn-server-common ......................... FAILURE
>> [0.058s]
>> > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
>> > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
>> > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
>> > [INFO] hadoop-yarn-server ................................ SKIPPED
>> > [INFO] hadoop-yarn ....................................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-common .................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
>> > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
>> > [INFO] hadoop-mapreduce-client ........................... SKIPPED
>> > [INFO] hadoop-mapreduce .................................. SKIPPED
>> > [INFO] Apache Hadoop Main ................................ SKIPPED
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] BUILD FAILURE
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Total time: 14.938s
>> > [INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
>> > [INFO] Final Memory: 29M/207M
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [ERROR] Failed to execute goal on project hadoop-yarn-server-common:
>> Could
>> > not resolve dependencies for project
>> > org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure
>> to
>> > find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
>> > http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshotwas
>> > cached in the local repository, resolution will not be reattempted until
>> > the
>> > update interval of local apache.snapshot mirror has elapsed or updates
>> are
>> > forced -> [Help 1]
>> > [ERROR]
>> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e
>> > switch.
>> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> > [ERROR]
>> > [ERROR] For more information about the errors and possible solutions,
>> > please
>> > read the following articles:
>> > [ERROR] [Help 1]
>> >
>> >
>> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
>> > on
>> > [ERROR]
>> > [ERROR] After correcting the problems, you can resume the build with the
>> > command
>> > [ERROR]   mvn <goals> -rf :hadoop-yarn-server-common
>> >
>> >
>> > Is anyone looking into this yet?
>> >
>> > --Bobby
>> >
>> >
>> >
>>
>
>


Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Mahadev Konar <ma...@hortonworks.com>.
Bobby,
 You are right. The test-patch uses mvn compile. Please file a jira.
It should be a minor change:

thanks
mahadev

On Mon, Aug 29, 2011 at 10:34 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Thanks Alejandro,
>
> That really clears things up. Is the a JIRA you know of to change test-patch to do mvn test -DskipTests instead of mvn compile?  If not I can file one and do the work.  Test-patch failed for me because of this.
>
> --Bobby
>
> On 8/29/11 12:21 PM, "Alejandro Abdelnur" <tu...@cloudera.com> wrote:
>
> The reason for this failure is because of how Maven reactor/dependency
> resolution works (IMO a bug).
>
> Maven reactor/dependency resolution is smart enough to create the classpath
> using the classes from all modules being built.
>
> However, this smartness falls short just a bit. The dependencies are
> resolved using the deepest maven phase used by current mvn invocation. If
> you are doing 'mvn compile' you don't get to the test compile phase.  This
> means that the TEST classes are not resolved from the build but from the
> cache/repo.
>
> The solution is to run 'mvn test -DskipTests' instead 'mvn compile'. This
> will include the TEST classes from the build.
>
> The same when creating the eclipse profile, run 'mvn test -DskipTests
> eclipse:eclipse'
>
> Thanks.
>
> Alejandro
>
> On Mon, Aug 29, 2011 at 9:59 AM, Ravi Prakash <ra...@gmail.com> wrote:
>
>> Yeah I've seen this before. Sometimes I had to descend into child
>> directories to mvn install them, before I could maven install parents. I'm
>> hoping/guessing that issue is fixed now
>>
>> On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans <ev...@yahoo-inc.com>
>> wrote:
>>
>> > Wow this is odd install works just fine, but compile fails unless I do an
>> > install first (I found this trying to run test-patch).
>> >
>> > $mvn --version
>> > Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
>> > Maven home: /home/evans/bin/maven
>> > Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
>> > Java home: /home/evans/bin/jdk1.6.0/jre
>> > Default locale: en_US, platform encoding: UTF-8
>> > OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family:
>> > "unix"
>> >
>> > Has anyone else seen this, or is there something messed up with my
>> machine?
>> >
>> > Thanks,
>> >
>> > Bobby
>> >
>> > On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>> >
>> > I am getting the following errors when I try to build either trunk or
>> 0.23
>> > with a clean maven cache.  I don't get any errors if I use my old cache.
>> >
>> > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
>> > hadoop-yarn-common ---
>> > [INFO] Compiling 2 source files to
>> >
>> >
>> /home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
>> > common/target/classes
>> > [INFO]
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Reactor Summary:
>> > [INFO]
>> > [INFO] Apache Hadoop Project POM ......................... SUCCESS
>> [0.714s]
>> > [INFO] Apache Hadoop Annotations ......................... SUCCESS
>> [0.323s]
>> > [INFO] Apache Hadoop Project Dist POM .................... SUCCESS
>> [0.001s]
>> > [INFO] Apache Hadoop Assemblies .......................... SUCCESS
>> [0.025s]
>> > [INFO] Apache Hadoop Alfredo ............................. SUCCESS
>> [0.067s]
>> > [INFO] Apache Hadoop Common .............................. SUCCESS
>> [2.117s]
>> > [INFO] Apache Hadoop Common Project ...................... SUCCESS
>> [0.001s]
>> > [INFO] Apache Hadoop HDFS ................................ SUCCESS
>> [1.419s]
>> > [INFO] Apache Hadoop HDFS Project ........................ SUCCESS
>> [0.001s]
>> > [INFO] hadoop-yarn-api ................................... SUCCESS
>> [7.019s]
>> > [INFO] hadoop-yarn-common ................................ SUCCESS
>> [2.181s]
>> > [INFO] hadoop-yarn-server-common ......................... FAILURE
>> [0.058s]
>> > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
>> > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
>> > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
>> > [INFO] hadoop-yarn-server ................................ SKIPPED
>> > [INFO] hadoop-yarn ....................................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-common .................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
>> > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
>> > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
>> > [INFO] hadoop-mapreduce-client ........................... SKIPPED
>> > [INFO] hadoop-mapreduce .................................. SKIPPED
>> > [INFO] Apache Hadoop Main ................................ SKIPPED
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] BUILD FAILURE
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [INFO] Total time: 14.938s
>> > [INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
>> > [INFO] Final Memory: 29M/207M
>> > [INFO]
>> > ------------------------------------------------------------------------
>> > [ERROR] Failed to execute goal on project hadoop-yarn-server-common:
>> Could
>> > not resolve dependencies for project
>> > org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure
>> to
>> > find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
>> > http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshotwas
>> > cached in the local repository, resolution will not be reattempted until
>> > the
>> > update interval of local apache.snapshot mirror has elapsed or updates
>> are
>> > forced -> [Help 1]
>> > [ERROR]
>> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e
>> > switch.
>> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> > [ERROR]
>> > [ERROR] For more information about the errors and possible solutions,
>> > please
>> > read the following articles:
>> > [ERROR] [Help 1]
>> >
>> >
>> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
>> > on
>> > [ERROR]
>> > [ERROR] After correcting the problems, you can resume the build with the
>> > command
>> > [ERROR]   mvn <goals> -rf :hadoop-yarn-server-common
>> >
>> >
>> > Is anyone looking into this yet?
>> >
>> > --Bobby
>> >
>> >
>> >
>>
>
>

Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Robert Evans <ev...@yahoo-inc.com>.
Thanks Alejandro,

That really clears things up. Is the a JIRA you know of to change test-patch to do mvn test -DskipTests instead of mvn compile?  If not I can file one and do the work.  Test-patch failed for me because of this.

--Bobby

On 8/29/11 12:21 PM, "Alejandro Abdelnur" <tu...@cloudera.com> wrote:

The reason for this failure is because of how Maven reactor/dependency
resolution works (IMO a bug).

Maven reactor/dependency resolution is smart enough to create the classpath
using the classes from all modules being built.

However, this smartness falls short just a bit. The dependencies are
resolved using the deepest maven phase used by current mvn invocation. If
you are doing 'mvn compile' you don't get to the test compile phase.  This
means that the TEST classes are not resolved from the build but from the
cache/repo.

The solution is to run 'mvn test -DskipTests' instead 'mvn compile'. This
will include the TEST classes from the build.

The same when creating the eclipse profile, run 'mvn test -DskipTests
eclipse:eclipse'

Thanks.

Alejandro

On Mon, Aug 29, 2011 at 9:59 AM, Ravi Prakash <ra...@gmail.com> wrote:

> Yeah I've seen this before. Sometimes I had to descend into child
> directories to mvn install them, before I could maven install parents. I'm
> hoping/guessing that issue is fixed now
>
> On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans <ev...@yahoo-inc.com>
> wrote:
>
> > Wow this is odd install works just fine, but compile fails unless I do an
> > install first (I found this trying to run test-patch).
> >
> > $mvn --version
> > Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
> > Maven home: /home/evans/bin/maven
> > Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
> > Java home: /home/evans/bin/jdk1.6.0/jre
> > Default locale: en_US, platform encoding: UTF-8
> > OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family:
> > "unix"
> >
> > Has anyone else seen this, or is there something messed up with my
> machine?
> >
> > Thanks,
> >
> > Bobby
> >
> > On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
> >
> > I am getting the following errors when I try to build either trunk or
> 0.23
> > with a clean maven cache.  I don't get any errors if I use my old cache.
> >
> > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
> > hadoop-yarn-common ---
> > [INFO] Compiling 2 source files to
> >
> >
> /home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
> > common/target/classes
> > [INFO]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache Hadoop Project POM ......................... SUCCESS
> [0.714s]
> > [INFO] Apache Hadoop Annotations ......................... SUCCESS
> [0.323s]
> > [INFO] Apache Hadoop Project Dist POM .................... SUCCESS
> [0.001s]
> > [INFO] Apache Hadoop Assemblies .......................... SUCCESS
> [0.025s]
> > [INFO] Apache Hadoop Alfredo ............................. SUCCESS
> [0.067s]
> > [INFO] Apache Hadoop Common .............................. SUCCESS
> [2.117s]
> > [INFO] Apache Hadoop Common Project ...................... SUCCESS
> [0.001s]
> > [INFO] Apache Hadoop HDFS ................................ SUCCESS
> [1.419s]
> > [INFO] Apache Hadoop HDFS Project ........................ SUCCESS
> [0.001s]
> > [INFO] hadoop-yarn-api ................................... SUCCESS
> [7.019s]
> > [INFO] hadoop-yarn-common ................................ SUCCESS
> [2.181s]
> > [INFO] hadoop-yarn-server-common ......................... FAILURE
> [0.058s]
> > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
> > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> > [INFO] hadoop-yarn-server ................................ SKIPPED
> > [INFO] hadoop-yarn ....................................... SKIPPED
> > [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
> > [INFO] hadoop-mapreduce-client-common .................... SKIPPED
> > [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
> > [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
> > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> > [INFO] hadoop-mapreduce-client ........................... SKIPPED
> > [INFO] hadoop-mapreduce .................................. SKIPPED
> > [INFO] Apache Hadoop Main ................................ SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 14.938s
> > [INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
> > [INFO] Final Memory: 29M/207M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal on project hadoop-yarn-server-common:
> Could
> > not resolve dependencies for project
> > org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure
> to
> > find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
> > http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshotwas
> > cached in the local repository, resolution will not be reattempted until
> > the
> > update interval of local apache.snapshot mirror has elapsed or updates
> are
> > forced -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please
> > read the following articles:
> > [ERROR] [Help 1]
> >
> >
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
> > on
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR]   mvn <goals> -rf :hadoop-yarn-server-common
> >
> >
> > Is anyone looking into this yet?
> >
> > --Bobby
> >
> >
> >
>


Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Alejandro Abdelnur <tu...@cloudera.com>.
The reason for this failure is because of how Maven reactor/dependency
resolution works (IMO a bug).

Maven reactor/dependency resolution is smart enough to create the classpath
using the classes from all modules being built.

However, this smartness falls short just a bit. The dependencies are
resolved using the deepest maven phase used by current mvn invocation. If
you are doing 'mvn compile' you don't get to the test compile phase.  This
means that the TEST classes are not resolved from the build but from the
cache/repo.

The solution is to run 'mvn test -DskipTests' instead 'mvn compile'. This
will include the TEST classes from the build.

The same when creating the eclipse profile, run 'mvn test -DskipTests
eclipse:eclipse'

Thanks.

Alejandro

On Mon, Aug 29, 2011 at 9:59 AM, Ravi Prakash <ra...@gmail.com> wrote:

> Yeah I've seen this before. Sometimes I had to descend into child
> directories to mvn install them, before I could maven install parents. I'm
> hoping/guessing that issue is fixed now
>
> On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans <ev...@yahoo-inc.com>
> wrote:
>
> > Wow this is odd install works just fine, but compile fails unless I do an
> > install first (I found this trying to run test-patch).
> >
> > $mvn --version
> > Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
> > Maven home: /home/evans/bin/maven
> > Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
> > Java home: /home/evans/bin/jdk1.6.0/jre
> > Default locale: en_US, platform encoding: UTF-8
> > OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family:
> > "unix"
> >
> > Has anyone else seen this, or is there something messed up with my
> machine?
> >
> > Thanks,
> >
> > Bobby
> >
> > On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
> >
> > I am getting the following errors when I try to build either trunk or
> 0.23
> > with a clean maven cache.  I don't get any errors if I use my old cache.
> >
> > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
> > hadoop-yarn-common ---
> > [INFO] Compiling 2 source files to
> >
> >
> /home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
> > common/target/classes
> > [INFO]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache Hadoop Project POM ......................... SUCCESS
> [0.714s]
> > [INFO] Apache Hadoop Annotations ......................... SUCCESS
> [0.323s]
> > [INFO] Apache Hadoop Project Dist POM .................... SUCCESS
> [0.001s]
> > [INFO] Apache Hadoop Assemblies .......................... SUCCESS
> [0.025s]
> > [INFO] Apache Hadoop Alfredo ............................. SUCCESS
> [0.067s]
> > [INFO] Apache Hadoop Common .............................. SUCCESS
> [2.117s]
> > [INFO] Apache Hadoop Common Project ...................... SUCCESS
> [0.001s]
> > [INFO] Apache Hadoop HDFS ................................ SUCCESS
> [1.419s]
> > [INFO] Apache Hadoop HDFS Project ........................ SUCCESS
> [0.001s]
> > [INFO] hadoop-yarn-api ................................... SUCCESS
> [7.019s]
> > [INFO] hadoop-yarn-common ................................ SUCCESS
> [2.181s]
> > [INFO] hadoop-yarn-server-common ......................... FAILURE
> [0.058s]
> > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
> > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> > [INFO] hadoop-yarn-server ................................ SKIPPED
> > [INFO] hadoop-yarn ....................................... SKIPPED
> > [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
> > [INFO] hadoop-mapreduce-client-common .................... SKIPPED
> > [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
> > [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
> > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> > [INFO] hadoop-mapreduce-client ........................... SKIPPED
> > [INFO] hadoop-mapreduce .................................. SKIPPED
> > [INFO] Apache Hadoop Main ................................ SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 14.938s
> > [INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
> > [INFO] Final Memory: 29M/207M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal on project hadoop-yarn-server-common:
> Could
> > not resolve dependencies for project
> > org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure
> to
> > find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
> > http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshotwas
> > cached in the local repository, resolution will not be reattempted until
> > the
> > update interval of local apache.snapshot mirror has elapsed or updates
> are
> > forced -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please
> > read the following articles:
> > [ERROR] [Help 1]
> >
> >
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
> > on
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR]   mvn <goals> -rf :hadoop-yarn-server-common
> >
> >
> > Is anyone looking into this yet?
> >
> > --Bobby
> >
> >
> >
>

Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Ravi Prakash <ra...@gmail.com>.
Yeah I've seen this before. Sometimes I had to descend into child
directories to mvn install them, before I could maven install parents. I'm
hoping/guessing that issue is fixed now

On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans <ev...@yahoo-inc.com> wrote:

> Wow this is odd install works just fine, but compile fails unless I do an
> install first (I found this trying to run test-patch).
>
> $mvn --version
> Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
> Maven home: /home/evans/bin/maven
> Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
> Java home: /home/evans/bin/jdk1.6.0/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family:
> "unix"
>
> Has anyone else seen this, or is there something messed up with my machine?
>
> Thanks,
>
> Bobby
>
> On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>
> I am getting the following errors when I try to build either trunk or 0.23
> with a clean maven cache.  I don't get any errors if I use my old cache.
>
> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
> hadoop-yarn-common ---
> [INFO] Compiling 2 source files to
>
> /home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
> common/target/classes
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hadoop Project POM ......................... SUCCESS [0.714s]
> [INFO] Apache Hadoop Annotations ......................... SUCCESS [0.323s]
> [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.001s]
> [INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.025s]
> [INFO] Apache Hadoop Alfredo ............................. SUCCESS [0.067s]
> [INFO] Apache Hadoop Common .............................. SUCCESS [2.117s]
> [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.001s]
> [INFO] Apache Hadoop HDFS ................................ SUCCESS [1.419s]
> [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.001s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [7.019s]
> [INFO] hadoop-yarn-common ................................ SUCCESS [2.181s]
> [INFO] hadoop-yarn-server-common ......................... FAILURE [0.058s]
> [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
> [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> [INFO] hadoop-yarn-server ................................ SKIPPED
> [INFO] hadoop-yarn ....................................... SKIPPED
> [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
> [INFO] hadoop-mapreduce-client-common .................... SKIPPED
> [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
> [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client ........................... SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO] Apache Hadoop Main ................................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 14.938s
> [INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
> [INFO] Final Memory: 29M/207M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project hadoop-yarn-server-common: Could
> not resolve dependencies for project
> org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure to
> find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
> http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshot was
> cached in the local repository, resolution will not be reattempted until
> the
> update interval of local apache.snapshot mirror has elapsed or updates are
> forced -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please
> read the following articles:
> [ERROR] [Help 1]
>
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
> on
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-yarn-server-common
>
>
> Is anyone looking into this yet?
>
> --Bobby
>
>
>

Re: Trunk and 0.23 build failing with clean .m2 directory

Posted by Robert Evans <ev...@yahoo-inc.com>.
Wow this is odd install works just fine, but compile fails unless I do an install first (I found this trying to run test-patch).

$mvn --version
Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600)
Maven home: /home/evans/bin/maven
Java version: 1.6.0_22, vendor: Sun Microsystems Inc.
Java home: /home/evans/bin/jdk1.6.0/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.18-238.12.1.el5", arch: "i386", family: "unix"

Has anyone else seen this, or is there something messed up with my machine?

Thanks,

Bobby

On 8/29/11 11:18 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:

I am getting the following errors when I try to build either trunk or 0.23
with a clean maven cache.  I don't get any errors if I use my old cache.

[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
hadoop-yarn-common ---
[INFO] Compiling 2 source files to
/home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-
common/target/classes
[INFO]
[INFO]
------------------------------------------------------------------------
[INFO] Building hadoop-yarn-server-common 0.24.0-SNAPSHOT
[INFO]
------------------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.714s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.323s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.001s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.025s]
[INFO] Apache Hadoop Alfredo ............................. SUCCESS [0.067s]
[INFO] Apache Hadoop Common .............................. SUCCESS [2.117s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.001s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [1.419s]
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.001s]
[INFO] hadoop-yarn-api ................................... SUCCESS [7.019s]
[INFO] hadoop-yarn-common ................................ SUCCESS [2.181s]
[INFO] hadoop-yarn-server-common ......................... FAILURE [0.058s]
[INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
[INFO] hadoop-yarn-server-tests .......................... SKIPPED
[INFO] hadoop-yarn-server ................................ SKIPPED
[INFO] hadoop-yarn ....................................... SKIPPED
[INFO] hadoop-mapreduce-client-core ...................... SKIPPED
[INFO] hadoop-mapreduce-client-common .................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
[INFO] hadoop-mapreduce-client-app ....................... SKIPPED
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client ........................... SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] Apache Hadoop Main ................................ SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 14.938s
[INFO] Finished at: Mon Aug 29 11:18:06 CDT 2011
[INFO] Final Memory: 29M/207M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hadoop-yarn-server-common: Could
not resolve dependencies for project
org.apache.hadoop:hadoop-yarn-server-common:jar:0.24.0-SNAPSHOT: Failure to
find org.apache.hadoop:hadoop-yarn-common:jar:tests:0.24.0-SNAPSHOT in
http://ymaven.corp.yahoo.com:9999/proximity/repository/apache.snapshot was
cached in the local repository, resolution will not be reattempted until the
update interval of local apache.snapshot mirror has elapsed or updates are
forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcepti
on
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <goals> -rf :hadoop-yarn-server-common


Is anyone looking into this yet?

--Bobby