You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Mahmood Naderan <nt...@yahoo.com> on 2014/03/06 16:17:16 UTC

Assertion error while builing hdoop 2.3.0

Hi
I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful. However wen I run

   

   cd hadoop-mapreduce-project 

   mvn clean install assembly:assembly -Pnative


At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)  Time elapsed: 5.28 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
    at org.junit.Assert.fail(Assert.java:93)
    at org.junit.Assert.failNotEquals(Assert.java:647)
    at org.junit.Assert.assertEquals(Assert.java:128)
    at org.junit.Assert.assertEquals(Assert.java:147)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests: 
  TestCommitterEventHandler.testFailure:314 null
  TestCommitterEventHandler.testBasic:263 null
  TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped: 0

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ........................... SUCCESS [  4.600 s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory: 29M/126M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app



 
Regards,
Mahmood

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
>If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 

That was easy. Thanks


 
Regards,
Mahmood



On Friday, March 7, 2014 9:05 AM, Mingjiang Shi <ms...@gopivotal.com> wrote:
 
If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 


On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com> wrote:

hadoop-2.3.0.tar.gz  (127MB)



-- 

Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
>If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 

That was easy. Thanks


 
Regards,
Mahmood



On Friday, March 7, 2014 9:05 AM, Mingjiang Shi <ms...@gopivotal.com> wrote:
 
If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 


On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com> wrote:

hadoop-2.3.0.tar.gz  (127MB)



-- 

Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
>If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 

That was easy. Thanks


 
Regards,
Mahmood



On Friday, March 7, 2014 9:05 AM, Mingjiang Shi <ms...@gopivotal.com> wrote:
 
If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 


On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com> wrote:

hadoop-2.3.0.tar.gz  (127MB)



-- 

Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
>If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 

That was easy. Thanks


 
Regards,
Mahmood



On Friday, March 7, 2014 9:05 AM, Mingjiang Shi <ms...@gopivotal.com> wrote:
 
If you just want to install a cluster to play with, download the hadoop-2.3.0.tar.gz  (127MB). 


On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com> wrote:

hadoop-2.3.0.tar.gz  (127MB)



-- 

Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mingjiang Shi <ms...@gopivotal.com>.
If you just want to install a cluster to play with, download the
hadoop-2.3.0.tar.gz  (127MB).

On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com>wrote:

> hadoop-2.3.0.tar.gz  (127MB)





-- 
Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mingjiang Shi <ms...@gopivotal.com>.
If you just want to install a cluster to play with, download the
hadoop-2.3.0.tar.gz  (127MB).

On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com>wrote:

> hadoop-2.3.0.tar.gz  (127MB)





-- 
Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mingjiang Shi <ms...@gopivotal.com>.
If you just want to install a cluster to play with, download the
hadoop-2.3.0.tar.gz  (127MB).

On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com>wrote:

> hadoop-2.3.0.tar.gz  (127MB)





-- 
Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mingjiang Shi <ms...@gopivotal.com>.
If you just want to install a cluster to play with, download the
hadoop-2.3.0.tar.gz  (127MB).

On Fri, Mar 7, 2014 at 12:32 PM, Mahmood Naderan <nt...@yahoo.com>wrote:

> hadoop-2.3.0.tar.gz  (127MB)





-- 
Cheers
-MJ

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Thanks for the update. Let me ask a question before continuing the installation. It has been stated

>>To get a Hadoop distribution, download a recent stable release from one of the Apache Download Mirrors.

Do you mean the source package or the other?

hadoop-2.3.0-src.tar.gz  (14MB)
hadoop-2.3.0.tar.gz  (127MB)

 
Regards,
Mahmood



On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp> wrote:
 
Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira


(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Thanks for the update. Let me ask a question before continuing the installation. It has been stated

>>To get a Hadoop distribution, download a recent stable release from one of the Apache Download Mirrors.

Do you mean the source package or the other?

hadoop-2.3.0-src.tar.gz  (14MB)
hadoop-2.3.0.tar.gz  (127MB)

 
Regards,
Mahmood



On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp> wrote:
 
Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira


(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Thanks for the update. Let me ask a question before continuing the installation. It has been stated

>>To get a Hadoop distribution, download a recent stable release from one of the Apache Download Mirrors.

Do you mean the source package or the other?

hadoop-2.3.0-src.tar.gz  (14MB)
hadoop-2.3.0.tar.gz  (127MB)

 
Regards,
Mahmood



On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp> wrote:
 
Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira


(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Thanks for the update. Let me ask a question before continuing the installation. It has been stated

>>To get a Hadoop distribution, download a recent stable release from one of the Apache Download Mirrors.

Do you mean the source package or the other?

hadoop-2.3.0-src.tar.gz  (14MB)
hadoop-2.3.0.tar.gz  (127MB)

 
Regards,
Mahmood



On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp> wrote:
 
Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira


(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>

Re: Assertion error while builing hdoop 2.3.0

Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Mahmood,

 > I have downloaded hadoop-2.3.0-src and followed the guide from
 > 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira

(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>


Re: Assertion error while builing hdoop 2.3.0

Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Mahmood,

 > I have downloaded hadoop-2.3.0-src and followed the guide from
 > 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira

(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>


Re: Assertion error while builing hdoop 2.3.0

Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Mahmood,

 > I have downloaded hadoop-2.3.0-src and followed the guide from
 > 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira

(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>


Re: Assertion error while builing hdoop 2.3.0

Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Mahmood,

 > I have downloaded hadoop-2.3.0-src and followed the guide from
 > 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira

(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt...@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>


Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Stuck at this step.....
Hope to receive any idea...


 
Regards,
Mahmood



On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan <nt...@yahoo.com> wrote:
 
Hi
I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful. However wen I run

   

   cd hadoop-mapreduce-project 

   mvn clean install assembly:assembly -Pnative


At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0,
 Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at
 org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running
 org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in
 org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)  Time elapsed: 5.28
 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
    at org.junit.Assert.fail(Assert.java:93)
    at org.junit.Assert.failNotEquals(Assert.java:647)
    at org.junit.Assert.assertEquals(Assert.java:128)
    at org.junit.Assert.assertEquals(Assert.java:147)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests
 run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in
 org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0,
 Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests: 
  TestCommitterEventHandler.testFailure:314 null
  TestCommitterEventHandler.testBasic:263 null
  TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped:
 0

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ........................... SUCCESS [  4.600 s]
[INFO]
 hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory:
 29M/126M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
 /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app



 
Regards,
Mahmood

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Stuck at this step.....
Hope to receive any idea...


 
Regards,
Mahmood



On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan <nt...@yahoo.com> wrote:
 
Hi
I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful. However wen I run

   

   cd hadoop-mapreduce-project 

   mvn clean install assembly:assembly -Pnative


At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0,
 Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at
 org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running
 org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in
 org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)  Time elapsed: 5.28
 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
    at org.junit.Assert.fail(Assert.java:93)
    at org.junit.Assert.failNotEquals(Assert.java:647)
    at org.junit.Assert.assertEquals(Assert.java:128)
    at org.junit.Assert.assertEquals(Assert.java:147)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests
 run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in
 org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0,
 Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests: 
  TestCommitterEventHandler.testFailure:314 null
  TestCommitterEventHandler.testBasic:263 null
  TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped:
 0

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ........................... SUCCESS [  4.600 s]
[INFO]
 hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory:
 29M/126M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
 /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app



 
Regards,
Mahmood

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Stuck at this step.....
Hope to receive any idea...


 
Regards,
Mahmood



On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan <nt...@yahoo.com> wrote:
 
Hi
I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful. However wen I run

   

   cd hadoop-mapreduce-project 

   mvn clean install assembly:assembly -Pnative


At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0,
 Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at
 org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running
 org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in
 org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)  Time elapsed: 5.28
 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
    at org.junit.Assert.fail(Assert.java:93)
    at org.junit.Assert.failNotEquals(Assert.java:647)
    at org.junit.Assert.assertEquals(Assert.java:128)
    at org.junit.Assert.assertEquals(Assert.java:147)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests
 run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in
 org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0,
 Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests: 
  TestCommitterEventHandler.testFailure:314 null
  TestCommitterEventHandler.testBasic:263 null
  TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped:
 0

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ........................... SUCCESS [  4.600 s]
[INFO]
 hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory:
 29M/126M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
 /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app



 
Regards,
Mahmood

Re: Assertion error while builing hdoop 2.3.0

Posted by Mahmood Naderan <nt...@yahoo.com>.
Stuck at this step.....
Hope to receive any idea...


 
Regards,
Mahmood



On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan <nt...@yahoo.com> wrote:
 
Hi
I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful. However wen I run

   

   cd hadoop-mapreduce-project 

   mvn clean install assembly:assembly -Pnative


At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0,
 Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at
 org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)  Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
    at org.junit.Assert.fail(Assert.java:92)
    at org.junit.Assert.assertTrue(Assert.java:43)
    at org.junit.Assert.assertNotNull(Assert.java:526)
    at org.junit.Assert.assertNotNull(Assert.java:537)
    at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running
 org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in
 org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)  Time elapsed: 5.28
 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
    at org.junit.Assert.fail(Assert.java:93)
    at org.junit.Assert.failNotEquals(Assert.java:647)
    at org.junit.Assert.assertEquals(Assert.java:128)
    at org.junit.Assert.assertEquals(Assert.java:147)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
    at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests
 run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in
 org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running
 org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0,
 Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests: 
  TestCommitterEventHandler.testFailure:314 null
  TestCommitterEventHandler.testBasic:263 null
  TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped:
 0

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ........................... SUCCESS [  4.600 s]
[INFO]
 hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory:
 29M/126M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
 /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app



 
Regards,
Mahmood