You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by zjffdu <zj...@gmail.com> on 2009/05/10 10:11:12 UTC

Can I run the testcase in local

Hi all,

 

I'd like to know more about the hadoop, so I want to debug the testcase in
local.

 

But I found the errors below:  Can anyone help to solve this problem, thank
you very much.

 

 

############################################################################
###########################################################

 

2009-05-10 16:00:51,483 ERROR namenode.FSNamesystem
(FSNamesystem.java:<init>(291)) - FSNamesystem initialization failed.

java.io.IOException: Problem starting http server

    at org.apache.hadoop.http.HttpServer.start(HttpServer.java:369)

    at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.
java:372)

    at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java
:289)

    at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:162
)

    at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:209)

    at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:197)

    at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java
:822)

    at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:275)

    at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:119)

    at
org.apache.hadoop.mapred.ClusterMapReduceTestCase.startCluster(ClusterMapRed
uceTestCase.java:81)

    at
org.apache.hadoop.mapred.ClusterMapReduceTestCase.setUp(ClusterMapReduceTest
Case.java:56)

    at junit.framework.TestCase.runBare(TestCase.java:125)

    at junit.framework.TestResult$1.protect(TestResult.java:106)

    at junit.framework.TestResult.runProtected(TestResult.java:124)

    at junit.framework.TestResult.run(TestResult.java:109)

    at junit.framework.TestCase.run(TestCase.java:118)

    at junit.framework.TestSuite.runTest(TestSuite.java:208)

    at junit.framework.TestSuite.run(TestSuite.java:203)

    at
org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3T
estReference.java:130)

    at
org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:3
8)

    at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRu
nner.java:460)

    at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRu
nner.java:673)

    at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.
java:386)

    at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner
.java:196)

Caused by: org.mortbay.util.MultiException[java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.server.namenode.dfshealth_jsp,
java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.server.namenode.nn_005fbrowsedfscontent_jsp]

    at org.mortbay.http.HttpServer.doStart(HttpServer.java:731)

    at org.mortbay.util.Container.start(Container.java:72)

    at org.apache.hadoop.http.HttpServer.start(HttpServer.java:347)

    ... 23 more

2009-05-10 16:00:51,483 INFO  namenode.FSNamesystem
(FSEditLog.java:printStatistics(940)) - Number of transactions: 0 Total time
for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0 

2009-05-10 16:00:51,483 WARN  namenode.FSNamesystem
(FSNamesystem.java:run(2217)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted

2009-05-10 16:00:51,655 INFO  ipc.Server (Server.java:stop(1033)) - Stopping
server on 4233

 


Re: Can I run the testcase in local

Posted by Iman <ie...@cs.uwaterloo.ca>.
Zhang,
You will need cygwin. There is also a hadoop virtual machine that you 
can use.
Check this tutorials for more details: 
http://public.yahoo.com/gogate/hadoop-tutorial/html/module3.html

zjffdu wrote:
> I found it can only work on linux, not windows.
>
>  
>
> So is there any way I can run it on windows.
>
>  
>
>  
>
>  
>
> From: zhang jianfeng [mailto:zjffdu@gmail.com] 
> Sent: 2009年5月10日 16:39
> To: core-user@hadoop.apache.org
> Subject: Re: Can I run the testcase in local
>
>  
>
> PS, I run it in windows machine
>
> On Sun, May 10, 2009 at 4:11 PM, zjffdu <zj...@gmail.com> wrote:
>
> Hi all,
>
>  
>
> I’d like to know more about the hadoop, so I want to debug the testcase in local.
>
>  
>
> But I found the errors below:  Can anyone help to solve this problem, thank you very much.
>
>  
>
>  
>
> #######################################################################################################################################
>
>  
>
> 2009-05-10 16:00:51,483 ERROR namenode.FSNamesystem (FSNamesystem.java:<init>(291)) - FSNamesystem initialization failed.
>
> java.io.IOException: Problem starting http server
>
>     at org.apache.hadoop.http.HttpServer.start(HttpServer.java:369)
>
>     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:372)
>
>     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:289)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:162)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:209)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:197)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:822)
>
>     at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:275)
>
>     at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:119)
>
>     at org.apache.hadoop.mapred.ClusterMapReduceTestCase.startCluster(ClusterMapReduceTestCase.java:81)
>
>     at org.apache.hadoop.mapred.ClusterMapReduceTestCase.setUp(ClusterMapReduceTestCase.java:56)
>
>     at junit.framework.TestCase.runBare(TestCase.java:125)
>
>     at junit.framework.TestResult$1.protect(TestResult.java:106)
>
>     at junit.framework.TestResult.runProtected(TestResult.java:124)
>
>     at junit.framework.TestResult.run(TestResult.java:109)
>
>     at junit.framework.TestCase.run(TestCase.java:118)
>
>     at junit.framework.TestSuite.runTest(TestSuite.java:208)
>
>     at junit.framework.TestSuite.run(TestSuite.java:203)
>
>     at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:130)
>
>     at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196)
>
> Caused by: org.mortbay.util.MultiException[java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.server.namenode.dfshealth_jsp, java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.server.namenode.nn_005fbrowsedfscontent_jsp]
>
>     at org.mortbay.http.HttpServer.doStart(HttpServer.java:731)
>
>     at org.mortbay.util.Container.start(Container.java:72)
>
>     at org.apache.hadoop.http.HttpServer.start(HttpServer.java:347)
>
>     ... 23 more
>
> 2009-05-10 16:00:51,483 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(940)) - Number of transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0 
>
> 2009-05-10 16:00:51,483 WARN  namenode.FSNamesystem (FSNamesystem.java:run(2217)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted
>
> 2009-05-10 16:00:51,655 INFO  ipc.Server (Server.java:stop(1033)) - Stopping server on 4233
>
>  
>
>  
>
>
>   


RE: Can I run the testcase in local

Posted by zjffdu <zj...@gmail.com>.
I found it can only work on linux, not windows.

 

So is there any way I can run it on windows.

 

 

 

From: zhang jianfeng [mailto:zjffdu@gmail.com] 
Sent: 2009年5月10日 16:39
To: core-user@hadoop.apache.org
Subject: Re: Can I run the testcase in local

 

PS, I run it in windows machine

On Sun, May 10, 2009 at 4:11 PM, zjffdu <zj...@gmail.com> wrote:

Hi all,

 

I’d like to know more about the hadoop, so I want to debug the testcase in local.

 

But I found the errors below:  Can anyone help to solve this problem, thank you very much.

 

 

#######################################################################################################################################

 

2009-05-10 16:00:51,483 ERROR namenode.FSNamesystem (FSNamesystem.java:<init>(291)) - FSNamesystem initialization failed.

java.io.IOException: Problem starting http server

    at org.apache.hadoop.http.HttpServer.start(HttpServer.java:369)

    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:372)

    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:289)

    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:162)

    at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:209)

    at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:197)

    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:822)

    at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:275)

    at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:119)

    at org.apache.hadoop.mapred.ClusterMapReduceTestCase.startCluster(ClusterMapReduceTestCase.java:81)

    at org.apache.hadoop.mapred.ClusterMapReduceTestCase.setUp(ClusterMapReduceTestCase.java:56)

    at junit.framework.TestCase.runBare(TestCase.java:125)

    at junit.framework.TestResult$1.protect(TestResult.java:106)

    at junit.framework.TestResult.runProtected(TestResult.java:124)

    at junit.framework.TestResult.run(TestResult.java:109)

    at junit.framework.TestCase.run(TestCase.java:118)

    at junit.framework.TestSuite.runTest(TestSuite.java:208)

    at junit.framework.TestSuite.run(TestSuite.java:203)

    at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:130)

    at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)

    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460)

    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673)

    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386)

    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196)

Caused by: org.mortbay.util.MultiException[java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.server.namenode.dfshealth_jsp, java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.server.namenode.nn_005fbrowsedfscontent_jsp]

    at org.mortbay.http.HttpServer.doStart(HttpServer.java:731)

    at org.mortbay.util.Container.start(Container.java:72)

    at org.apache.hadoop.http.HttpServer.start(HttpServer.java:347)

    ... 23 more

2009-05-10 16:00:51,483 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(940)) - Number of transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0 

2009-05-10 16:00:51,483 WARN  namenode.FSNamesystem (FSNamesystem.java:run(2217)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted

2009-05-10 16:00:51,655 INFO  ipc.Server (Server.java:stop(1033)) - Stopping server on 4233

 

 


Re: Can I run the testcase in local

Posted by zhang jianfeng <zj...@gmail.com>.
PS, I run it in windows machine

On Sun, May 10, 2009 at 4:11 PM, zjffdu <zj...@gmail.com> wrote:

>  Hi all,
>
>
>
> I’d like to know more about the hadoop, so I want to debug the testcase in
> local.
>
>
>
> But I found the errors below:  Can anyone help to solve this problem, thank
> you very much.
>
>
>
>
>
>
> #######################################################################################################################################
>
>
>
> 2009-05-10 16:00:51,483 ERROR namenode.FSNamesystem (*
> FSNamesystem.java:<init>(291)*) - FSNamesystem initialization failed.
>
> *java.io.IOException*: Problem starting http server
>
>     at org.apache.hadoop.http.HttpServer.start(*HttpServer.java:369*)
>
>     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(*
> FSNamesystem.java:372*)
>
>     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(*
> FSNamesystem.java:289*)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(*
> NameNode.java:162*)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(*
> NameNode.java:209*)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(*
> NameNode.java:197*)
>
>     at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(*
> NameNode.java:822*)
>
>     at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(*
> MiniDFSCluster.java:275*)
>
>     at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(*
> MiniDFSCluster.java:119*)
>
>     at org.apache.hadoop.mapred.ClusterMapReduceTestCase.startCluster(*
> ClusterMapReduceTestCase.java:81*)
>
>     at org.apache.hadoop.mapred.ClusterMapReduceTestCase.setUp(*
> ClusterMapReduceTestCase.java:56*)
>
>     at junit.framework.TestCase.runBare(*TestCase.java:125*)
>
>     at junit.framework.TestResult$1.protect(*TestResult.java:106*)
>
>     at junit.framework.TestResult.runProtected(*TestResult.java:124*)
>
>     at junit.framework.TestResult.run(*TestResult.java:109*)
>
>     at junit.framework.TestCase.run(*TestCase.java:118*)
>
>     at junit.framework.TestSuite.runTest(*TestSuite.java:208*)
>
>     at junit.framework.TestSuite.run(*TestSuite.java:203*)
>
>     at
> org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(*
> JUnit3TestReference.java:130*)
>
>     at org.eclipse.jdt.internal.junit.runner.TestExecution.run(*
> TestExecution.java:38*)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(*
> RemoteTestRunner.java:460*)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(*
> RemoteTestRunner.java:673*)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(*
> RemoteTestRunner.java:386*)
>
>     at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(*
> RemoteTestRunner.java:196*)
>
> Caused by: *
> org.mortbay.util.MultiException[java.lang.ClassNotFoundException*:
> org.apache.hadoop.hdfs.server.namenode.dfshealth_jsp, *
> java.lang.ClassNotFoundException*:
> org.apache.hadoop.hdfs.server.namenode.nn_005fbrowsedfscontent_jsp]
>
>     at org.mortbay.http.HttpServer.doStart(*HttpServer.java:731*)
>
>     at org.mortbay.util.Container.start(*Container.java:72*)
>
>     at org.apache.hadoop.http.HttpServer.start(*HttpServer.java:347*)
>
>     ... 23 more
>
> 2009-05-10 16:00:51,483 INFO  namenode.FSNamesystem (*
> FSEditLog.java:printStatistics(940)*) - Number of transactions: 0 Total
> time for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0
>
> 2009-05-10 16:00:51,483 WARN  namenode.FSNamesystem (*
> FSNamesystem.java:run(2217)*) - ReplicationMonitor thread received *
> InterruptedException.java.lang.InterruptedException*: sleep interrupted
>
> 2009-05-10 16:00:51,655 INFO  ipc.Server (*Server.java:stop(1033)*) -
> Stopping server on 4233
>
>
>