You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Abdul Qadeer <qa...@gmail.com> on 2008/09/05 02:57:31 UTC
How to debug org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles
I want to debug the test case
org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles<http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3151/testReport/org.apache.hadoop.streaming/TestMultipleCachefiles/testMultipleCachefiles>
from within Eclipse. But doing so gives exception that "webapps not found
in CLASSPATH" when in
fact I have put it in Eclipse classpath and verified this entry in
.classpath file.
Could anyone please suggest how to remove this problem?
Thanks,
Abdul Qadeer
Re: How to debug
org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles
Posted by Shihua Ma <be...@gmail.com>.
You can put src in your classpath,Because The HttpServer scan the webapps
folder in your classpath to start jetty webserver.
Josh Ma
http://www.hadoop.org.cn http://www.hadoop.org.cn
Abdul Qadeer wrote:
>
> I am running a single node Hadoop. If I try to debug
> org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles,
> the following exception tells that
> I haven't put webapps on the classpath. I have in fact put src/webapps on
> classpath.
> So I was wondering what is wrong.
>
> 2008-09-06 20:03:28,183 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(409)) -
> fsOwner=personalpc\admin,None,root,Administrators,Users
> 2008-09-06 20:03:28,191 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(413)) -
> supergroup=supergroup
> 2008-09-06 20:03:28,191 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(414)) -
> isPermissionEnabled=true
> 2008-09-06 20:03:28,440 INFO common.Storage
> (FSImage.java:saveFSImage(897))
> - Image file of size 90 saved in 0 seconds.
> 2008-09-06 20:03:28,510 INFO common.Storage (FSImage.java:format(952)) -
> Storage directory dfs\name1 has been successfully formatted.
> 2008-09-06 20:03:28,538 INFO common.Storage
> (FSImage.java:saveFSImage(897))
> - Image file of size 90 saved in 0 seconds.
> 2008-09-06 20:03:28,590 INFO common.Storage (FSImage.java:format(952)) -
> Storage directory dfs\name2 has been successfully formatted.
> 2008-09-06 20:03:28,904 INFO metrics.RpcMetrics
> (RpcMetrics.java:<init>(56)) - Initializing RPC Metrics with
> hostName=NameNode, port=57467
> 2008-09-06 20:03:29,246 INFO namenode.NameNode
> (NameNode.java:initialize(156)) - Namenode up at:
> 127.0.0.1/127.0.0.1:57467
> 2008-09-06 20:03:29,290 INFO jvm.JvmMetrics (JvmMetrics.java:init(67)) -
> Initializing JVM Metrics with processName=NameNode, sessionId=null
> 2008-09-06 20:03:29,352 INFO metrics.NameNodeMetrics
> (NameNodeMetrics.java:<init>(85)) - Initializing NameNodeMeterics using
> context object:org.apache.hadoop.metrics.spi.NullContext
> 2008-09-06 20:03:29,417 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(409)) -
> fsOwner=personalpc\admin,None,root,Administrators,Users
> 2008-09-06 20:03:29,418 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(413)) -
> supergroup=supergroup
> 2008-09-06 20:03:29,418 INFO fs.FSNamesystem
> (FSNamesystem.java:setConfigurationParameters(414)) -
> isPermissionEnabled=true
> 2008-09-06 20:03:29,442 INFO metrics.FSNamesystemMetrics
> (FSNamesystemMetrics.java:<init>(60)) - Initializing FSNamesystemMeterics
> using context object:org.apache.hadoop.metrics.spi.NullContext
> 2008-09-06 20:03:29,444 INFO fs.FSNamesystem
> (FSNamesystem.java:registerMBean(4274)) - Registered
> FSNamesystemStatusMBean
> 2008-09-06 20:03:29,519 INFO common.Storage
> (FSImage.java:loadFSImage(748))
> - Number of files = 0
> 2008-09-06 20:03:29,519 INFO common.Storage
> (FSImage.java:loadFilesUnderConstruction(1052)) - Number of files under
> construction = 0
> 2008-09-06 20:03:29,520 INFO common.Storage
> (FSImage.java:loadFSImage(683))
> - Image file of size 90 loaded in 0 seconds.
> 2008-09-06 20:03:29,521 INFO common.Storage
> (FSEditLog.java:loadFSEdits(667)) - Edits file edits of size 4 edits # 0
> loaded in 0 seconds.
> 2008-09-06 20:03:29,541 INFO common.Storage
> (FSImage.java:saveFSImage(897))
> - Image file of size 90 saved in 0 seconds.
> 2008-09-06 20:03:29,581 INFO common.Storage
> (FSImage.java:saveFSImage(897))
> - Image file of size 90 saved in 0 seconds.
> 2008-09-06 20:03:29,727 INFO fs.FSNamesystem
> (FSNamesystem.java:initialize(307)) - Finished loading FSImage in 373
> msecs
> 2008-09-06 20:03:29,761 INFO hdfs.StateChange
> (FSNamesystem.java:leave(3795)) - STATE* Leaving safe mode after 0 secs.
> 2008-09-06 20:03:29,762 INFO hdfs.StateChange
> (FSNamesystem.java:leave(3804)) - STATE* Network topology has 0 racks and
> 0
> datanodes
> 2008-09-06 20:03:29,762 INFO hdfs.StateChange
> (FSNamesystem.java:leave(3807)) - STATE* UnderReplicatedBlocks has 0
> blocks
> 2008-09-06 20:03:30,173 ERROR fs.FSNamesystem
> (FSNamesystem.java:<init>(286)) - FSNamesystem initialization failed.
> java.io.IOException: webapps not found in CLASSPATH
> at
> org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:157)
> at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:74)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:347)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:284)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:160)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:205)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:191)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:849)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:270)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:119)
> at
> org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles(TestMultipleCachefiles.java:61)
> at
> org.apache.hadoop.streaming.TestMultipleCachefiles.main(TestMultipleCachefiles.java:138)
> 2008-09-06 20:03:30,177 INFO fs.FSNamesystem
> (FSEditLog.java:printStatistics(843)) - Number of transactions: 0 Total
> time
> for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0
> 2008-09-06 20:03:30,180 WARN fs.FSNamesystem
> (FSNamesystem.java:run(2191))
> - ReplicationMonitor thread received
> InterruptedException.java.lang.InterruptedException: sleep interrupted
> 2008-09-06 20:03:30,183 INFO ipc.Server (Server.java:stop(992)) -
> Stopping
> server on 57467
>
>
>
> Abdul Qadeer
>
>
> On Sat, Sep 6, 2008 at 7:18 PM, 叶双明 <ye...@gmail.com> wrote:
>
>> Any detail error message ?
>>
>> 2008/9/5, Abdul Qadeer <qa...@gmail.com>:
>> >
>> > I want to debug the test case
>> >
>> org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles<
>> >
>> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3151/testReport/org.apache.hadoop.streaming/TestMultipleCachefiles/testMultipleCachefiles
>> > >
>> > from within Eclipse. But doing so gives exception that "webapps not
>> found
>> > in CLASSPATH" when in
>> > fact I have put it in Eclipse classpath and verified this entry in
>> > .classpath file.
>> >
>> > Could anyone please suggest how to remove this problem?
>> >
>> > Thanks,
>> > Abdul Qadeer
>> >
>>
>>
>>
>> --
>> Sorry for my english!!
>> 明
>>
>
>
--
View this message in context: http://www.nabble.com/How-to-debug-org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles-tp19322988p19364934.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: How to debug org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles
Posted by Abdul Qadeer <qa...@gmail.com>.
I am running a single node Hadoop. If I try to debug
org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles,
the following exception tells that
I haven't put webapps on the classpath. I have in fact put src/webapps on
classpath.
So I was wondering what is wrong.
2008-09-06 20:03:28,183 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(409)) -
fsOwner=personalpc\admin,None,root,Administrators,Users
2008-09-06 20:03:28,191 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(413)) - supergroup=supergroup
2008-09-06 20:03:28,191 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(414)) -
isPermissionEnabled=true
2008-09-06 20:03:28,440 INFO common.Storage (FSImage.java:saveFSImage(897))
- Image file of size 90 saved in 0 seconds.
2008-09-06 20:03:28,510 INFO common.Storage (FSImage.java:format(952)) -
Storage directory dfs\name1 has been successfully formatted.
2008-09-06 20:03:28,538 INFO common.Storage (FSImage.java:saveFSImage(897))
- Image file of size 90 saved in 0 seconds.
2008-09-06 20:03:28,590 INFO common.Storage (FSImage.java:format(952)) -
Storage directory dfs\name2 has been successfully formatted.
2008-09-06 20:03:28,904 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(56)) - Initializing RPC Metrics with
hostName=NameNode, port=57467
2008-09-06 20:03:29,246 INFO namenode.NameNode
(NameNode.java:initialize(156)) - Namenode up at: 127.0.0.1/127.0.0.1:57467
2008-09-06 20:03:29,290 INFO jvm.JvmMetrics (JvmMetrics.java:init(67)) -
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-09-06 20:03:29,352 INFO metrics.NameNodeMetrics
(NameNodeMetrics.java:<init>(85)) - Initializing NameNodeMeterics using
context object:org.apache.hadoop.metrics.spi.NullContext
2008-09-06 20:03:29,417 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(409)) -
fsOwner=personalpc\admin,None,root,Administrators,Users
2008-09-06 20:03:29,418 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(413)) - supergroup=supergroup
2008-09-06 20:03:29,418 INFO fs.FSNamesystem
(FSNamesystem.java:setConfigurationParameters(414)) -
isPermissionEnabled=true
2008-09-06 20:03:29,442 INFO metrics.FSNamesystemMetrics
(FSNamesystemMetrics.java:<init>(60)) - Initializing FSNamesystemMeterics
using context object:org.apache.hadoop.metrics.spi.NullContext
2008-09-06 20:03:29,444 INFO fs.FSNamesystem
(FSNamesystem.java:registerMBean(4274)) - Registered FSNamesystemStatusMBean
2008-09-06 20:03:29,519 INFO common.Storage (FSImage.java:loadFSImage(748))
- Number of files = 0
2008-09-06 20:03:29,519 INFO common.Storage
(FSImage.java:loadFilesUnderConstruction(1052)) - Number of files under
construction = 0
2008-09-06 20:03:29,520 INFO common.Storage (FSImage.java:loadFSImage(683))
- Image file of size 90 loaded in 0 seconds.
2008-09-06 20:03:29,521 INFO common.Storage
(FSEditLog.java:loadFSEdits(667)) - Edits file edits of size 4 edits # 0
loaded in 0 seconds.
2008-09-06 20:03:29,541 INFO common.Storage (FSImage.java:saveFSImage(897))
- Image file of size 90 saved in 0 seconds.
2008-09-06 20:03:29,581 INFO common.Storage (FSImage.java:saveFSImage(897))
- Image file of size 90 saved in 0 seconds.
2008-09-06 20:03:29,727 INFO fs.FSNamesystem
(FSNamesystem.java:initialize(307)) - Finished loading FSImage in 373 msecs
2008-09-06 20:03:29,761 INFO hdfs.StateChange
(FSNamesystem.java:leave(3795)) - STATE* Leaving safe mode after 0 secs.
2008-09-06 20:03:29,762 INFO hdfs.StateChange
(FSNamesystem.java:leave(3804)) - STATE* Network topology has 0 racks and 0
datanodes
2008-09-06 20:03:29,762 INFO hdfs.StateChange
(FSNamesystem.java:leave(3807)) - STATE* UnderReplicatedBlocks has 0 blocks
2008-09-06 20:03:30,173 ERROR fs.FSNamesystem
(FSNamesystem.java:<init>(286)) - FSNamesystem initialization failed.
java.io.IOException: webapps not found in CLASSPATH
at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:157)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:74)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:347)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:284)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:160)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:205)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:191)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:849)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:270)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:119)
at
org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles(TestMultipleCachefiles.java:61)
at
org.apache.hadoop.streaming.TestMultipleCachefiles.main(TestMultipleCachefiles.java:138)
2008-09-06 20:03:30,177 INFO fs.FSNamesystem
(FSEditLog.java:printStatistics(843)) - Number of transactions: 0 Total time
for transactions(ms): 0 Number of syncs: 0 SyncTimes(ms): 0 0
2008-09-06 20:03:30,180 WARN fs.FSNamesystem (FSNamesystem.java:run(2191))
- ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
2008-09-06 20:03:30,183 INFO ipc.Server (Server.java:stop(992)) - Stopping
server on 57467
Abdul Qadeer
On Sat, Sep 6, 2008 at 7:18 PM, 叶双明 <ye...@gmail.com> wrote:
> Any detail error message ?
>
> 2008/9/5, Abdul Qadeer <qa...@gmail.com>:
> >
> > I want to debug the test case
> >
> org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles<
> >
> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3151/testReport/org.apache.hadoop.streaming/TestMultipleCachefiles/testMultipleCachefiles
> > >
> > from within Eclipse. But doing so gives exception that "webapps not
> found
> > in CLASSPATH" when in
> > fact I have put it in Eclipse classpath and verified this entry in
> > .classpath file.
> >
> > Could anyone please suggest how to remove this problem?
> >
> > Thanks,
> > Abdul Qadeer
> >
>
>
>
> --
> Sorry for my english!!
> 明
>
Re: How to debug org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles
Posted by 叶双明 <ye...@gmail.com>.
Any detail error message ?
2008/9/5, Abdul Qadeer <qa...@gmail.com>:
>
> I want to debug the test case
> org.apache.hadoop.streaming.TestMultipleCachefiles.testMultipleCachefiles<
> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3151/testReport/org.apache.hadoop.streaming/TestMultipleCachefiles/testMultipleCachefiles
> >
> from within Eclipse. But doing so gives exception that "webapps not found
> in CLASSPATH" when in
> fact I have put it in Eclipse classpath and verified this entry in
> .classpath file.
>
> Could anyone please suggest how to remove this problem?
>
> Thanks,
> Abdul Qadeer
>
--
Sorry for my english!!
明