You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Dave Kelsey <da...@gamehouse.com> on 2012/01/05 19:25:24 UTC

datanode failing to start

java version 1.6.0_29
hadoop: 0.20.203.0

I'm attempting to setup the pseudo-distributed config on a mac 10.6.8.
I followed the steps from the QuickStart 
(http://wiki.apache.org./hadoop/QuickStart) and succeeded with Stage 1: 
Standalone Operation.
I followed the steps for Stage 2: Pseudo-distributed Configuration.
I set the JAVA_HOME variable in conf/hadoop-env.sh and I changed 
tools.jar to the location of classes.jar (a mac version of tools.jar)
I've modified the three .xml files as described in the QuickStart.
ssh'ing to localhost has been configured and works with passwordless 
authentication.
I formatted the namenode with "bin/hadoop namenode -format" as the 
instructions say

This is what I see when I run bin/start-all.sh

root# bin/start-all.sh
starting namenode, logging to 
/Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-namenode-Hoot-2.local.out
localhost: starting datanode, logging to 
/Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-datanode-Hoot-2.local.out
localhost: Exception in thread "main" java.lang.NoClassDefFoundError: server
localhost: Caused by: java.lang.ClassNotFoundException: server
localhost:     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
localhost:     at java.security.AccessController.doPrivileged(Native Method)
localhost:     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
localhost:     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
localhost:     at 
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
localhost:     at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
localhost: starting secondarynamenode, logging to 
/Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-secondarynamenode-Hoot-2.local.out
starting jobtracker, logging to 
/Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-jobtracker-Hoot-2.local.out
localhost: starting tasktracker, logging to 
/Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-tasktracker-Hoot-2.local.out

There are 4 processes running:
ps -fax | grep hadoop | grep -v grep | wc -l
       4

They are:
SecondaryNameNode
TaskTracker
NameNode
JobTracker


I've searched to see if anyone else has encountered this and not found 
anything

d

p.s. I've also posted this to core-user@hadoop.apache.org which I've yet 
to find how to subscribe to.


Re: datanode failing to start

Posted by Suresh Srinivas <su...@hortonworks.com>.
Can you please send your notes on what info is out of date or better still
create a jira so that it can be addressed.

On Fri, Jan 6, 2012 at 3:11 PM, Dave Kelsey <da...@gamehouse.com> wrote:

> gave up and installed version 1.
> it installed correctly and worked, thought the instructions for setup and
> the location of scripts and configs are now out of date.
>
> D
>
> On 1/5/2012 10:25 AM, Dave Kelsey wrote:
>
>>
>> java version 1.6.0_29
>> hadoop: 0.20.203.0
>>
>> I'm attempting to setup the pseudo-distributed config on a mac 10.6.8.
>> I followed the steps from the QuickStart (http://wiki.apache.org./**
>> hadoop/QuickStart <http://wiki.apache.org./hadoop/QuickStart>) and
>> succeeded with Stage 1: Standalone Operation.
>> I followed the steps for Stage 2: Pseudo-distributed Configuration.
>> I set the JAVA_HOME variable in conf/hadoop-env.sh and I changed
>> tools.jar to the location of classes.jar (a mac version of tools.jar)
>> I've modified the three .xml files as described in the QuickStart.
>> ssh'ing to localhost has been configured and works with passwordless
>> authentication.
>> I formatted the namenode with "bin/hadoop namenode -format" as the
>> instructions say
>>
>> This is what I see when I run bin/start-all.sh
>>
>> root# bin/start-all.sh
>> starting namenode, logging to /Users/admin/hadoop/hadoop-0.**
>> 20.203.0/bin/../logs/hadoop-**root-namenode-Hoot-2.local.out
>> localhost: starting datanode, logging to /Users/admin/hadoop/hadoop-0.**
>> 20.203.0/bin/../logs/hadoop-**root-datanode-Hoot-2.local.out
>> localhost: Exception in thread "main" java.lang.**NoClassDefFoundError:
>> server
>> localhost: Caused by: java.lang.**ClassNotFoundException: server
>> localhost:     at java.net.URLClassLoader$1.run(**
>> URLClassLoader.java:202)
>> localhost:     at java.security.**AccessController.doPrivileged(**Native
>> Method)
>> localhost:     at java.net.URLClassLoader.**
>> findClass(URLClassLoader.java:**190)
>> localhost:     at java.lang.ClassLoader.**loadClass(ClassLoader.java:**
>> 306)
>> localhost:     at sun.misc.Launcher$**AppClassLoader.loadClass(**
>> Launcher.java:301)
>> localhost:     at java.lang.ClassLoader.**loadClass(ClassLoader.java:**
>> 247)
>> localhost: starting secondarynamenode, logging to
>> /Users/admin/hadoop/hadoop-0.**20.203.0/bin/../logs/hadoop-**
>> root-secondarynamenode-Hoot-2.**local.out
>> starting jobtracker, logging to /Users/admin/hadoop/hadoop-0.**
>> 20.203.0/bin/../logs/hadoop-**root-jobtracker-Hoot-2.local.**out
>> localhost: starting tasktracker, logging to /Users/admin/hadoop/hadoop-0.
>> **20.203.0/bin/../logs/hadoop-**root-tasktracker-Hoot-2.local.**out
>>
>> There are 4 processes running:
>> ps -fax | grep hadoop | grep -v grep | wc -l
>>      4
>>
>> They are:
>> SecondaryNameNode
>> TaskTracker
>> NameNode
>> JobTracker
>>
>>
>> I've searched to see if anyone else has encountered this and not found
>> anything
>>
>> d
>>
>> p.s. I've also posted this to core-user@hadoop.apache.org which I've yet
>> to find how to subscribe to.
>>
>>

Re: datanode failing to start

Posted by Dave Kelsey <da...@gamehouse.com>.
gave up and installed version 1.
it installed correctly and worked, thought the instructions for setup 
and the location of scripts and configs are now out of date.

D

On 1/5/2012 10:25 AM, Dave Kelsey wrote:
>
> java version 1.6.0_29
> hadoop: 0.20.203.0
>
> I'm attempting to setup the pseudo-distributed config on a mac 10.6.8.
> I followed the steps from the QuickStart 
> (http://wiki.apache.org./hadoop/QuickStart) and succeeded with Stage 
> 1: Standalone Operation.
> I followed the steps for Stage 2: Pseudo-distributed Configuration.
> I set the JAVA_HOME variable in conf/hadoop-env.sh and I changed 
> tools.jar to the location of classes.jar (a mac version of tools.jar)
> I've modified the three .xml files as described in the QuickStart.
> ssh'ing to localhost has been configured and works with passwordless 
> authentication.
> I formatted the namenode with "bin/hadoop namenode -format" as the 
> instructions say
>
> This is what I see when I run bin/start-all.sh
>
> root# bin/start-all.sh
> starting namenode, logging to 
> /Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-namenode-Hoot-2.local.out
> localhost: starting datanode, logging to 
> /Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-datanode-Hoot-2.local.out
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: 
> server
> localhost: Caused by: java.lang.ClassNotFoundException: server
> localhost:     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> localhost:     at java.security.AccessController.doPrivileged(Native 
> Method)
> localhost:     at 
> java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> localhost:     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> localhost:     at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> localhost:     at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> localhost: starting secondarynamenode, logging to 
> /Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-secondarynamenode-Hoot-2.local.out
> starting jobtracker, logging to 
> /Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-jobtracker-Hoot-2.local.out
> localhost: starting tasktracker, logging to 
> /Users/admin/hadoop/hadoop-0.20.203.0/bin/../logs/hadoop-root-tasktracker-Hoot-2.local.out
>
> There are 4 processes running:
> ps -fax | grep hadoop | grep -v grep | wc -l
>       4
>
> They are:
> SecondaryNameNode
> TaskTracker
> NameNode
> JobTracker
>
>
> I've searched to see if anyone else has encountered this and not found 
> anything
>
> d
>
> p.s. I've also posted this to core-user@hadoop.apache.org which I've 
> yet to find how to subscribe to.
>