You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jignesh Patel <ji...@websoft.com> on 2011/10/03 23:21:35 UTC
Re: error for deploying hadoop on macbook pro
Harsh thanks,
It worked out now I am able to start the cluster but when I tried to see the jobConf history
http://localhost:50030/jobconf_history.jsp
I got the following message.
Missing 'logFile' for fetching job configuration!
On Sep 30, 2011, at 5:41 PM, Harsh J wrote:
> Since you're only just beginning, and have unknowingly issued multiple
> "namenode -format" commands, simply run the following and restart DN
> alone:
>
> $ rm -r /private/tmp/hadoop-hadoop-user/dfs/data
>
> (And please do not reformat namenode, lest you go out of namespace ID
> sync yet again -- You can instead `hadoop dfs -rmr /*` to rid yourself
> of all HDFS files)
>
> On Sat, Oct 1, 2011 at 2:13 AM, Jignesh Patel <ji...@websoft.com> wrote:
>> Now I am able to make task tracker and job tracker running but I still have following problem with datanode.
>>
>> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /private/tmp/hadoop-hadoop-user/dfs/data: namenode namespaceID = 798142055; datanode namespaceID = 964022125
>>
>>
>> On Sep 30, 2011, at 3:59 PM, Jignesh Patel wrote:
>>
>>>
>>>
>>>
>>>>
>>>>
>>>>
>>>> I am trying to setup single node cluster using hadoop-0.20.204.0 and while setting I found my job tracker and task tracker are not starting. I am attaching the exception. I also don't know why my while formatting name node my IP address still doesn't show 127.0.0.1 as follows.
>>>>
>>>> 1/09/30 15:50:36 INFO namenode.NameNode: STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting NameNode
>>>> STARTUP_MSG: host = Jignesh-MacBookPro.local/192.168.1.120
>>>> STARTUP_MSG: args = [-format]
>>>> STARTUP_MSG: version = 0.20.204.0
>>>> STARTUP_MSG: build = git://hrt8n35.cc1.ygridcore.net/ on branch branch-0.20-security-204 -r 65e258bf0813ac2b15bb4c954660eaf9e8fba141; compiled by 'hortonow' on Thu Aug 25 23:35:31 UTC 2011
>>>>
>>> <hadoop-hadoop-user-tasktracker-Jignesh-MacBookPro.local.out>
>>> <hadoop-hadoop-user-jobtracker-Jignesh-MacBookPro.local.log>
>>>
>>
>>
>
>
>
> --
> Harsh J
Re: error for deploying hadoop on macbook pro
Posted by "Vitthal \"Suhas\" Gogate" <go...@hortonworks.com>.
Sorry few more things,
-- localhost did not work for me.. I had to use my machine name returned by
"hostname" e.g. horton-mac.local
-- Also change the localhost to your machine name in conf/slaves and
conf/masters file.
--Suhas
On Mon, Oct 3, 2011 at 5:44 PM, Vitthal "Suhas" Gogate <
gogate@hortonworks.com> wrote:
> Steps worked in the following document worked for me, except
>
> -- JAVA_HOME need to be set correctly in the conf/hadoop-env.sh
> -- By default on Mac OS X, sshd is not running, so need to start it using
> "System Preferences/Sharing" and add users who are allowed to do ssh.
>
>
> http://www.stanford.edu/class/cs246/cs246-11-mmds/hw_files/hadoop_install.pdf
>
> --Suhas
>
>
> On Mon, Oct 3, 2011 at 2:21 PM, Jignesh Patel <ji...@websoft.com> wrote:
>
>> Harsh thanks,
>> It worked out now I am able to start the cluster but when I tried to see
>> the jobConf history
>>
>> http://localhost:50030/jobconf_history.jsp
>>
>> I got the following message.
>> Missing 'logFile' for fetching job configuration!
>>
>>
>> On Sep 30, 2011, at 5:41 PM, Harsh J wrote:
>>
>> > Since you're only just beginning, and have unknowingly issued multiple
>> > "namenode -format" commands, simply run the following and restart DN
>> > alone:
>> >
>> > $ rm -r /private/tmp/hadoop-hadoop-user/dfs/data
>> >
>> > (And please do not reformat namenode, lest you go out of namespace ID
>> > sync yet again -- You can instead `hadoop dfs -rmr /*` to rid yourself
>> > of all HDFS files)
>> >
>> > On Sat, Oct 1, 2011 at 2:13 AM, Jignesh Patel <ji...@websoft.com>
>> wrote:
>> >> Now I am able to make task tracker and job tracker running but I still
>> have following problem with datanode.
>> >>
>> >> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
>> java.io.IOException: Incompatible namespaceIDs in
>> /private/tmp/hadoop-hadoop-user/dfs/data: namenode namespaceID = 798142055;
>> datanode namespaceID = 964022125
>> >>
>> >>
>> >> On Sep 30, 2011, at 3:59 PM, Jignesh Patel wrote:
>> >>
>> >>>
>> >>>
>> >>>
>> >>>>
>> >>>>
>> >>>>
>> >>>> I am trying to setup single node cluster using hadoop-0.20.204.0 and
>> while setting I found my job tracker and task tracker are not starting. I am
>> attaching the exception. I also don't know why my while formatting name node
>> my IP address still doesn't show 127.0.0.1 as follows.
>> >>>>
>> >>>> 1/09/30 15:50:36 INFO namenode.NameNode: STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting NameNode
>> >>>> STARTUP_MSG: host = Jignesh-MacBookPro.local/192.168.1.120
>> >>>> STARTUP_MSG: args = [-format]
>> >>>> STARTUP_MSG: version = 0.20.204.0
>> >>>> STARTUP_MSG: build = git://hrt8n35.cc1.ygridcore.net/ on branch
>> branch-0.20-security-204 -r 65e258bf0813ac2b15bb4c954660eaf9e8fba141;
>> compiled by 'hortonow' on Thu Aug 25 23:35:31 UTC 2011
>> >>>>
>> >>> <hadoop-hadoop-user-tasktracker-Jignesh-MacBookPro.local.out>
>> >>> <hadoop-hadoop-user-jobtracker-Jignesh-MacBookPro.local.log>
>> >>>
>> >>
>> >>
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>>
>
Re: error for deploying hadoop on macbook pro
Posted by "Vitthal \"Suhas\" Gogate" <go...@hortonworks.com>.
Steps worked in the following document worked for me, except
-- JAVA_HOME need to be set correctly in the conf/hadoop-env.sh
-- By default on Mac OS X, sshd is not running, so need to start it using
"System Preferences/Sharing" and add users who are allowed to do ssh.
http://www.stanford.edu/class/cs246/cs246-11-mmds/hw_files/hadoop_install.pdf
--Suhas
On Mon, Oct 3, 2011 at 2:21 PM, Jignesh Patel <ji...@websoft.com> wrote:
> Harsh thanks,
> It worked out now I am able to start the cluster but when I tried to see
> the jobConf history
>
> http://localhost:50030/jobconf_history.jsp
>
> I got the following message.
> Missing 'logFile' for fetching job configuration!
>
>
> On Sep 30, 2011, at 5:41 PM, Harsh J wrote:
>
> > Since you're only just beginning, and have unknowingly issued multiple
> > "namenode -format" commands, simply run the following and restart DN
> > alone:
> >
> > $ rm -r /private/tmp/hadoop-hadoop-user/dfs/data
> >
> > (And please do not reformat namenode, lest you go out of namespace ID
> > sync yet again -- You can instead `hadoop dfs -rmr /*` to rid yourself
> > of all HDFS files)
> >
> > On Sat, Oct 1, 2011 at 2:13 AM, Jignesh Patel <ji...@websoft.com>
> wrote:
> >> Now I am able to make task tracker and job tracker running but I still
> have following problem with datanode.
> >>
> >> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
> java.io.IOException: Incompatible namespaceIDs in
> /private/tmp/hadoop-hadoop-user/dfs/data: namenode namespaceID = 798142055;
> datanode namespaceID = 964022125
> >>
> >>
> >> On Sep 30, 2011, at 3:59 PM, Jignesh Patel wrote:
> >>
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>>
> >>>> I am trying to setup single node cluster using hadoop-0.20.204.0 and
> while setting I found my job tracker and task tracker are not starting. I am
> attaching the exception. I also don't know why my while formatting name node
> my IP address still doesn't show 127.0.0.1 as follows.
> >>>>
> >>>> 1/09/30 15:50:36 INFO namenode.NameNode: STARTUP_MSG:
> >>>> /************************************************************
> >>>> STARTUP_MSG: Starting NameNode
> >>>> STARTUP_MSG: host = Jignesh-MacBookPro.local/192.168.1.120
> >>>> STARTUP_MSG: args = [-format]
> >>>> STARTUP_MSG: version = 0.20.204.0
> >>>> STARTUP_MSG: build = git://hrt8n35.cc1.ygridcore.net/ on branch
> branch-0.20-security-204 -r 65e258bf0813ac2b15bb4c954660eaf9e8fba141;
> compiled by 'hortonow' on Thu Aug 25 23:35:31 UTC 2011
> >>>>
> >>> <hadoop-hadoop-user-tasktracker-Jignesh-MacBookPro.local.out>
> >>> <hadoop-hadoop-user-jobtracker-Jignesh-MacBookPro.local.log>
> >>>
> >>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>