You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Pranav Gadekar <pp...@gmail.com> on 2014/01/25 06:45:53 UTC
Datanode Shutting down automatically
This is my log file.
014-01-24 17:24:58,238 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = user/127.0.1.1
STARTUP_MSG: args = []
STARTUP_MSG: version = 1.2.1
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
STARTUP_MSG: java = 1.6.0_27
************************************************************/
2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2014-01-24 17:24:58,669 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2014-01-24 17:24:58,670 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2014-01-24 17:24:58,670 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
started
2014-01-24 17:24:58,877 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2014-01-24 17:24:58,880 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2014-01-24 17:25:10,778 ERROR
org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
= 102782159; datanode namespaceID = 1227483104
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
2014-01-24 17:25:10,779 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
************************************************************/
2014-01-24 17:26:13,413 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = user/127.0.1.1
STARTUP_MSG: args = []
STARTUP_MSG: version = 1.2.1
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
STARTUP_MSG: java = 1.6.0_27
************************************************************/
2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2014-01-24 17:26:13,518 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2014-01-24 17:26:13,518 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2014-01-24 17:26:13,518 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
started
2014-01-24 17:26:13,626 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2014-01-24 17:26:13,628 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2014-01-24 17:26:28,860 ERROR
org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
= 102782159; datanode namespaceID = 1227483104
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
2014-01-24 17:26:28,860 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
************************************************************/
Shutdown command is initialised automatically.
Please take a look and respond with a solution.
Re: Datanode Shutting down automatically
Posted by Shekhar Sharma <sh...@gmail.com>.
Incompatible name space Id error.its because dat u might have formatted the
namenode but data nodes folder is still have the same I'd.
What is the value of the following property
dfs. Data.dir
dfs. name.dir
hadoop.tmp.dir
The value of these properties is directory on local file system
Solution is to open the version file of the name node (under
dfs/name/current folder) you will see the first line as name space Id, copy
that and then open version file of datanode which is not coming up
(dfs/data/ current folder) you copy name space Id. Now start the data node
process
A dirty hack is to delete the folders(directories specified by the above
properties) from all the machines and den format ur name node and start ur
process. Please note dat the previous data will be lost
On 25 Jan 2014 11:55, "Pranav Gadekar" <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
>
Re: Datanode Shutting down automatically
Posted by Shekhar Sharma <sh...@gmail.com>.
Incompatible name space Id error.its because dat u might have formatted the
namenode but data nodes folder is still have the same I'd.
What is the value of the following property
dfs. Data.dir
dfs. name.dir
hadoop.tmp.dir
The value of these properties is directory on local file system
Solution is to open the version file of the name node (under
dfs/name/current folder) you will see the first line as name space Id, copy
that and then open version file of datanode which is not coming up
(dfs/data/ current folder) you copy name space Id. Now start the data node
process
A dirty hack is to delete the folders(directories specified by the above
properties) from all the machines and den format ur name node and start ur
process. Please note dat the previous data will be lost
On 25 Jan 2014 11:55, "Pranav Gadekar" <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
>
Re: Datanode Shutting down automatically
Posted by Shekhar Sharma <sh...@gmail.com>.
Incompatible name space Id error.its because dat u might have formatted the
namenode but data nodes folder is still have the same I'd.
What is the value of the following property
dfs. Data.dir
dfs. name.dir
hadoop.tmp.dir
The value of these properties is directory on local file system
Solution is to open the version file of the name node (under
dfs/name/current folder) you will see the first line as name space Id, copy
that and then open version file of datanode which is not coming up
(dfs/data/ current folder) you copy name space Id. Now start the data node
process
A dirty hack is to delete the folders(directories specified by the above
properties) from all the machines and den format ur name node and start ur
process. Please note dat the previous data will be lost
On 25 Jan 2014 11:55, "Pranav Gadekar" <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
>
RE: Datanode Shutting down automatically
Posted by Chetan Agrawal <c....@outlook.com>.
thanx a lot...is working fine now
> From: harsh@cloudera.com
> Date: Sat, 25 Jan 2014 12:15:08 +0530
> Subject: Re: Datanode Shutting down automatically
> To: user@hadoop.apache.org
>
> You reformatted your NameNode at some point, but likely failed to also
> clear out the DN data directories, which would not auto-wipe
> themselves.
>
> Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
> start up the next time you invoke it.
>
> P.s. Please do not email general@hadoop.apache.org with any user
> questions. It exists for project level discussions and announcements.
>
> On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> > This is my log file.
> >
> > 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> > STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:24:58,669 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:24:58,877 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:24:58,880 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:25:10,778 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:25:10,779 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> > 2014-01-24 17:26:13,413 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:26:13,626 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:26:13,628 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:26:28,860 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:26:28,860 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> >
> >
> > Shutdown command is initialised automatically.
> > Please take a look and respond with a solution.
>
>
>
> --
> Harsh J
RE: Datanode Shutting down automatically
Posted by Chetan Agrawal <c....@outlook.com>.
thanx a lot...is working fine now
> From: harsh@cloudera.com
> Date: Sat, 25 Jan 2014 12:15:08 +0530
> Subject: Re: Datanode Shutting down automatically
> To: user@hadoop.apache.org
>
> You reformatted your NameNode at some point, but likely failed to also
> clear out the DN data directories, which would not auto-wipe
> themselves.
>
> Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
> start up the next time you invoke it.
>
> P.s. Please do not email general@hadoop.apache.org with any user
> questions. It exists for project level discussions and announcements.
>
> On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> > This is my log file.
> >
> > 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> > STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:24:58,669 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:24:58,877 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:24:58,880 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:25:10,778 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:25:10,779 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> > 2014-01-24 17:26:13,413 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:26:13,626 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:26:13,628 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:26:28,860 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:26:28,860 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> >
> >
> > Shutdown command is initialised automatically.
> > Please take a look and respond with a solution.
>
>
>
> --
> Harsh J
RE: Datanode Shutting down automatically
Posted by Chetan Agrawal <c....@outlook.com>.
thanx a lot...is working fine now
> From: harsh@cloudera.com
> Date: Sat, 25 Jan 2014 12:15:08 +0530
> Subject: Re: Datanode Shutting down automatically
> To: user@hadoop.apache.org
>
> You reformatted your NameNode at some point, but likely failed to also
> clear out the DN data directories, which would not auto-wipe
> themselves.
>
> Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
> start up the next time you invoke it.
>
> P.s. Please do not email general@hadoop.apache.org with any user
> questions. It exists for project level discussions and announcements.
>
> On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> > This is my log file.
> >
> > 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> > STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:24:58,669 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:24:58,877 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:24:58,880 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:25:10,778 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:25:10,779 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> > 2014-01-24 17:26:13,413 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:26:13,626 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:26:13,628 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:26:28,860 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:26:28,860 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> >
> >
> > Shutdown command is initialised automatically.
> > Please take a look and respond with a solution.
>
>
>
> --
> Harsh J
RE: Datanode Shutting down automatically
Posted by Chetan Agrawal <c....@outlook.com>.
thanx a lot...is working fine now
> From: harsh@cloudera.com
> Date: Sat, 25 Jan 2014 12:15:08 +0530
> Subject: Re: Datanode Shutting down automatically
> To: user@hadoop.apache.org
>
> You reformatted your NameNode at some point, but likely failed to also
> clear out the DN data directories, which would not auto-wipe
> themselves.
>
> Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
> start up the next time you invoke it.
>
> P.s. Please do not email general@hadoop.apache.org with any user
> questions. It exists for project level discussions and announcements.
>
> On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> > This is my log file.
> >
> > 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> > STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:24:58,669 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:24:58,670 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:24:58,877 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:24:58,880 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:25:10,778 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:25:10,779 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> > 2014-01-24 17:26:13,413 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG: host = user/127.0.1.1
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 1.2.1
> > STARTUP_MSG: build =
> > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> > 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> > STARTUP_MSG: java = 1.6.0_27
> > ************************************************************/
> > 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> > loaded properties from hadoop-metrics2.properties
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> > MetricsSystem,sub=Stats registered.
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> > at 10 second(s).
> > 2014-01-24 17:26:13,518 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> > started
> > 2014-01-24 17:26:13,626 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> > registered.
> > 2014-01-24 17:26:13,628 WARN
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> > exists!
> > 2014-01-24 17:26:28,860 ERROR
> > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> > = 102782159; datanode namespaceID = 1227483104
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> > at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
> >
> > 2014-01-24 17:26:28,860 INFO
> > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> > ************************************************************/
> >
> >
> > Shutdown command is initialised automatically.
> > Please take a look and respond with a solution.
>
>
>
> --
> Harsh J
Re: Datanode Shutting down automatically
Posted by Harsh J <ha...@cloudera.com>.
You reformatted your NameNode at some point, but likely failed to also
clear out the DN data directories, which would not auto-wipe
themselves.
Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
start up the next time you invoke it.
P.s. Please do not email general@hadoop.apache.org with any user
questions. It exists for project level discussions and announcements.
On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
--
Harsh J
Re: Datanode Shutting down automatically
Posted by Harsh J <ha...@cloudera.com>.
You reformatted your NameNode at some point, but likely failed to also
clear out the DN data directories, which would not auto-wipe
themselves.
Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
start up the next time you invoke it.
P.s. Please do not email general@hadoop.apache.org with any user
questions. It exists for project level discussions and announcements.
On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
--
Harsh J
Re: Datanode Shutting down automatically
Posted by Shekhar Sharma <sh...@gmail.com>.
Incompatible name space Id error.its because dat u might have formatted the
namenode but data nodes folder is still have the same I'd.
What is the value of the following property
dfs. Data.dir
dfs. name.dir
hadoop.tmp.dir
The value of these properties is directory on local file system
Solution is to open the version file of the name node (under
dfs/name/current folder) you will see the first line as name space Id, copy
that and then open version file of datanode which is not coming up
(dfs/data/ current folder) you copy name space Id. Now start the data node
process
A dirty hack is to delete the folders(directories specified by the above
properties) from all the machines and den format ur name node and start ur
process. Please note dat the previous data will be lost
On 25 Jan 2014 11:55, "Pranav Gadekar" <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
>
Re: Datanode Shutting down automatically
Posted by Harsh J <ha...@cloudera.com>.
You reformatted your NameNode at some point, but likely failed to also
clear out the DN data directories, which would not auto-wipe
themselves.
Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
start up the next time you invoke it.
P.s. Please do not email general@hadoop.apache.org with any user
questions. It exists for project level discussions and announcements.
On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
--
Harsh J
Re: Datanode Shutting down automatically
Posted by Harsh J <ha...@cloudera.com>.
You reformatted your NameNode at some point, but likely failed to also
clear out the DN data directories, which would not auto-wipe
themselves.
Clear the contents of /app/hadoop/tmp/dfs/data at the DN and it should
start up the next time you invoke it.
P.s. Please do not email general@hadoop.apache.org with any user
questions. It exists for project level discussions and announcements.
On Sat, Jan 25, 2014 at 11:15 AM, Pranav Gadekar <pp...@gmail.com> wrote:
> This is my log file.
>
> 014-01-24 17:24:58,238 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:24:58,622 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:24:58,669 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:24:58,670 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:24:58,877 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:24:58,880 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:25:10,778 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:25:10,779 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
> 2014-01-24 17:26:13,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = user/127.0.1.1
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 1.2.1
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r
> 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
> STARTUP_MSG: java = 1.6.0_27
> ************************************************************/
> 2014-01-24 17:26:13,510 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-24 17:26:13,518 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2014-01-24 17:26:13,626 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2014-01-24 17:26:13,628 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2014-01-24 17:26:28,860 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID
> = 102782159; datanode namespaceID = 1227483104
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:414)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:321)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1712)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1651)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1669)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1795)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1812)
>
> 2014-01-24 17:26:28,860 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at user/127.0.1.1
> ************************************************************/
>
>
> Shutdown command is initialised automatically.
> Please take a look and respond with a solution.
--
Harsh J