You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by chaitanya krishna <ch...@gmail.com> on 2008/07/16 07:55:17 UTC
Reg: Problem in Build Versions of Hadoop-0.17.0
Hi,
I'm using hadoop-0.17.0 and recently, when i stopped and restarted dfs,
the datanodes are being created and soon, they r not present. the logs of
namenode shows the following error:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
************************************************************/
2008-07-16 10:13:34,885 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = 172.16.45.171/172.16.45.171
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.17.1-dev
STARTUP_MSG: build = -r ; compiled by 'jobs' on Wed Jul 16 10:13:11 IST
2008
************************************************************/
2008-07-16 10:13:34,973 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=9000
2008-07-16 10:13:35,011 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
172.16.45.171/172.16.45.171:9000
2008-07-16 10:13:35,015 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-07-16 10:13:35,017 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=jobs,jobs
2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-07-16 10:14:44,869 INFO org.apache.hadoop.fs.FSNamesystem: Finished
loading FSImage in 69827 msecs
2008-07-16 10:14:44,870 INFO org.apache.hadoop.dfs.StateChange: STATE*
Leaving safe mode after 69 secs.
2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2008-07-16 10:14:44,877 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-07-16 10:14:44,930 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-07-16 10:14:44,993 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-07-16 10:14:45,190 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@e29820
2008-07-16 10:14:45,219 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-07-16 10:14:45,221 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50070
2008-07-16 10:14:45,221 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@b30913
2008-07-16 10:14:45,221 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
up at: 0.0.0.0:50070
2008-07-16 10:14:45,307 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.174:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.178:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.176:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.177:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.172:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.175:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.179:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,311 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.173:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:45,341 INFO org.apache.hadoop.dfs.NameNode: Error report
from 172.16.45.180:50010: Incompatible build versions: namenode BV = ;
datanode BV = 656523
2008-07-16 10:14:49,224 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 1 Total time for transactions(ms): 1 Number of syncs: 0
SyncTimes(ms): 0
2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
Log from 172.16.45.171
2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 3 Total time for transactions(ms): 2 Number of syncs: 3
SyncTimes(ms): 5
2008-07-16 10:21:05,432 INFO org.apache.hadoop.fs.FSNamesystem: Roll FSImage
from 172.16.45.171
2008-07-16 10:21:05,469 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0
2008-07-16 10:21:18,304 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
************************************************************/
On seeing the mailist list archives, i found that you heard or experienced
this problem earlier. I also realised that namenode was being compiled by
'jobs' (our username) whereas the datanode is being compiled/built by
"hadoopqa"
How do i overcome this problem?
Please help
Thanks,
V.V.Chaitanya Krishna
B.Tech, IIIT,Hyderabad
India.
Re: Reg: Problem in Build Versions of Hadoop-0.17.0
Posted by chaitanya krishna <ch...@gmail.com>.
Thanks for the reply. It worked! :)
On Wed, Jul 16, 2008 at 11:45 AM, Shengkai Zhu <ge...@gmail.com> wrote:
> Replace the hadoop-*-core.jar in datanodes with your jar compiled under
> "jobs"
>
>
> On 7/16/08, chaitanya krishna <ch...@gmail.com> wrote:
> >
> > Hi,
> >
> > I'm using hadoop-0.17.0 and recently, when i stopped and restarted dfs,
> > the datanodes are being created and soon, they r not present. the logs of
> > namenode shows the following error:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
> > ************************************************************/
> > 2008-07-16 10:13:34,885 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting NameNode
> > STARTUP_MSG: host = 172.16.45.171/172.16.45.171
> > STARTUP_MSG: args = []
> > STARTUP_MSG: version = 0.17.1-dev
> > STARTUP_MSG: build = -r ; compiled by 'jobs' on Wed Jul 16 10:13:11
> IST
> > 2008
> > ************************************************************/
> > 2008-07-16 10:13:34,973 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
> > Initializing RPC Metrics with hostName=NameNode, port=9000
> > 2008-07-16 10:13:35,011 INFO org.apache.hadoop.dfs.NameNode: Namenode up
> > at:
> > 172.16.45.171/172.16.45.171:9000
> > 2008-07-16 10:13:35,015 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
> > Initializing JVM Metrics with processName=NameNode, sessionId=null
> > 2008-07-16 10:13:35,017 INFO org.apache.hadoop.dfs.NameNodeMetrics:
> > Initializing NameNodeMeterics using context
> > object:org.apache.hadoop.metrics.spi.NullContext
> > 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> > fsOwner=jobs,jobs
> > 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> > supergroup=supergroup
> > 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> > isPermissionEnabled=true
> > 2008-07-16 10:14:44,869 INFO org.apache.hadoop.fs.FSNamesystem: Finished
> > loading FSImage in 69827 msecs
> > 2008-07-16 10:14:44,870 INFO org.apache.hadoop.dfs.StateChange: STATE*
> > Leaving safe mode after 69 secs.
> > 2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
> > Network topology has 0 racks and 0 datanodes
> > 2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
> > UnderReplicatedBlocks has 0 blocks
> > 2008-07-16 10:14:44,877 INFO org.apache.hadoop.fs.FSNamesystem:
> Registered
> > FSNamesystemStatusMBean
> > 2008-07-16 10:14:44,930 INFO org.mortbay.util.Credential: Checking
> Resource
> > aliases
> > 2008-07-16 10:14:44,993 INFO org.mortbay.http.HttpServer: Version
> > Jetty/5.1.4
> > 2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
> > HttpContext[/static,/static]
> > 2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
> > HttpContext[/logs,/logs]
> > 2008-07-16 10:14:45,190 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.servlet.WebApplicationHandler@e29820
> > 2008-07-16 10:14:45,219 INFO org.mortbay.util.Container: Started
> > WebApplicationContext[/,/]
> > 2008-07-16 10:14:45,221 INFO org.mortbay.http.SocketListener: Started
> > SocketListener on 0.0.0.0:50070
> > 2008-07-16 10:14:45,221 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.Server@b30913
> > 2008-07-16 10:14:45,221 INFO org.apache.hadoop.fs.FSNamesystem:
> Web-server
> > up at: 0.0.0.0:50070
> > 2008-07-16 10:14:45,307 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.174:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.178:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.176:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.177:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.172:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.175:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.179:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,311 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.173:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:45,341 INFO org.apache.hadoop.dfs.NameNode: Error report
> > from 172.16.45.180:50010: Incompatible build versions: namenode BV = ;
> > datanode BV = 656523
> > 2008-07-16 10:14:49,224 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> > transactions: 1 Total time for transactions(ms): 1 Number of syncs: 0
> > SyncTimes(ms): 0
> > 2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
> > Log from 172.16.45.171
> > 2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> > transactions: 3 Total time for transactions(ms): 2 Number of syncs: 3
> > SyncTimes(ms): 5
> > 2008-07-16 10:21:05,432 INFO org.apache.hadoop.fs.FSNamesystem: Roll
> > FSImage
> > from 172.16.45.171
> > 2008-07-16 10:21:05,469 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> > transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
> > SyncTimes(ms): 0
> > 2008-07-16 10:21:18,304 INFO org.apache.hadoop.dfs.NameNode:
> SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
> > ************************************************************/
> >
> >
> >
> > On seeing the mailist list archives, i found that you heard or
> experienced
> > this problem earlier. I also realised that namenode was being compiled by
> > 'jobs' (our username) whereas the datanode is being compiled/built by
> > "hadoopqa"
> >
> > How do i overcome this problem?
> > Please help
> >
> >
> >
> > Thanks,
> > V.V.Chaitanya Krishna
> > B.Tech, IIIT,Hyderabad
> > India.
> >
>
>
>
> --
>
> 朱盛凯
>
> Jash Zhu
>
> 复旦大学软件学院
>
> Software School, Fudan University
>
Re: Reg: Problem in Build Versions of Hadoop-0.17.0
Posted by Shengkai Zhu <ge...@gmail.com>.
Replace the hadoop-*-core.jar in datanodes with your jar compiled under
"jobs"
On 7/16/08, chaitanya krishna <ch...@gmail.com> wrote:
>
> Hi,
>
> I'm using hadoop-0.17.0 and recently, when i stopped and restarted dfs,
> the datanodes are being created and soon, they r not present. the logs of
> namenode shows the following error:
> /************************************************************
> SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
> ************************************************************/
> 2008-07-16 10:13:34,885 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG: host = 172.16.45.171/172.16.45.171
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.17.1-dev
> STARTUP_MSG: build = -r ; compiled by 'jobs' on Wed Jul 16 10:13:11 IST
> 2008
> ************************************************************/
> 2008-07-16 10:13:34,973 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
> Initializing RPC Metrics with hostName=NameNode, port=9000
> 2008-07-16 10:13:35,011 INFO org.apache.hadoop.dfs.NameNode: Namenode up
> at:
> 172.16.45.171/172.16.45.171:9000
> 2008-07-16 10:13:35,015 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
> Initializing JVM Metrics with processName=NameNode, sessionId=null
> 2008-07-16 10:13:35,017 INFO org.apache.hadoop.dfs.NameNodeMetrics:
> Initializing NameNodeMeterics using context
> object:org.apache.hadoop.metrics.spi.NullContext
> 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> fsOwner=jobs,jobs
> 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> supergroup=supergroup
> 2008-07-16 10:13:35,060 INFO org.apache.hadoop.fs.FSNamesystem:
> isPermissionEnabled=true
> 2008-07-16 10:14:44,869 INFO org.apache.hadoop.fs.FSNamesystem: Finished
> loading FSImage in 69827 msecs
> 2008-07-16 10:14:44,870 INFO org.apache.hadoop.dfs.StateChange: STATE*
> Leaving safe mode after 69 secs.
> 2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
> Network topology has 0 racks and 0 datanodes
> 2008-07-16 10:14:44,871 INFO org.apache.hadoop.dfs.StateChange: STATE*
> UnderReplicatedBlocks has 0 blocks
> 2008-07-16 10:14:44,877 INFO org.apache.hadoop.fs.FSNamesystem: Registered
> FSNamesystemStatusMBean
> 2008-07-16 10:14:44,930 INFO org.mortbay.util.Credential: Checking Resource
> aliases
> 2008-07-16 10:14:44,993 INFO org.mortbay.http.HttpServer: Version
> Jetty/5.1.4
> 2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
> HttpContext[/static,/static]
> 2008-07-16 10:14:44,993 INFO org.mortbay.util.Container: Started
> HttpContext[/logs,/logs]
> 2008-07-16 10:14:45,190 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.servlet.WebApplicationHandler@e29820
> 2008-07-16 10:14:45,219 INFO org.mortbay.util.Container: Started
> WebApplicationContext[/,/]
> 2008-07-16 10:14:45,221 INFO org.mortbay.http.SocketListener: Started
> SocketListener on 0.0.0.0:50070
> 2008-07-16 10:14:45,221 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.Server@b30913
> 2008-07-16 10:14:45,221 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
> up at: 0.0.0.0:50070
> 2008-07-16 10:14:45,307 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.174:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.178:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.176:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,308 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.177:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.172:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.175:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,309 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.179:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,311 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.173:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:45,341 INFO org.apache.hadoop.dfs.NameNode: Error report
> from 172.16.45.180:50010: Incompatible build versions: namenode BV = ;
> datanode BV = 656523
> 2008-07-16 10:14:49,224 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> transactions: 1 Total time for transactions(ms): 1 Number of syncs: 0
> SyncTimes(ms): 0
> 2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
> Log from 172.16.45.171
> 2008-07-16 10:19:45,726 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> transactions: 3 Total time for transactions(ms): 2 Number of syncs: 3
> SyncTimes(ms): 5
> 2008-07-16 10:21:05,432 INFO org.apache.hadoop.fs.FSNamesystem: Roll
> FSImage
> from 172.16.45.171
> 2008-07-16 10:21:05,469 INFO org.apache.hadoop.fs.FSNamesystem: Number of
> transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
> SyncTimes(ms): 0
> 2008-07-16 10:21:18,304 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down NameNode at 172.16.45.171/172.16.45.171
> ************************************************************/
>
>
>
> On seeing the mailist list archives, i found that you heard or experienced
> this problem earlier. I also realised that namenode was being compiled by
> 'jobs' (our username) whereas the datanode is being compiled/built by
> "hadoopqa"
>
> How do i overcome this problem?
> Please help
>
>
>
> Thanks,
> V.V.Chaitanya Krishna
> B.Tech, IIIT,Hyderabad
> India.
>
--
朱盛凯
Jash Zhu
复旦大学软件学院
Software School, Fudan University