You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Mr.hipo" <hi...@hotmail.com> on 2010/02/26 04:24:24 UTC
hadoop sometimes not start properly
i start hadoop sometimes not work properly display this infomation:
use hadoop dfsadmin -report
there is no Datanodes available,but sometimes i restart it , it ok , i want to kown the reason ,3ks!
here is namenode log.
version:0.20.1+152 (single mode),
2010-02-26 10:59:55,338 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 9200, call addBlock(/data/hadoop/hadoopdata/mapred/system/jobtracke
r.info, DFSClient_344842887) from 172.27.28.160:56154: error: java.io.IOException: File /data/hadoop/hadoopdata/mapred/system/jobtracker.info could on
ly be replicated to 0 nodes, instead of 1
java.io.IOException: File /data/hadoop/hadoopdata/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1267)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:434)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
2010-02-26 10:59:55,340 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=de
lete src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=null
2010-02-26 11:00:05,455 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=cr
eate src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=searchadmin:supergroup:rw-r--r--
2010-02-26 11:00:05,456 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=se
tPermission src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=searchadmin:supergroup:rw-------
2010-02-26 11:00:05,457 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 9200, call addBlock(/data/hadoop/hadoopdata/mapred/system/jobtracke
r.info, DFSClient_344842887) from 172.27.28.160:56154: error: java.io.IOException: File /data/hadoop/hadoopdata/mapred/system/jobtracker.info could on
ly be replicated to 0 nodes, instead of 1
java.io.IOException: File /data/hadoop/hadoopdata/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1267)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:434)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
2010-02-26 11:00:05,476 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=de
lete src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=null
2010-02-26 11:00:05,564 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.registerDatanode: node registration from 172.27.28.160:50010 storag
e DS-843266494-172.27.28.160-50010-1267153205554
2010-02-26 11:00:05,566 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/172.27.28.160:50010
2010-02-26 11:00:15,492 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions: 56 Total time for transactions(ms): 1Number
of transactions batched in Syncs: 0 Number of syncs: 39 SyncTimes(ms): 1079
2010-02-26 11:00:15,497 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=cr
eate src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=searchadmin:supergroup:rw-r--r--
2010-02-26 11:00:15,499 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=searchadmin,users,dialout ip=/172.27.28.160 cmd=se
tPermission src=/data/hadoop/hadoopdata/mapred/system/jobtracker.info dst=null perm=searchadmin:supergroup:rw-------
2010-02-26 11:00:15,500 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /data/hadoop/hadoopdata/mapred/system/jobtracker.inf
o. blk_3325044043436299893_1013
2010-02-26 11:00:15,629 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 172.27.28.160:50010 is added to b
lk_3325044043436299893_1013 size 4
2010-02-26 11:00:15,689 INFO org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.completeFile: file /data/hadoop/hadoopdata/mapred/system/jobtracker.i
nfo is closed by DFSClient_344842887
2010-02-26 11:04:14,400 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 172.27.28.160
2010-02-26 11:04:14,400 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions: 58 Total time for transactions(ms): 1Number
of transactions batched in Syncs: 0 Number of syncs: 42 SyncTimes(ms): 1085
2010-02-26 11:04:15,137 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll FSImage from 172.27.28.160
2010-02-26 11:04:15,137 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions: 0 Total time for transactions(ms): 0Number o
f transactions batched in Syncs: 0 Number of syncs: 1 SyncTimes(ms): 0
_________________________________________________________________
MSN十年回馈，每位用户可免费获得价值25元的卡巴斯基反病毒软件2010激活码，快来领取！
http://kaba.msn.com.cn/?k=1