You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by cho ju il <tj...@kgrid.co.kr> on 2014/11/25 02:43:37 UTC

How do you find the source of the load?

 
I can not find the cause of rising load data nodes. 
How do you find the source of the load? 
 
 
 
**** datanode log
 
2014-11-25 06:07:35,432 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Block blk_5029028296867344001_7218414 unfinalized and removed.
2014-11-25 06:07:35,432 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration
(192.168.10.47:90010, storageID=, infoPort=90075, ipcPort=90020):DataXceiver
java.io.EOFException: while trying to read 65536 bytes
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readToBuf(BlockReceiver.java:295)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readNextPacket(BlockReceiver.java:382)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:403)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:581)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:406)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:112)
        at java.lang.Thread.run(Thread.java:662)