You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by cho ju il <tj...@kgrid.co.kr> on 2014/08/29 08:24:43 UTC

"No space left on device" Exception, OPENFORWRITE file

 
How can i disk re-balancing of datanode??? 
Why does generate openforwrite file? 
How do I handle openforwrite file?
 
Hadoop 1.1.2
 
*** Datanode disk usage
Use%   Mounted on
100%    /data01
100%    /data02 
100%    /data03 
100%    /data04 
100%    /data05 
100%    /data06 
20%     /data07 
 
*** datanode error log
org.apache.hadoop.util.DiskChecker$DiskOutOfSpaceException: No space left on device 
 
*** my upload process
success case :  upload, /hdfs/20140826/13886942.0, replication(1)  &gt;&gt;&gt;  upload completed  &gt;&gt;&gt;  set replication ( 2 )
fail case :  upload, /hdfs/20140826/13886942.0, replication(1)  &gt;&gt;&gt;  "No space.." exception  &gt;&gt;&gt;  upload stop   &gt;&gt;&gt;  set replication ( 2 )
 
*** fail case
bin/hadoop fsck /hdfs/20140826/13886942.0 -files -blocks -locations -openforwrite
/hdfs/20140826/13886942.0 805306368 bytes, 6 block(s), OPENFORWRITE:  Under replicated blk_8476382876550200462_13950495. Target Replicas is 2 but found 1 replica(s).
 Under replicated blk_-5612270950888918170_13950498. Target Replicas is 2 but found 1 replica(s).
 Under replicated blk_5224343373334553723_13950499. Target Replicas is 2 but found 1 replica(s).
 Under replicated blk_-8429720977390588895_13950501. Target Replicas is 2 but found 1 replica(s).
 Under replicated blk_5229465734903912554_13950502. Target Replicas is 2 but found 1 replica(s).
 Under replicated blk_4974206501850413571_13950502. Target Replicas is 2 but found 1 replica(s).
0. blk_8476382876550200462_13950495 len=134217728 repl=1 [192.168.10.68:40010]
1. blk_-5612270950888918170_13950498 len=134217728 repl=1 [192.168.10.68:40010]
2. blk_5224343373334553723_13950499 len=134217728 repl=1 [192.168.10.68:40010]
3. blk_-8429720977390588895_13950501 len=134217728 repl=1 [192.168.10.68:40010]
4. blk_5229465734903912554_13950502 len=134217728 repl=1 [192.168.10.68:40010]
 
5. blk_4974206501850413571_13950502 len=134217728 repl=1 [192.168.10.68:40010]