You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by schubert zhang <zs...@gmail.com> on 2009/03/20 10:25:55 UTC

add Block fail

I am using hadoop-0.19.2 (build form branch-0.19)

Many times, my HBase cannot add new block like this.

/3564864123815244014/index. blk_-2453675368959468063_2307
2009-03-20 16:30:37,580 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place
enough replicas, still in need of 1
2009-03-20 16:30:40,286 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 10.24.1.16:50010 is added to
blk_-8235263037718305223_2307 size 20973614
2009-03-20 16:30:40,286 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 10.24.1.12:50010 is added to
blk_-8235263037718305223_2307 size 20973614
2009-03-20 16:30:40,287 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 10.24.1.18:50010 is added to
blk_-8235263037718305223_2307 size 20973614
2009-03-20 16:30:40,293 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit:
ugi=schubert,schubert   ip=/10.24.1.10  cmd=rename
src=/sandmill/cdr/wap/WAP20090320163023.000000408
dst=/sandmill/cdr/wap/comp/WAP20090320163023.000000408
perm=schubert:supergroup:rw-r--r--
2009-03-20 16:30:40,295 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit:
ugi=schubert,schubert   ip=/10.24.1.10  cmd=create
src=/sandmill/cdr/wap/WAP20090320163040.000000283       dst=null
perm=schubert:supergroup:rw-r--r--
2009-03-20 16:30:40,311 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.allocateBlock: /sandmill/cdr/wap/WAP20090320163040.000000283.
blk_-6859853571473252522_2308
2009-03-20 16:30:40,582 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place
enough replicas, still in need of 1
2009-03-20 16:30:40,803 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/hbase/TABA/1481112388/wap/mapfiles/3564864123815244014/index.
blk_-5424740790201722732_2308
2009-03-20 16:30:43,584 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place
enough replicas, still in need of 1
2009-03-20 16:30:46,586 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place
enough replicas, still in need of 1
2009-03-20 16:30:46,812 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 9000, call
addBlock(/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index,
DFSClient_-116720272) from 10.24.1.20:34393: error:
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(Unknown
Source)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(Unknown
Source)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(Unknown Source)
        at org.apache.hadoop.ipc.Server$Handler.run(Unknown Source)
2009-03-20 16:30:47,220 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 16 on 9000, call
addBlock(/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index,
DFSClient_-116720272) from 10.24.1.20:34393: error:
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(Unknown
Source)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(Unknown
Source)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(Unknown Source)
        at org.apache.hadoop.ipc.Server$Handler.run(Unknown Source)
2009-03-20 16:30:48,026 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 9000, call
addBlock(/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index,
DFSClient_-116720272) from 10.24.1.20:34393: error:
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(Unknown
Source)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(Unknown
Source)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(Unknown Source)
        at org.apache.hadoop.ipc.Server$Handler.run(Unknown Source)
2009-03-20 16:30:49,588 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place
enough replicas, still in need of 1
2009-03-20 16:30:49,630 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 9000, call
addBlock(/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index,
DFSClient_-116720272) from 10.24.1.20:34393: error:
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on
/hbase/TABA/compaction.dir/1481112388/wap/mapfiles/808539215531658503/index
File does not exist. [Lease.  Holder: DFSClient_-116720272, pendingcreates:
5]
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(Unknown
Source)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(Unknown
Source)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(Unknown
Source)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(Unknown Source)
        at org.apache.hadoop.ipc.Server$Handler.run(Unknown Source)