You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Adarsh Sharma <ad...@orkash.com> on 2011/01/11 11:39:34 UTC

No locks available

Dear all,

Yesterday I was working on a cluster of 6 Hadoop nodes ( Load data, 
perform some jobs ). But today when I start my cluster I came across a 
problem on one of my datanodes.

Datanodes fails to start due to following error :-


2011-01-11 12:54:10,367 INFO 
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = hadoop3/172.16.1.4
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.2
STARTUP_MSG:   build = 
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2011-01-11 12:55:57,031 INFO 
org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: No 
locks available
        at sun.nio.ch.FileChannelImpl.lock0(Native Method)
        at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:881)
        at java.nio.channels.FileChannel.tryLock(FileChannel.java:962)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:527)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:505)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:363)
        at 
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:112)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)

2011-01-11 12:55:57,043 ERROR 
org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: No 
locks available
        at sun.nio.ch.FileChannelImpl.lock0(Native Method)
        at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:881)
        at java.nio.channels.FileChannel.tryLock(FileChannel.java:962)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:527)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:505)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:363)
        at 
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:112)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
"hadoop-hadoop-datanode-hadoop3.log" 1775L, 
210569C                                                        
1,1           Top


Can Please is familiar with this issue. Please help.


Thanks & Regards

Adarsh Sharma

Re: No locks available

Posted by Adarsh Sharma <ad...@orkash.com>.
Allen Wittenauer wrote:
> On Jan 11, 2011, at 2:39 AM, Adarsh Sharma wrote:
>
>   
>> Dear all,
>>
>> Yesterday I was working on a cluster of 6 Hadoop nodes ( Load data, perform some jobs ). But today when I start my cluster I came across a problem on one of my datanodes.
>>     
>
> 	Are you running this on NFS?
>   
No Sir,

I am running this on 3 Servers with local filesystem. Each Server 
contains 2 Hard Disks ( /hdd2-1, /hdd1-1 ) and on each servers there run 
2 VM's and one occupy /hdd2-1 and the other /hdd1-1.

My Namenode contains all the predefined Ip of VM's.


Thanks
>   
>> 2011-01-11 12:55:57,031 INFO org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: No locks available
>>

Re: No locks available

Posted by Allen Wittenauer <aw...@linkedin.com>.
On Jan 11, 2011, at 2:39 AM, Adarsh Sharma wrote:

> Dear all,
> 
> Yesterday I was working on a cluster of 6 Hadoop nodes ( Load data, perform some jobs ). But today when I start my cluster I came across a problem on one of my datanodes.

	Are you running this on NFS?

> 
> 2011-01-11 12:55:57,031 INFO org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: No locks available