[jira] Commented: (HADOOP-1523) Hung region servers waiting on write locks

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12509546 ] 

Hudson commented on HADOOP-1523:
--------------------------------

Integrated in Hadoop-Nightly #142 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/142/])

> Hung region servers waiting on write locks
> ------------------------------------------
>
>                 Key: HADOOP-1523
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1523
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/hbase
>            Reporter: stack
>            Assignee: stack
>         Attachments: locks-v2.patch
>
>
> A couple of times this afternoon I"ve been able to manufacture a hung region server variously stuck trying to obtain write locks either on memcache or a row lock on HRegion.  The lease expiration must not be working properly (shutting down all open scanners).  Maybe locks should be expiring.
> {code}
> "IPC Server handler 2 on 60010" daemon prio=5 tid=0x005167f0 nid=0x189d000 in Object.wait() [0xb1397000..0xb1397d10]
>     at java.lang.Object.wait(Native Method)
>     - waiting on <0x0b316ba8> (a java.util.HashMap)
>     at java.lang.Object.wait(Object.java:474)
>     at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1211)
>     - locked <0x0b316ba8> (a java.util.HashMap)
>     at org.apache.hadoop.hbase.HRegion.startUpdate(HRegion.java:1020)
>     at org.apache.hadoop.hbase.HRegionServer.startUpdate(HRegionServer.java:1007)
>     at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:585)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)
> "IPC Server handler 1 on 60010" daemon prio=5 tid=0x005163f0 nid=0x189cc00 in Object.wait() [0xb1316000..0xb1316d10]
>     at java.lang.Object.wait(Native Method)
>     - waiting on <0x0b317148> (a java.lang.Integer)
>     at java.lang.Object.wait(Object.java:474)
>     at org.apache.hadoop.hbase.HLocking.obtainWriteLock(HLocking.java:82)
>     - locked <0x0b317148> (a java.lang.Integer) 
>     at org.apache.hadoop.hbase.HMemcache.add(HMemcache.java:153)
>     at org.apache.hadoop.hbase.HRegion.commit(HRegion.java:1144)
>     - locked <0x0b398080> (a org.apache.hadoop.io.Text)
>     at org.apache.hadoop.hbase.HRegionServer.commit(HRegionServer.java:1071)
>     at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:585)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.