You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by hua beatls <be...@gmail.com> on 2013/01/05 10:06:06 UTC
regionserver has too many "blcok' state
HI,
we have large batch file to put in the hbase, but we have many 'block'
state usring: jstack -F XXX(pid of regionserver), please see below:
- java.util.concurrent.locks.LockSupport.park(java.lang.Object)
@bci=14, line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 13980: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 13979: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 12957: (state = BLOCKED)
- java.lang.Object.wait(long) @bci=0 (Interpreted frame)
- java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
- org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153,
line=205 (Interpreted frame)
- org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220,
line=165 (Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 12956: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Interpreted frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Interpreted frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Interpreted frame)
- org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line
any suggestion for the error log?
Thanks!
beatls
Re: regionserver has too many "blcok' state
Posted by lars hofhansl <la...@apache.org>.
Which block states are you referring to? All I see is handler threads waiting for work.
________________________________
From: hua beatls <be...@gmail.com>
To: user@hbase.apache.org
Sent: Saturday, January 5, 2013 1:06 AM
Subject: regionserver has too many "blcok' state
HI,
we have large batch file to put in the hbase, but we have many 'block'
state usring: jstack -F XXX(pid of regionserver), please see below:
- java.util.concurrent.locks.LockSupport.park(java.lang.Object)
@bci=14, line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 13980: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 13979: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Compiled frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Compiled frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Compiled frame)
- java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
(Interpreted frame)
-
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
@bci=17, line=1103 (Interpreted frame)
- java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
(Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 12957: (state = BLOCKED)
- java.lang.Object.wait(long) @bci=0 (Interpreted frame)
- java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
- org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153,
line=205 (Interpreted frame)
- org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220,
line=165 (Interpreted frame)
- java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
Thread 12956: (state = BLOCKED)
- sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
- java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
line=186 (Interpreted frame)
-
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
@bci=42, line=2043 (Interpreted frame)
- java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
(Interpreted frame)
- org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line
any suggestion for the error log?
Thanks!
beatls
Re: regionserver has too many "blcok' state
Posted by Stack <st...@duboce.net>.
Is there no progress being made in your update? Mind providing more data
on version, where it is running, what the update is like, how big the cells
are, how many regions and regionservers.
St.Ack
On Sat, Jan 5, 2013 at 1:06 AM, hua beatls <be...@gmail.com> wrote:
> HI,
> we have large batch file to put in the hbase, but we have many 'block'
> state usring: jstack -F XXX(pid of regionserver), please see below:
>
>
> - java.util.concurrent.locks.LockSupport.park(java.lang.Object)
> @bci=14, line=186 (Compiled frame)
> -
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
> @bci=42, line=2043 (Compiled frame)
> - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
> (Compiled frame)
> - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
> (Interpreted frame)
> -
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
> @bci=17, line=1103 (Interpreted frame)
> - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
> (Interpreted frame)
> - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
>
>
> Thread 13980: (state = BLOCKED)
> - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
> - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
> line=186 (Compiled frame)
> -
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
> @bci=42, line=2043 (Compiled frame)
> - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
> (Compiled frame)
> - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
> (Interpreted frame)
> -
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
> @bci=17, line=1103 (Interpreted frame)
> - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
> (Interpreted frame)
> - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
>
>
> Thread 13979: (state = BLOCKED)
> - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
> - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
> line=186 (Compiled frame)
> -
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
> @bci=42, line=2043 (Compiled frame)
> - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
> (Compiled frame)
> - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043
> (Interpreted frame)
> -
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
> @bci=17, line=1103 (Interpreted frame)
> - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603
> (Interpreted frame)
> - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
>
>
> Thread 12957: (state = BLOCKED)
> - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
> - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
> - org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153,
> line=205 (Interpreted frame)
> - org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220,
> line=165 (Interpreted frame)
> - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
>
>
> Thread 12956: (state = BLOCKED)
> - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
> - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14,
> line=186 (Interpreted frame)
> -
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await()
> @bci=42, line=2043 (Interpreted frame)
> - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442
> (Interpreted frame)
> - org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line
>
> any suggestion for the error log?
>
> Thanks!
> beatls
>