You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jena.apache.org by "Tao (陶信东)" <ta...@myhexin.com> on 2013/04/16 09:24:30 UTC

Abnormal CPU consumption by Fuseki

Hi,

We’ve being using Fuseki/TDB for 2 years. Recently we noticed that
sometimes it was using huge amount of our CPU resources, as can be seen from
the cited email.

Did anyone encounter the same situations? What is the most probable problem?

Thanks

Tao

From: 陈仕员 [mailto:chenshiyuan@myhexin.com] 
Sent: Tuesday, April 16, 2013 3:10 PM
To: 陶信东
Cc: 夏炜
Subject: qna00002Fuseki进程cpu很高

 



 

jstack 日志:

 

2013-04-16 15:05:32

Full thread dump OpenJDK 64-Bit Server VM (16.0-b13 mixed mode):

 

"Attach Listener" daemon prio=10 tid=0x0000000000c61000 nid=0x46cb waiting
on condition [0x0000000000000000]

   java.lang.Thread.State: RUNNABLE

 

"qtp1025542363-365" prio=10 tid=0x00007fcdd0013800 nid=0x4676 runnable
[0x00007fcdcaaa9000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce5a510928> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2b6c03c0> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-364" prio=10 tid=0x00007fcdd0045000 nid=0x4623 waiting on
condition [0x00007fcdcaead000]

   java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.
locks.AbstractQueuedSynchronizer$ConditionObject)

        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN
anos(AbstractQueuedSynchronizer.java:2081)

        at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.
java:516)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.j
ava:39)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
62)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-362" prio=10 tid=0x00007fcdd0281800 nid=0x45c0 waiting on
condition [0x00007fcdd88ac000]

   java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.
locks.AbstractQueuedSynchronizer$ConditionObject)

        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN
anos(AbstractQueuedSynchronizer.java:2081)

        at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.
java:516)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.j
ava:39)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
62)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-361" prio=10 tid=0x00007fcdd01d3800 nid=0x45bf runnable
[0x00007fcddb5b9000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce5a50fa68> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2ba526d0> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-360" prio=10 tid=0x00007fcd8818c000 nid=0x447a waiting on
condition [0x00007fcdcc5c4000]

   java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.
locks.AbstractQueuedSynchronizer$ConditionObject)

        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN
anos(AbstractQueuedSynchronizer.java:2081)

        at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.
java:516)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.j
ava:39)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
62)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-358" prio=10 tid=0x00007fcd88182000 nid=0x43e5 waiting on
condition [0x00007fcdc8584000]

   java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.
locks.AbstractQueuedSynchronizer$ConditionObject)

        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN
anos(AbstractQueuedSynchronizer.java:2081)

        at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.
java:516)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.j
ava:39)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
62)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-357" prio=10 tid=0x00007fcd88183800 nid=0x4177 waiting on
condition [0x00007fcdd7fa3000]

   java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.
locks.AbstractQueuedSynchronizer$ConditionObject)

        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN
anos(AbstractQueuedSynchronizer.java:2081)

        at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.
java:516)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.j
ava:39)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
62)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-263" prio=10 tid=0x0000000002054000 nid=0x58a4 runnable
[0x00007fcdc7574000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0ebe78> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2b52f178> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-258" prio=10 tid=0x00007fce184f7800 nid=0x5899 runnable
[0x00007fcdc7a79000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-232" prio=10 tid=0x00007fce1816f000 nid=0x583b runnable
[0x00007fcdc9493000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-228" prio=10 tid=0x00007fce1821c800 nid=0x5833 runnable
[0x00007fcdc9897000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-223" prio=10 tid=0x00007fcdd027c800 nid=0x582a runnable
[0x00007fcdc9d9c000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0f86d8> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bfb5900> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-220" prio=10 tid=0x00007fcdd0175000 nid=0x5824 runnable
[0x00007fcdca09e000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0e8150> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bfb6218> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-180" prio=10 tid=0x00007fce18848800 nid=0x5782 runnable
[0x00007fcdcc8c6000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0f1ae8> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2b8b1658> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-161" prio=10 tid=0x00007fcdd0188000 nid=0x5755 runnable
[0x00007fcdcdbda000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0f9e88> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bfb5d50> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-145" prio=10 tid=0x00007fce181aa000 nid=0x5731 runnable
[0x00007fcdcebea000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.server.Request.isAsyncStarted(Request.java:1249)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:125)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-141" prio=10 tid=0x00007fce1866b000 nid=0x5728 runnable
[0x00007fcdcefee000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-120" prio=10 tid=0x00007fce18739800 nid=0x56ff runnable
[0x00007fcdd4468000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0ef508> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bfb63b0> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-107" prio=10 tid=0x00007fcdd0040800 nid=0x56f0 runnable
[0x00007fcdd5175000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-73" prio=10 tid=0x00007fcdd0015800 nid=0x56c7 runnable
[0x00007fcdd7397000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0f0b80> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bf74bd0> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-71" prio=10 tid=0x00007fcdd0011800 nid=0x56c5 runnable
[0x00007fcdd7599000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0f9128> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bfb5c38> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-60" prio=10 tid=0x0000000000e58000 nid=0x56b9 runnable
[0x00007fcdd80a4000]

   java.lang.Thread.State: RUNNABLE

        at
org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:58)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-24" prio=10 tid=0x0000000001016000 nid=0x4fd0 runnable
[0x00007fcdddabe000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.FileDispatcher.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)

        at sun.nio.ch.IOUtil.read(IOUtil.java:224)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)

        - locked <0x00007fce2b0e6888> (a java.lang.Object)

        at
org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)

        - locked <0x00007fce2bf85420> (a java.nio.HeapByteBuffer)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.fill(BlockingChannelConnector.java:237)

        at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)

        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)

        at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)

        at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnectio
n.java:50)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoin
t.run(BlockingChannelConnector.java:293)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-16 Acceptor0 BlockingChannelConnector@0.0.0.0:2020 STARTING"
prio=10 tid=0x00007fce186f9000 nid=0x4f27 runnable [0x00007fcdfd065000]

   java.lang.Thread.State: RUNNABLE

        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)

        at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)

        - locked <0x00007fce284d2e78> (a java.lang.Object)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector.accept(BlockingChannel
Connector.java:138)

        at
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.ja
va:833)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"qtp1025542363-10" prio=10 tid=0x00007fce1824d800 nid=0x4f21 waiting on
condition [0x00007fcdfd66b000]

   java.lang.Thread.State: TIMED_WAITING (sleeping)

        at java.lang.Thread.sleep(Native Method)

        at
org.eclipse.jetty.server.nio.BlockingChannelConnector$1.run(BlockingChannelC
onnector.java:90)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:
598)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5
33)

        at java.lang.Thread.run(Thread.java:636)

 

"HashSessionScavenger-0" daemon prio=10 tid=0x00007fce18254800 nid=0x4f1b in
Object.wait() [0x00007fcdfd76c000]

   java.lang.Thread.State: TIMED_WAITING (on object monitor)

        at java.lang.Object.wait(Native Method)

        - waiting on <0x00007fce28505368> (a java.util.TaskQueue)

        at java.util.TimerThread.mainLoop(Timer.java:531)

        - locked <0x00007fce28505368> (a java.util.TaskQueue)

        at java.util.TimerThread.run(Timer.java:484)

 

"Low Memory Detector" daemon prio=10 tid=0x00007fce18025000 nid=0x4ee6
runnable [0x0000000000000000]

   java.lang.Thread.State: RUNNABLE

 

"CompilerThread1" daemon prio=10 tid=0x00007fce18022000 nid=0x4ee5 waiting
on condition [0x0000000000000000]

   java.lang.Thread.State: RUNNABLE

 

"CompilerThread0" daemon prio=10 tid=0x00007fce1801f000 nid=0x4ee4 waiting
on condition [0x0000000000000000]

   java.lang.Thread.State: RUNNABLE

 

"Signal Dispatcher" daemon prio=10 tid=0x00007fce1801d000 nid=0x4ee3
runnable [0x0000000000000000]

   java.lang.Thread.State: RUNNABLE

 

"Finalizer" daemon prio=10 tid=0x00007fce18001000 nid=0x4ee2 in
Object.wait() [0x00007fce174c0000]

   java.lang.Thread.State: WAITING (on object monitor)

        at java.lang.Object.wait(Native Method)

        - waiting on <0x00007fce284f6890> (a
java.lang.ref.ReferenceQueue$Lock)

        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)

        - locked <0x00007fce284f6890> (a java.lang.ref.ReferenceQueue$Lock)

        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)

        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)

 

"Reference Handler" daemon prio=10 tid=0x0000000000b96800 nid=0x4ee1 in
Object.wait() [0x00007fce175c1000]

   java.lang.Thread.State: WAITING (on object monitor)

        at java.lang.Object.wait(Native Method)

        - waiting on <0x00007fce284ee948> (a java.lang.ref.Reference$Lock)

        at java.lang.Object.wait(Object.java:502)

        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)

        - locked <0x00007fce284ee948> (a java.lang.ref.Reference$Lock)

 

"main" prio=10 tid=0x0000000000b22800 nid=0x4ed7 in Object.wait()
[0x00007fce78401000]

   java.lang.Thread.State: WAITING (on object monitor)

        at java.lang.Object.wait(Native Method)

        - waiting on <0x00007fce285024e0> (a java.lang.Object)

        at java.lang.Object.wait(Object.java:502)

        at
org.eclipse.jetty.util.thread.QueuedThreadPool.join(QueuedThreadPool.java:38
5)

        - locked <0x00007fce285024e0> (a java.lang.Object)

        at org.eclipse.jetty.server.Server.join(Server.java:402)

        at org.apache.jena.fuseki.FusekiCmd.exec(FusekiCmd.java:402)

        at arq.cmdline.CmdMain.mainMethod(CmdMain.java:101)

        at arq.cmdline.CmdMain.mainRun(CmdMain.java:63)

        at arq.cmdline.CmdMain.mainRun(CmdMain.java:50)

        at org.apache.jena.fuseki.FusekiCmd.main(FusekiCmd.java:106)

 

"VM Thread" prio=10 tid=0x0000000000b92000 nid=0x4ee0 runnable 

 

"GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000000b2d800 nid=0x4ed8
runnable 

 

"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000000b2f800 nid=0x4ed9
runnable 

 

"GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000000b31000 nid=0x4eda
runnable 

 

"GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000000b33000 nid=0x4edb
runnable 

 

"GC task thread#4 (ParallelGC)" prio=10 tid=0x0000000000b35000 nid=0x4edc
runnable 

 

"GC task thread#5 (ParallelGC)" prio=10 tid=0x0000000000b36800 nid=0x4edd
runnable 

 

"GC task thread#6 (ParallelGC)" prio=10 tid=0x0000000000b38800 nid=0x4ede
runnable 

 

"GC task thread#7 (ParallelGC)" prio=10 tid=0x0000000000b3a800 nid=0x4edf
runnable 

 

"VM Periodic Task Thread" prio=10 tid=0x00007fce18027800 nid=0x4ee7 waiting
on condition 

 

JNI global references: 1299

 

  _____  

  _____  

陈仕员

浙江核新同花顺网络信息股份有限公司 

Mobile :18668187090

Email  : chenshiyuan@myhexin.com

WebSite: http://search.10jqka.com.cn 

 


RE: Abnormal CPU consumption by Fuseki

Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Hi Andy,

Sorry that the picture didn't show (I don't know why). The CPU consumption of the Fuseki process is over 600% (the server has 8 cores).

For now, I think the problem is probably caused by too much log IOs in our own code. We customized LARQ and included it in Fuseki. There were too many "System.out.println()" in our code. 

I've removed all the console output code and it seemed ok up to now. 

Thanks
Tao

-----Original Message-----
From: Andy Seaborne [mailto:andy@apache.org] 
Sent: Tuesday, April 16, 2013 6:55 PM
To: users@jena.apache.org
Subject: Re: Abnormal CPU consumption by Fuseki

On 16/04/13 08:24, Tao (陶信东) wrote:
> Hi,
>
> We’ve being using Fuseki/TDB for 2 years. Recently we noticed that 
> sometimes it was using huge amount of our CPU resources, as can be 
> seen from the cited email.

I'm afraid that list of threads doesn't tell me anything; maybe someone else can seee something in the list.  No Jena code is mentioned except for the start up thread (which is hanging around (= "WAITING") doing nothing).  Several threads seem to be reading HTTP requests (in Jetty) (are the clients being slow?)

What is the setup? (machine size? cores? version of software?) What has changed recently?
Does it have enough heap (maybe the GC is taking a lot of the time)?

What causes you to think it is consuming a lot of CPU?

	Andy

>
> Did anyone encounter the same situations? What is the most probable problem?
>
> Thanks
>
> Tao
>
> *From:*陈仕员[mailto:chenshiyuan@myhexin.com]
> *Sent:* Tuesday, April 16, 2013 3:10 PM
> *To:* 陶信东
> *Cc:* 夏炜
> *Subject:* qna00002Fuseki进程cpu很高
>
> jstack 日志:
>
> 2013-04-16 15:05:32
>


Re: Abnormal CPU consumption by Fuseki

Posted by Andy Seaborne <an...@apache.org>.
On 16/04/13 08:24, Tao (陶信东) wrote:
> Hi,
>
> We’ve being using Fuseki/TDB for 2 years. Recently we noticed that
> sometimes it was using huge amount of our CPU resources, as can be seen
> from the cited email.

I'm afraid that list of threads doesn't tell me anything; maybe someone 
else can seee something in the list.  No Jena code is mentioned except 
for the start up thread (which is hanging around (= "WAITING") doing 
nothing).  Several threads seem to be reading HTTP requests (in Jetty) 
(are the clients being slow?)

What is the setup? (machine size? cores? version of software?)
What has changed recently?
Does it have enough heap (maybe the GC is taking a lot of the time)?

What causes you to think it is consuming a lot of CPU?

	Andy

>
> Did anyone encounter the same situations? What is the most probable problem?
>
> Thanks
>
> Tao
>
> *From:*陈仕员[mailto:chenshiyuan@myhexin.com]
> *Sent:* Tuesday, April 16, 2013 3:10 PM
> *To:* 陶信东
> *Cc:* 夏炜
> *Subject:* qna00002Fuseki进程cpu很高
>
> jstack 日志:
>
> 2013-04-16 15:05:32
>


Re: Abnormal CPU consumption by Fuseki

Posted by Claude Warren <cl...@xenei.com>.
Tao,

I think I had a similar problem and discovered it was a bug in the JVM.
 Now I am doing all of this from memory so some of the info below may be
incorrect.

I captured thread dumps and ran http://java.net/projects/tda  I think the
TDA documentation will tell you how to capture thread dumps without killing
the process.

I found that there were a number of threads waiting for the same object but
that no thread held it.  (From a quick scan of your dump this may be the
case you have).

This is similar to (if not exactly the same as)
http://bugs.sun.com/view_bug.do?bug_id=6822370

I found that +UseMembar worked on a couple of servers I was supporting, but
only with specific versions of Java.  I don't recall which versions only
that the servers were Ubuntu servers so that may help some.

Information on +UseMembar can be found at
http://stackoverflow.com/questions/1120088/what-is-javas-xxusemembar-parameter

-- Claude


On Tue, Apr 16, 2013 at 8:24 AM, Tao (陶信东) <ta...@myhexin.com> wrote:

> ****
>
> Hi,****
>
> We’ve being using Fuseki/TDB for 2 years. Recently we noticed that
> sometimes it was using huge amount of our CPU resources, as can be seen
> from the cited email.****
>
> Did anyone encounter the same situations? What is the most probable
> problem?****
>
> Thanks****
>
> Tao****
>
> *From:* 陈仕员 [mailto:chenshiyuan@myhexin.com]
> *Sent:* Tuesday, April 16, 2013 3:10 PM
> *To:* 陶信东
> *Cc:* 夏炜
> *Subject:* qna00002Fuseki进程cpu很高****
>
> ** **
>
> ****
>
>  ****
>
> jstack 日志:****
>
>  ****
>
> 2013-04-16 15:05:32****
>
> Full thread dump OpenJDK 64-Bit Server VM (16.0-b13 mixed mode):****
>
>  ****
>
>
> "Attach Listener" daemon prio=10 tid=0x0000000000c61000 nid=0x46cb waiting on condition [0x0000000000000000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>  ****
>
>
> "qtp1025542363-365" prio=10 tid=0x00007fcdd0013800 nid=0x4676 runnable [0x00007fcdcaaa9000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce5a510928> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2b6c03c0> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-364" prio=10 tid=0x00007fcdd0045000 nid=0x4623 waiting on condition [0x00007fcdcaead000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>
>         - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> ****
>
>
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> ****
>
>
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
> ****
>
>
>         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-362" prio=10 tid=0x00007fcdd0281800 nid=0x45c0 waiting on condition [0x00007fcdd88ac000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>
>         - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> ****
>
>
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> ****
>
>
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
> ****
>
>
>         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-361" prio=10 tid=0x00007fcdd01d3800 nid=0x45bf runnable [0x00007fcddb5b9000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce5a50fa68> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2ba526d0> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-360" prio=10 tid=0x00007fcd8818c000 nid=0x447a waiting on condition [0x00007fcdcc5c4000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>
>         - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> ****
>
>
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> ****
>
>
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
> ****
>
>
>         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-358" prio=10 tid=0x00007fcd88182000 nid=0x43e5 waiting on condition [0x00007fcdc8584000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>
>         - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> ****
>
>
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> ****
>
>
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
> ****
>
>
>         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-357" prio=10 tid=0x00007fcd88183800 nid=0x4177 waiting on condition [0x00007fcdd7fa3000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>
>         - parking to wait for  <0x00007fce284d0f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> ****
>
>
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> ****
>
>
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
> ****
>
>
>         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-263" prio=10 tid=0x0000000002054000 nid=0x58a4 runnable [0x00007fcdc7574000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0ebe78> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2b52f178> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-258" prio=10 tid=0x00007fce184f7800 nid=0x5899 runnable [0x00007fcdc7a79000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-232" prio=10 tid=0x00007fce1816f000 nid=0x583b runnable [0x00007fcdc9493000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-228" prio=10 tid=0x00007fce1821c800 nid=0x5833 runnable [0x00007fcdc9897000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-223" prio=10 tid=0x00007fcdd027c800 nid=0x582a runnable [0x00007fcdc9d9c000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0f86d8> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bfb5900> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-220" prio=10 tid=0x00007fcdd0175000 nid=0x5824 runnable [0x00007fcdca09e000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0e8150> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bfb6218> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-180" prio=10 tid=0x00007fce18848800 nid=0x5782 runnable [0x00007fcdcc8c6000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0f1ae8> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2b8b1658> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-161" prio=10 tid=0x00007fcdd0188000 nid=0x5755 runnable [0x00007fcdcdbda000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0f9e88> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bfb5d50> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-145" prio=10 tid=0x00007fce181aa000 nid=0x5731 runnable [0x00007fcdcebea000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.server.Request.isAsyncStarted(Request.java:1249)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:125)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-141" prio=10 tid=0x00007fce1866b000 nid=0x5728 runnable [0x00007fcdcefee000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-120" prio=10 tid=0x00007fce18739800 nid=0x56ff runnable [0x00007fcdd4468000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0ef508> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bfb63b0> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-107" prio=10 tid=0x00007fcdd0040800 nid=0x56f0 runnable [0x00007fcdd5175000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-73" prio=10 tid=0x00007fcdd0015800 nid=0x56c7 runnable [0x00007fcdd7397000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0f0b80> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bf74bd0> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-71" prio=10 tid=0x00007fcdd0011800 nid=0x56c5 runnable [0x00007fcdd7599000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0f9128> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bfb5c38> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-60" prio=10 tid=0x0000000000e58000 nid=0x56b9 runnable [0x00007fcdd80a4000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>
>         at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:826)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:58)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-24" prio=10 tid=0x0000000001016000 nid=0x4fd0 runnable [0x00007fcdddabe000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.FileDispatcher.read0(Native Method)****
>
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)****
>
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)****
>
>         at sun.nio.ch.IOUtil.read(IOUtil.java:224)****
>
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)**
> **
>
>         - locked <0x00007fce2b0e6888> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.io.nio.ChannelEndPoint.fill(ChannelEndPoint.java:186)
> ****
>
>         - locked <0x00007fce2bf85420> (a java.nio.HeapByteBuffer)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.fill(BlockingChannelConnector.java:237)
> ****
>
>         at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:949)****
>
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:274)
> ****
>
>
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218)
> ****
>
>
>         at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:50)
> ****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEndPoint.run(BlockingChannelConnector.java:293)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
> "qtp1025542363-16 Acceptor0 BlockingChannelConnector@0.0.0.0:2020
>  STARTING" prio=10 tid=0x00007fce186f9000 nid=0x4f27 runnable [0x00007fcdfd065000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)****
>
>
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
> ****
>
>         - locked <0x00007fce284d2e78> (a java.lang.Object)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector.accept(BlockingChannelConnector.java:138)
> ****
>
>
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:833)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "qtp1025542363-10" prio=10 tid=0x00007fce1824d800 nid=0x4f21 waiting on condition [0x00007fcdfd66b000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (sleeping)****
>
>         at java.lang.Thread.sleep(Native Method)****
>
>
>         at org.eclipse.jetty.server.nio.BlockingChannelConnector$1.run(BlockingChannelConnector.java:90)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598)
> ****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533)
> ****
>
>         at java.lang.Thread.run(Thread.java:636)****
>
>  ****
>
>
> "HashSessionScavenger-0" daemon prio=10 tid=0x00007fce18254800 nid=0x4f1b in Object.wait() [0x00007fcdfd76c000]
> ****
>
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)****
>
>         at java.lang.Object.wait(Native Method)****
>
>         - waiting on <0x00007fce28505368> (a java.util.TaskQueue)****
>
>         at java.util.TimerThread.mainLoop(Timer.java:531)****
>
>         - locked <0x00007fce28505368> (a java.util.TaskQueue)****
>
>         at java.util.TimerThread.run(Timer.java:484)****
>
>  ****
>
>
> "Low Memory Detector" daemon prio=10 tid=0x00007fce18025000 nid=0x4ee6 runnable [0x0000000000000000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>  ****
>
>
> "CompilerThread1" daemon prio=10 tid=0x00007fce18022000 nid=0x4ee5 waiting on condition [0x0000000000000000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>  ****
>
>
> "CompilerThread0" daemon prio=10 tid=0x00007fce1801f000 nid=0x4ee4 waiting on condition [0x0000000000000000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>  ****
>
>
> "Signal Dispatcher" daemon prio=10 tid=0x00007fce1801d000 nid=0x4ee3 runnable [0x0000000000000000]
> ****
>
>    java.lang.Thread.State: RUNNABLE****
>
>  ****
>
>
> "Finalizer" daemon prio=10 tid=0x00007fce18001000 nid=0x4ee2 in Object.wait() [0x00007fce174c0000]
> ****
>
>    java.lang.Thread.State: WAITING (on object monitor)****
>
>         at java.lang.Object.wait(Native Method)****
>
>
>         - waiting on <0x00007fce284f6890> (a java.lang.ref.ReferenceQueue$Lock)
> ****
>
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)***
> *
>
>         - locked <0x00007fce284f6890> (a java.lang.ref.ReferenceQueue$Lock)
> ****
>
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)***
> *
>
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)
> ****
>
>  ****
>
>
> "Reference Handler" daemon prio=10 tid=0x0000000000b96800 nid=0x4ee1 in Object.wait() [0x00007fce175c1000]
> ****
>
>    java.lang.Thread.State: WAITING (on object monitor)****
>
>         at java.lang.Object.wait(Native Method)****
>
>         - waiting on <0x00007fce284ee948> (a java.lang.ref.Reference$Lock)
> ****
>
>         at java.lang.Object.wait(Object.java:502)****
>
>         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
> ****
>
>         - locked <0x00007fce284ee948> (a java.lang.ref.Reference$Lock)****
>
>  ****
>
>
> "main" prio=10 tid=0x0000000000b22800 nid=0x4ed7 in Object.wait() [0x00007fce78401000]
> ****
>
>    java.lang.Thread.State: WAITING (on object monitor)****
>
>         at java.lang.Object.wait(Native Method)****
>
>         - waiting on <0x00007fce285024e0> (a java.lang.Object)****
>
>         at java.lang.Object.wait(Object.java:502)****
>
>
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.join(QueuedThreadPool.java:385)
> ****
>
>         - locked <0x00007fce285024e0> (a java.lang.Object)****
>
>         at org.eclipse.jetty.server.Server.join(Server.java:402)****
>
>         at org.apache.jena.fuseki.FusekiCmd.exec(FusekiCmd.java:402)****
>
>         at arq.cmdline.CmdMain.mainMethod(CmdMain.java:101)****
>
>         at arq.cmdline.CmdMain.mainRun(CmdMain.java:63)****
>
>         at arq.cmdline.CmdMain.mainRun(CmdMain.java:50)****
>
>         at org.apache.jena.fuseki.FusekiCmd.main(FusekiCmd.java:106)****
>
>  ****
>
> "VM Thread" prio=10 tid=0x0000000000b92000 nid=0x4ee0 runnable ****
>
>  ****
>
>
> "GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000000b2d800 nid=0x4ed8 runnable
> ****
>
>  ****
>
>
> "GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000000b2f800 nid=0x4ed9 runnable
> ****
>
>  ****
>
>
> "GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000000b31000 nid=0x4eda runnable
> ****
>
>  ****
>
>
> "GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000000b33000 nid=0x4edb runnable
> ****
>
>  ****
>
>
> "GC task thread#4 (ParallelGC)" prio=10 tid=0x0000000000b35000 nid=0x4edc runnable
> ****
>
>  ****
>
>
> "GC task thread#5 (ParallelGC)" prio=10 tid=0x0000000000b36800 nid=0x4edd runnable
> ****
>
>  ****
>
>
> "GC task thread#6 (ParallelGC)" prio=10 tid=0x0000000000b38800 nid=0x4ede runnable
> ****
>
>  ****
>
>
> "GC task thread#7 (ParallelGC)" prio=10 tid=0x0000000000b3a800 nid=0x4edf runnable
> ****
>
>  ****
>
>
> "VM Periodic Task Thread" prio=10 tid=0x00007fce18027800 nid=0x4ee7 waiting on condition
> ****
>
>  ****
>
> JNI global references: 1299****
>
>  ****
> ------------------------------
> ------------------------------
>
> 陈仕员****
>
> 浙江核新同花顺网络信息股份有限公司 ****
>
> Mobile :18668187090****
>
> Email  : chenshiyuan@myhexin.com****
>
> WebSite: http://search.10jqka.com.cn ****
>
>  ****
>



-- 
I like: Like Like - The likeliest place on the web<http://like-like.xenei.com>
Identity: https://www.identify.nu/user.php?claude@xenei.com
LinkedIn: http://www.linkedin.com/in/claudewarren