You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@servicecomb.apache.org by GitBox <gi...@apache.org> on 2021/09/28 13:50:12 UTC

[GitHub] [servicecomb-java-chassis] xxdwpl opened a new issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

xxdwpl opened a new issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601


   **版本:**
   1.3.2
   
   **背景:**
   服务端需要流式返回音频数据,采用http chunk方式传输。
   客户端接收音频数据后播放,播放存在取消操作,也就是数据接收一部分之后,客户端会存在`response.close()`操作。
   服务端在catch到Pipe closed异常后,会取消后续的业务操作,节省资源。
   发现在客户端连续取消8次后,第9次请求客户端无法接收到response数据,等待约50s后,服务恢复正常,可以继续请求。
   
   代码如下
   ```
   // 服务端接口代码
   public ResponseEntity<InputStream> serviceIntf(@RequestBody ...) {
       PipedInputStream inputStream = service.executBusiness(...);
       return ResponseEntity.ok().header(HttpHeaders.CONTENT_TYPE, "application/octet-stream").body(inputStream);
   }
   
   // 服务端启动异步线程做业务处理,并写入数据到outputStream,最后关闭流
   public InputStream executBusiness(...) {
       PipedOutputStream outputStream = new PipedOutputStream();
       PipedInputStream  inputStream = new PipedInputStream(outputStream, 64 * 1024);
       threadPoolTaskExecutor.execute(() -> {
           try {
               ...
               outputStream.write(audioData);
               outputStream.flush();
           } catch (IOException e) {
               // 客户端主动关闭连接,取消后续业务处理
               if ("Pipe closed".equals(e.getMessage())) {
                   cancelBusinessProcess();
               }
           } finally {
               outputStream.close();
           }
       });
   
   }
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929272639


   补充下,客户端主动关闭response时,cse错误日志:
   ```
   2021-09-28 18:04:27.903 [vert.x-eventloop-thread-7] ERROR - [AbstractRestInvocation.java:onExecuteHttpServerFiltersFinish:301] - [] - Failed to execute HttpServerFilters, operation:XXXService.xx.xxx, request uri:/xx/xxx/xxx
   java.util.concurrent.CompletionException: io.vertx.core.VertxException: Connection was closed
           at java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:326) ~[?:1.8.0_272]
           at java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:338) ~[?:1.8.0_272]
           at java.util.concurrent.CompletableFuture.uniRelay(CompletableFuture.java:925) ~[?:1.8.0_272]
           at java.util.concurrent.CompletableFuture$UniRelay.tryFire(CompletableFuture.java:913) ~[?:1.8.0_272]
           at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_272]
           at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_272]
           at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.handleException(InputStreamToReadStream.java:136) ~[foundation-vertx-1.3.2.jar!/:1.3.2]
           at org.apache.servicecomb.foundation.vertx.stream.PumpCommon.lambda$pump$0(PumpCommon.java:53) ~[foundation-vertx-1.3.2.jar!/:1.3.2]
           at io.vertx.core.http.impl.HttpServerResponseImpl.handleClosed(HttpServerResponseImpl.java:620) ~[vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.http.impl.HttpServerResponseImpl.handleException(HttpServerResponseImpl.java:594) ~[vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.http.impl.HttpServerRequestImpl.handleException(HttpServerRequestImpl.java:570) ~[vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.http.impl.Http1xServerConnection.handleClosed(Http1xServerConnection.java:413) ~[vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.net.impl.VertxHandler.lambda$channelInactive$4(VertxHandler.java:152) ~[vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.impl.ContextImpl.executeTask(ContextImpl.java:366) [vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:43) [vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.impl.ContextImpl.executeFromIO(ContextImpl.java:229) [vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.impl.ContextImpl.executeFromIO(ContextImpl.java:221) [vertx-core-3.9.4.jar!/:3.9.4]
           at io.vertx.core.net.impl.VertxHandler.channelInactive(VertxHandler.java:152) [vertx-core-3.9.4.jar!/:3.9.4]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:81) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:277) [netty-handler-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:389) [netty-codec-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354) [netty-codec-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:819) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) [netty-common-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) [netty-common-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) [netty-transport-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.59.Final.jar!/:4.1.59.Final]
           at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.59.Final.jar!/:4.1.59.Final]
           at java.lang.Thread.run(Thread.java:748) [?:1.8.0_272]
   Caused by: io.vertx.core.VertxException: Connection was closed
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] liubao68 edited a comment on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
liubao68 edited a comment on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-938393723


   > “客户端接收音频数据后播放,播放存在取消操作,也就是数据接收一部分之后,客户端会存在response.close()操作。
   服务端在catch到Pipe closed异常后,会取消后续的业务操作,节省资源”
   
   正常情况下, 客户端关闭连接, 服务端会接收到连接关闭事件。如果没有, 那么服务端会等到请求超时或者连接闲置时间后关闭连接。 
   
   可以首先确认下每次取消操作, 服务端的链接资源是否都及时被释放了。如果没有, 那么频繁的取消, 会导致这个现象。 即使通过扩大线程池, 可以多支持几个取消, 但仍然无法保证频繁的取消能够功能正常。 
   
   9次取消, 可能和worker pool size的设置有关系,和event loop size应该没关系, 可以从堆栈里面看出来, event loop 全部都是闲置的状。 最新代码默认值是20个, 1.3.2版本可以查询代码分析下。 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl edited a comment on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl edited a comment on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929238623


   **在第9次请求等待期间打印线程堆栈:**
   ```
   2021-08-30 15:02:24
   Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.162-b12 mixed mode):
   
   "vocoder--9" #123 prio=5 os_prio=0 tid=0x00007f49dd54b000 nid=0x299bb3 waiting on condition [0x00007f482bbfa000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--9" #122 prio=5 os_prio=0 tid=0x00007f49ddb2b800 nid=0x299bb2 waiting on condition [0x00007f482bcfb000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--9" #121 prio=5 os_prio=0 tid=0x00007f49e0003800 nid=0x299bb1 in Object.wait() [0x00007f482bdfc000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.awaitSpace(PipedInputStream.java:273)
   	at java.io.PipedInputStream.receive(PipedInputStream.java:231)
   	- locked <0x00000007956e1840> (a java.io.PipedInputStream)
   	at java.io.PipedOutputStream.write(PipedOutputStream.java:149)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.textAudioProcessEmotion(TextToVoiceService.java:480)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.lambda$processAudioEmotion$3(TextToVoiceService.java:412)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService$$Lambda$638/963565835.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x00000007956f4e60> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "pool-8-thread-4" #120 prio=5 os_prio=0 tid=0x00007f49b5181000 nid=0x299bb0 waiting on condition [0x00007f482befd000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--8" #119 prio=5 os_prio=0 tid=0x00007f49cc5bd000 nid=0x299b10 waiting on condition [0x00007f482bffe000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--8" #118 prio=5 os_prio=0 tid=0x00007f49cccd2800 nid=0x299b0f waiting on condition [0x00007f48301ac000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--8" #117 prio=5 os_prio=0 tid=0x00007f49d000e000 nid=0x299b0e waiting on condition [0x00007f48302ad000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-3" #116 prio=5 os_prio=0 tid=0x00007f49c888e800 nid=0x299b0d waiting on condition [0x00007f48303ae000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--7" #115 prio=5 os_prio=0 tid=0x00007f49bdcd7800 nid=0x299ad6 waiting on condition [0x00007f48304af000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--7" #114 prio=5 os_prio=0 tid=0x00007f49bd039000 nid=0x299ad5 waiting on condition [0x00007f48305b0000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--7" #113 prio=5 os_prio=0 tid=0x00007f49c0062000 nid=0x299ad4 waiting on condition [0x00007f48306b1000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-3" #112 prio=5 os_prio=0 tid=0x00007f49bc015800 nid=0x299ad3 waiting on condition [0x00007f48307b2000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--6" #111 prio=5 os_prio=0 tid=0x00007f49ac00a000 nid=0x299ad2 waiting on condition [0x00007f48308b3000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--6" #110 prio=5 os_prio=0 tid=0x00007f49adcea000 nid=0x299ad1 waiting on condition [0x00007f48309b4000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--6" #109 prio=5 os_prio=0 tid=0x00007f49b0018800 nid=0x299ad0 waiting on condition [0x00007f4830ab5000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-10-thread-2" #108 prio=5 os_prio=0 tid=0x00007f49ac027000 nid=0x299acf waiting on condition [0x00007f4830bb6000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc076e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "Attach Listener" #107 daemon prio=9 os_prio=0 tid=0x00007f4a1c001800 nid=0x299aab waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--5" #106 prio=5 os_prio=0 tid=0x00007f48b8260800 nid=0x299a71 waiting on condition [0x00007f4830db8000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--5" #105 prio=5 os_prio=0 tid=0x00007f48b910e000 nid=0x299a70 waiting on condition [0x00007f4830eb9000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--5" #104 prio=5 os_prio=0 tid=0x00007f48ac108800 nid=0x299a6f waiting on condition [0x00007f4830fba000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-2" #103 prio=5 os_prio=0 tid=0x00007f49dd008000 nid=0x299a6e waiting on condition [0x00007f48310bb000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--4" #102 prio=5 os_prio=0 tid=0x00007f48a40d0800 nid=0x299a68 waiting on condition [0x00007f48311bc000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--4" #101 prio=5 os_prio=0 tid=0x00007f48a502f800 nid=0x299a67 waiting on condition [0x00007f48312bd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--4" #100 prio=5 os_prio=0 tid=0x00007f4898161800 nid=0x299a66 waiting on condition [0x00007f48313be000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-2" #99 prio=5 os_prio=0 tid=0x00007f49b8011000 nid=0x299a65 waiting on condition [0x00007f48314bf000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--3" #98 prio=5 os_prio=0 tid=0x00007f4aa8d59800 nid=0x299a4e waiting on condition [0x00007f48315c0000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--3" #97 prio=5 os_prio=0 tid=0x00007f4aa8bc1800 nid=0x299a4d waiting on condition [0x00007f48316c1000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--3" #96 prio=5 os_prio=0 tid=0x00007f4aa009a000 nid=0x299a4c waiting on condition [0x00007f48317c2000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-10-thread-1" #95 prio=5 os_prio=0 tid=0x00007f49d0028000 nid=0x299a4b waiting on condition [0x00007f48318c3000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc076e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--2" #94 prio=5 os_prio=0 tid=0x00007f4a9cb78000 nid=0x299a3f waiting on condition [0x00007f48319c4000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--2" #93 prio=5 os_prio=0 tid=0x00007f4a9c052800 nid=0x299a3e waiting on condition [0x00007f4831ac5000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--2" #92 prio=5 os_prio=0 tid=0x00007f4a90014800 nid=0x299a2f waiting on condition [0x00007f4831bc6000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-1" #91 prio=5 os_prio=0 tid=0x00007f49c0032000 nid=0x299a2e waiting on condition [0x00007f4831cc7000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-19" #90 prio=5 os_prio=0 tid=0x00007f49b413f000 nid=0x299a1c waiting on condition [0x00007f4831dc8000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-18" #89 prio=5 os_prio=0 tid=0x00007f49b4008000 nid=0x299a1b waiting on condition [0x00007f4831ec9000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-17" #88 prio=5 os_prio=0 tid=0x00007f49b400b800 nid=0x299a1a waiting on condition [0x00007f4831fca000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-16" #87 prio=5 os_prio=0 tid=0x00007f49b400d000 nid=0x299a19 waiting on condition [0x00007f48320cb000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-15" #86 prio=5 os_prio=0 tid=0x00007f49b4015000 nid=0x299a18 waiting on condition [0x00007f48321cc000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-14" #85 prio=5 os_prio=0 tid=0x00007f49b402f800 nid=0x299a17 in Object.wait() [0x00007f48322cd000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070e406440> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e406440> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e506490> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e5065b8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-13" #84 prio=5 os_prio=0 tid=0x00007f49b4036000 nid=0x299a16 in Object.wait() [0x00007f48323ce000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e506840> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e506840> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070de5e578> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070de5e608> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-12" #83 prio=5 os_prio=0 tid=0x00007f49b4072800 nid=0x299a15 in Object.wait() [0x00007f48324cf000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070dc08180> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070dc08180> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070dd081f0> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070dd08280> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-11" #82 prio=5 os_prio=0 tid=0x00007f49b4085800 nid=0x299a14 waiting on condition [0x00007f48325d0000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-10" #81 prio=5 os_prio=0 tid=0x00007f49b40c3000 nid=0x299a13 in Object.wait() [0x00007f48326d1000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070d009a10> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070d009a10> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e162e70> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e162a90> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-9" #80 prio=5 os_prio=0 tid=0x00007f49b401a000 nid=0x299a12 waiting on condition [0x00007f48327d2000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-8" #79 prio=5 os_prio=0 tid=0x00007f49b4093800 nid=0x299a11 waiting on condition [0x00007f48328d3000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-7" #78 prio=5 os_prio=0 tid=0x00007f49b4090000 nid=0x299a10 waiting on condition [0x00007f48329d4000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-6" #77 prio=5 os_prio=0 tid=0x00007f49b408e000 nid=0x299a0f in Object.wait() [0x00007f4832ad5000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070e005e70> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e005e70> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e105ee0> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e105f70> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-5" #76 prio=5 os_prio=0 tid=0x00007f49b408b800 nid=0x299a0e waiting on condition [0x00007f4832bd6000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-4" #75 prio=5 os_prio=0 tid=0x00007f49b4077000 nid=0x299a0d waiting on condition [0x00007f4832cd7000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-3" #74 prio=5 os_prio=0 tid=0x00007f49b4075800 nid=0x299a0c in Object.wait() [0x00007f4832dd8000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e663550> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e6635e0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-2" #73 prio=5 os_prio=0 tid=0x00007f49b4070800 nid=0x299a0b waiting on condition [0x00007f4832ed9000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-1" #72 prio=5 os_prio=0 tid=0x00007f49b405f800 nid=0x299a0a in Object.wait() [0x00007f4832fda000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e95e320> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e95e320> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070ea5e390> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea5e420> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vocoder--1" #71 prio=5 os_prio=0 tid=0x00007f4a10a0b800 nid=0x299a03 waiting on condition [0x00007f4833bfc000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--1" #70 prio=5 os_prio=0 tid=0x00007f4a1048b000 nid=0x299a02 waiting on condition [0x00007f4833efd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-0" #69 prio=5 os_prio=0 tid=0x00007f49b4048800 nid=0x299a01 waiting on condition [0x00007f4833ffe000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--1" #68 prio=5 os_prio=0 tid=0x00007f4a044cc000 nid=0x299a00 waiting on condition [0x00007f489c1b7000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-1" #67 prio=5 os_prio=0 tid=0x00007f49b5303800 nid=0x2999ff waiting on condition [0x00007f489c4b8000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "RMI TCP Connection(156)-10.30.200.207" #66 daemon prio=5 os_prio=0 tid=0x00007f49fc00b800 nid=0x299541 runnable [0x00007f489c7b8000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea61218> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea613d8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "RMI TCP Connection(155)-10.30.200.207" #65 daemon prio=5 os_prio=0 tid=0x00007f49fc007000 nid=0x299523 runnable [0x00007f489c8b9000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea635f0> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea637b0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "RMI TCP Connection(157)-10.30.200.207" #64 daemon prio=5 os_prio=0 tid=0x00007f49fc001800 nid=0x299522 runnable [0x00007f489c9ba000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea659c8> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea65b88> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "JMX server connection timeout 63" #63 daemon prio=5 os_prio=0 tid=0x00007f49ec00f000 nid=0x299501 in Object.wait() [0x00007f489cabc000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:168)
   	- locked <0x000000070ea65d30> (a [I)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "RMI Scheduler(0)" #62 daemon prio=5 os_prio=0 tid=0x00007f49ec003800 nid=0x299500 waiting on condition [0x00007f489cbbd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x00000005edab36f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "DestroyJavaVM" #61 prio=5 os_prio=0 tid=0x00007f4abc013800 nid=0x298e53 waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE
   
      Locked ownable synchronizers:
   	- None
   
   "spectator-poller-0" #59 prio=5 os_prio=0 tid=0x00007f483a5d9000 nid=0x2993c9 waiting on condition [0x00007f489cebe000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea66208> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "spectator-gauge-polling-0" #58 daemon prio=5 os_prio=0 tid=0x00007f483a4c0800 nid=0x2993c8 waiting on condition [0x00007f489cfbf000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea66468> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-acceptor-thread-0" #57 prio=5 os_prio=0 tid=0x00007f49b4132000 nid=0x2993c7 runnable [0x00007f489d2c0000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66790> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66780> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66738> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:810)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-15" #56 prio=5 os_prio=0 tid=0x00007f49d402b800 nid=0x2993c6 runnable [0x00007f489d3c1000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66ad0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66ac0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66a78> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:810)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-14" #55 prio=5 os_prio=0 tid=0x00007f483a5f0000 nid=0x2993c5 runnable [0x00007f489daf1000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66e10> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66e00> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66db8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-13" #54 prio=5 os_prio=0 tid=0x00007f483a5ee800 nid=0x2993c4 runnable [0x00007f489dbf2000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67138> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67128> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea670e0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-12" #53 prio=5 os_prio=0 tid=0x00007f483a5ec800 nid=0x2993c3 runnable [0x00007f489dcf4000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67460> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67450> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67408> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-11" #52 prio=5 os_prio=0 tid=0x00007f483a5ea800 nid=0x2993c2 runnable [0x00007f489ddf5000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67788> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67778> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67730> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-10" #51 prio=5 os_prio=0 tid=0x00007f483a5e9000 nid=0x2993c1 runnable [0x00007f489def6000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67ab0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67aa0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67a58> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-9" #50 prio=5 os_prio=0 tid=0x00007f48bc00b800 nid=0x2993c0 runnable [0x00007f489dff7000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67dd8> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67dc8> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67d80> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-8" #49 prio=5 os_prio=0 tid=0x00007f483a5e7000 nid=0x2993bf runnable [0x00007f489e0f8000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68100> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea680f0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea680a8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-7" #48 prio=5 os_prio=0 tid=0x00007f483a5e5000 nid=0x2993be runnable [0x00007f489e1f9000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68428> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68418> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea683d0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-6" #47 prio=5 os_prio=0 tid=0x00007f483a5e3000 nid=0x2993bd runnable [0x00007f489e2f9000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68750> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68740> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea686f8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-5" #46 prio=5 os_prio=0 tid=0x00007f483a5e1800 nid=0x2993bc runnable [0x00007f489e3fa000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68a78> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68a68> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea68a20> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-4" #45 prio=5 os_prio=0 tid=0x00007f483a5df800 nid=0x2993bb runnable [0x00007f48b01f7000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68da0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68d90> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea68d48> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-3" #44 prio=5 os_prio=0 tid=0x00007f483a5de000 nid=0x2993ba runnable [0x00007f48e2200000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea690c8> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea690b8> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea69070> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-2" #43 prio=5 os_prio=0 tid=0x00007f483a5dc000 nid=0x2993b9 runnable [0x00007f491814f000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea693f0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea693e0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea69398> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-1" #42 prio=5 os_prio=0 tid=0x00007f483a5da800 nid=0x2993b8 runnable [0x00007f49a4130000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea69718> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea69708> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea696c0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-0" #41 prio=5 os_prio=0 tid=0x00007f483a49e800 nid=0x2993b7 runnable [0x00007f4a00105000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea69a40> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea69a30> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea699e8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vertx-blocked-thread-checker" #40 daemon prio=5 os_prio=0 tid=0x00007f48c7880000 nid=0x2993b6 in Object.wait() [0x00007f4a03bf5000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.util.TimerThread.mainLoop(Timer.java:552)
   	- locked <0x000000070ea69ca8> (a java.util.TaskQueue)
   	at java.util.TimerThread.run(Timer.java:505)
   
      Locked ownable synchronizers:
   	- None
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl edited a comment on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl edited a comment on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929238623


   **在第9次请求等待期间打印线程堆栈:**
   ```
   2021-08-30 15:02:24
   Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.162-b12 mixed mode):
   
   "vocoder--9" #123 prio=5 os_prio=0 tid=0x00007f49dd54b000 nid=0x299bb3 waiting on condition [0x00007f482bbfa000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--9" #122 prio=5 os_prio=0 tid=0x00007f49ddb2b800 nid=0x299bb2 waiting on condition [0x00007f482bcfb000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--9" #121 prio=5 os_prio=0 tid=0x00007f49e0003800 nid=0x299bb1 in Object.wait() [0x00007f482bdfc000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.awaitSpace(PipedInputStream.java:273)
   	at java.io.PipedInputStream.receive(PipedInputStream.java:231)
   	- locked <0x00000007956e1840> (a java.io.PipedInputStream)
   	at java.io.PipedOutputStream.write(PipedOutputStream.java:149)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.textAudioProcessEmotion(TextToVoiceService.java:480)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.lambda$processAudioEmotion$3(TextToVoiceService.java:412)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService$$Lambda$638/963565835.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x00000007956f4e60> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "pool-8-thread-4" #120 prio=5 os_prio=0 tid=0x00007f49b5181000 nid=0x299bb0 waiting on condition [0x00007f482befd000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--8" #119 prio=5 os_prio=0 tid=0x00007f49cc5bd000 nid=0x299b10 waiting on condition [0x00007f482bffe000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--8" #118 prio=5 os_prio=0 tid=0x00007f49cccd2800 nid=0x299b0f waiting on condition [0x00007f48301ac000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--8" #117 prio=5 os_prio=0 tid=0x00007f49d000e000 nid=0x299b0e waiting on condition [0x00007f48302ad000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-3" #116 prio=5 os_prio=0 tid=0x00007f49c888e800 nid=0x299b0d waiting on condition [0x00007f48303ae000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--7" #115 prio=5 os_prio=0 tid=0x00007f49bdcd7800 nid=0x299ad6 waiting on condition [0x00007f48304af000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--7" #114 prio=5 os_prio=0 tid=0x00007f49bd039000 nid=0x299ad5 waiting on condition [0x00007f48305b0000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--7" #113 prio=5 os_prio=0 tid=0x00007f49c0062000 nid=0x299ad4 waiting on condition [0x00007f48306b1000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-3" #112 prio=5 os_prio=0 tid=0x00007f49bc015800 nid=0x299ad3 waiting on condition [0x00007f48307b2000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--6" #111 prio=5 os_prio=0 tid=0x00007f49ac00a000 nid=0x299ad2 waiting on condition [0x00007f48308b3000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--6" #110 prio=5 os_prio=0 tid=0x00007f49adcea000 nid=0x299ad1 waiting on condition [0x00007f48309b4000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--6" #109 prio=5 os_prio=0 tid=0x00007f49b0018800 nid=0x299ad0 waiting on condition [0x00007f4830ab5000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-10-thread-2" #108 prio=5 os_prio=0 tid=0x00007f49ac027000 nid=0x299acf waiting on condition [0x00007f4830bb6000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc076e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "Attach Listener" #107 daemon prio=9 os_prio=0 tid=0x00007f4a1c001800 nid=0x299aab waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--5" #106 prio=5 os_prio=0 tid=0x00007f48b8260800 nid=0x299a71 waiting on condition [0x00007f4830db8000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--5" #105 prio=5 os_prio=0 tid=0x00007f48b910e000 nid=0x299a70 waiting on condition [0x00007f4830eb9000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--5" #104 prio=5 os_prio=0 tid=0x00007f48ac108800 nid=0x299a6f waiting on condition [0x00007f4830fba000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-2" #103 prio=5 os_prio=0 tid=0x00007f49dd008000 nid=0x299a6e waiting on condition [0x00007f48310bb000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--4" #102 prio=5 os_prio=0 tid=0x00007f48a40d0800 nid=0x299a68 waiting on condition [0x00007f48311bc000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--4" #101 prio=5 os_prio=0 tid=0x00007f48a502f800 nid=0x299a67 waiting on condition [0x00007f48312bd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--4" #100 prio=5 os_prio=0 tid=0x00007f4898161800 nid=0x299a66 waiting on condition [0x00007f48313be000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-2" #99 prio=5 os_prio=0 tid=0x00007f49b8011000 nid=0x299a65 waiting on condition [0x00007f48314bf000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--3" #98 prio=5 os_prio=0 tid=0x00007f4aa8d59800 nid=0x299a4e waiting on condition [0x00007f48315c0000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--3" #97 prio=5 os_prio=0 tid=0x00007f4aa8bc1800 nid=0x299a4d waiting on condition [0x00007f48316c1000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--3" #96 prio=5 os_prio=0 tid=0x00007f4aa009a000 nid=0x299a4c waiting on condition [0x00007f48317c2000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-10-thread-1" #95 prio=5 os_prio=0 tid=0x00007f49d0028000 nid=0x299a4b waiting on condition [0x00007f48318c3000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc076e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vocoder--2" #94 prio=5 os_prio=0 tid=0x00007f4a9cb78000 nid=0x299a3f waiting on condition [0x00007f48319c4000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--2" #93 prio=5 os_prio=0 tid=0x00007f4a9c052800 nid=0x299a3e waiting on condition [0x00007f4831ac5000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--2" #92 prio=5 os_prio=0 tid=0x00007f4a90014800 nid=0x299a2f waiting on condition [0x00007f4831bc6000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-9-thread-1" #91 prio=5 os_prio=0 tid=0x00007f49c0032000 nid=0x299a2e waiting on condition [0x00007f4831cc7000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070dc06f18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-19" #90 prio=5 os_prio=0 tid=0x00007f49b413f000 nid=0x299a1c waiting on condition [0x00007f4831dc8000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-18" #89 prio=5 os_prio=0 tid=0x00007f49b4008000 nid=0x299a1b waiting on condition [0x00007f4831ec9000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-17" #88 prio=5 os_prio=0 tid=0x00007f49b400b800 nid=0x299a1a waiting on condition [0x00007f4831fca000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-16" #87 prio=5 os_prio=0 tid=0x00007f49b400d000 nid=0x299a19 waiting on condition [0x00007f48320cb000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-15" #86 prio=5 os_prio=0 tid=0x00007f49b4015000 nid=0x299a18 waiting on condition [0x00007f48321cc000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-14" #85 prio=5 os_prio=0 tid=0x00007f49b402f800 nid=0x299a17 in Object.wait() [0x00007f48322cd000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070e406440> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e406440> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e506490> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e5065b8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-13" #84 prio=5 os_prio=0 tid=0x00007f49b4036000 nid=0x299a16 in Object.wait() [0x00007f48323ce000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e506840> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e506840> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070de5e578> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070de5e608> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-12" #83 prio=5 os_prio=0 tid=0x00007f49b4072800 nid=0x299a15 in Object.wait() [0x00007f48324cf000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070dc08180> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070dc08180> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070dd081f0> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070dd08280> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-11" #82 prio=5 os_prio=0 tid=0x00007f49b4085800 nid=0x299a14 waiting on condition [0x00007f48325d0000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-10" #81 prio=5 os_prio=0 tid=0x00007f49b40c3000 nid=0x299a13 in Object.wait() [0x00007f48326d1000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070d009a10> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070d009a10> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e162e70> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e162a90> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-9" #80 prio=5 os_prio=0 tid=0x00007f49b401a000 nid=0x299a12 waiting on condition [0x00007f48327d2000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-8" #79 prio=5 os_prio=0 tid=0x00007f49b4093800 nid=0x299a11 waiting on condition [0x00007f48328d3000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-7" #78 prio=5 os_prio=0 tid=0x00007f49b4090000 nid=0x299a10 waiting on condition [0x00007f48329d4000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-6" #77 prio=5 os_prio=0 tid=0x00007f49b408e000 nid=0x299a0f in Object.wait() [0x00007f4832ad5000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- locked <0x000000070e005e70> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e005e70> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e105ee0> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e105f70> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-5" #76 prio=5 os_prio=0 tid=0x00007f49b408b800 nid=0x299a0e waiting on condition [0x00007f4832bd6000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-4" #75 prio=5 os_prio=0 tid=0x00007f49b4077000 nid=0x299a0d waiting on condition [0x00007f4832cd7000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-3" #74 prio=5 os_prio=0 tid=0x00007f49b4075800 nid=0x299a0c in Object.wait() [0x00007f4832dd8000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e663550> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e6635e0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vert.x-worker-thread-2" #73 prio=5 os_prio=0 tid=0x00007f49b4070800 nid=0x299a0b waiting on condition [0x00007f4832ed9000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-1" #72 prio=5 os_prio=0 tid=0x00007f49b405f800 nid=0x299a0a in Object.wait() [0x00007f4832fda000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e95e320> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e95e320> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070ea5e390> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea5e420> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "vocoder--1" #71 prio=5 os_prio=0 tid=0x00007f4a10a0b800 nid=0x299a03 waiting on condition [0x00007f4833bfc000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e5e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "backend--1" #70 prio=5 os_prio=0 tid=0x00007f4a1048b000 nid=0x299a02 waiting on condition [0x00007f4833efd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5e868> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-worker-thread-0" #69 prio=5 os_prio=0 tid=0x00007f49b4048800 nid=0x299a01 waiting on condition [0x00007f4833ffe000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070e95e0d8> (a java.util.concurrent.LinkedTransferQueue)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
   	at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
   	at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "ttsService--1" #68 prio=5 os_prio=0 tid=0x00007f4a044cc000 nid=0x299a00 waiting on condition [0x00007f489c1b7000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ec98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "pool-8-thread-1" #67 prio=5 os_prio=0 tid=0x00007f49b5303800 nid=0x2999ff waiting on condition [0x00007f489c4b8000]
      java.lang.Thread.State: WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea5ef18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "RMI TCP Connection(156)-10.30.200.207" #66 daemon prio=5 os_prio=0 tid=0x00007f49fc00b800 nid=0x299541 runnable [0x00007f489c7b8000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea61218> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea613d8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "RMI TCP Connection(155)-10.30.200.207" #65 daemon prio=5 os_prio=0 tid=0x00007f49fc007000 nid=0x299523 runnable [0x00007f489c8b9000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea635f0> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea637b0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "RMI TCP Connection(157)-10.30.200.207" #64 daemon prio=5 os_prio=0 tid=0x00007f49fc001800 nid=0x299522 runnable [0x00007f489c9ba000]
      java.lang.Thread.State: RUNNABLE
   	at java.net.SocketInputStream.socketRead0(Native Method)
   	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
   	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
   	- locked <0x000000070ea659c8> (a java.io.BufferedInputStream)
   	at java.io.FilterInputStream.read(FilterInputStream.java:83)
   	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$7/605632991.run(Unknown Source)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070ea65b88> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   
   "JMX server connection timeout 63" #63 daemon prio=5 os_prio=0 tid=0x00007f49ec00f000 nid=0x299501 in Object.wait() [0x00007f489cabc000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:168)
   	- locked <0x000000070ea65d30> (a [I)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "RMI Scheduler(0)" #62 daemon prio=5 os_prio=0 tid=0x00007f49ec003800 nid=0x299500 waiting on condition [0x00007f489cbbd000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x00000005edab36f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "DestroyJavaVM" #61 prio=5 os_prio=0 tid=0x00007f4abc013800 nid=0x298e53 waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE
   
      Locked ownable synchronizers:
   	- None
   
   "spectator-poller-0" #59 prio=5 os_prio=0 tid=0x00007f483a5d9000 nid=0x2993c9 waiting on condition [0x00007f489cebe000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea66208> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "spectator-gauge-polling-0" #58 daemon prio=5 os_prio=0 tid=0x00007f483a4c0800 nid=0x2993c8 waiting on condition [0x00007f489cfbf000]
      java.lang.Thread.State: TIMED_WAITING (parking)
   	at sun.misc.Unsafe.park(Native Method)
   	- parking to wait for  <0x000000070ea66468> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-acceptor-thread-0" #57 prio=5 os_prio=0 tid=0x00007f49b4132000 nid=0x2993c7 runnable [0x00007f489d2c0000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66790> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66780> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66738> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:810)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-15" #56 prio=5 os_prio=0 tid=0x00007f49d402b800 nid=0x2993c6 runnable [0x00007f489d3c1000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66ad0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66ac0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66a78> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:810)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-14" #55 prio=5 os_prio=0 tid=0x00007f483a5f0000 nid=0x2993c5 runnable [0x00007f489daf1000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea66e10> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea66e00> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea66db8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-13" #54 prio=5 os_prio=0 tid=0x00007f483a5ee800 nid=0x2993c4 runnable [0x00007f489dbf2000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67138> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67128> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea670e0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-12" #53 prio=5 os_prio=0 tid=0x00007f483a5ec800 nid=0x2993c3 runnable [0x00007f489dcf4000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67460> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67450> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67408> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-11" #52 prio=5 os_prio=0 tid=0x00007f483a5ea800 nid=0x2993c2 runnable [0x00007f489ddf5000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67788> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67778> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67730> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-10" #51 prio=5 os_prio=0 tid=0x00007f483a5e9000 nid=0x2993c1 runnable [0x00007f489def6000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67ab0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67aa0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67a58> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-9" #50 prio=5 os_prio=0 tid=0x00007f48bc00b800 nid=0x2993c0 runnable [0x00007f489dff7000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea67dd8> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea67dc8> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea67d80> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-8" #49 prio=5 os_prio=0 tid=0x00007f483a5e7000 nid=0x2993bf runnable [0x00007f489e0f8000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68100> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea680f0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea680a8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-7" #48 prio=5 os_prio=0 tid=0x00007f483a5e5000 nid=0x2993be runnable [0x00007f489e1f9000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68428> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68418> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea683d0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-6" #47 prio=5 os_prio=0 tid=0x00007f483a5e3000 nid=0x2993bd runnable [0x00007f489e2f9000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68750> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68740> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea686f8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-5" #46 prio=5 os_prio=0 tid=0x00007f483a5e1800 nid=0x2993bc runnable [0x00007f489e3fa000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68a78> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68a68> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea68a20> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-4" #45 prio=5 os_prio=0 tid=0x00007f483a5df800 nid=0x2993bb runnable [0x00007f48b01f7000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea68da0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea68d90> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea68d48> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-3" #44 prio=5 os_prio=0 tid=0x00007f483a5de000 nid=0x2993ba runnable [0x00007f48e2200000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea690c8> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea690b8> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea69070> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-2" #43 prio=5 os_prio=0 tid=0x00007f483a5dc000 nid=0x2993b9 runnable [0x00007f491814f000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea693f0> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea693e0> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea69398> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-1" #42 prio=5 os_prio=0 tid=0x00007f483a5da800 nid=0x2993b8 runnable [0x00007f49a4130000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea69718> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea69708> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea696c0> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vert.x-eventloop-thread-0" #41 prio=5 os_prio=0 tid=0x00007f483a49e800 nid=0x2993b7 runnable [0x00007f4a00105000]
      java.lang.Thread.State: RUNNABLE
   	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   	- locked <0x000000070ea69a40> (a io.netty.channel.nio.SelectedSelectionKeySet)
   	- locked <0x000000070ea69a30> (a java.util.Collections$UnmodifiableSet)
   	- locked <0x000000070ea699e8> (a sun.nio.ch.EPollSelectorImpl)
   	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
   	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:814)
   	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
   	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
   	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- None
   
   "vertx-blocked-thread-checker" #40 daemon prio=5 os_prio=0 tid=0x00007f48c7880000 nid=0x2993b6 in Object.wait() [0x00007f4a03bf5000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.util.TimerThread.mainLoop(Timer.java:552)
   	- locked <0x000000070ea69ca8> (a java.util.TaskQueue)
   	at java.util.TimerThread.run(Timer.java:505)
   
      Locked ownable synchronizers:
   	- None
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929269757


   1)查询官方文档,发现verticle-count默认值为CPU个数,业务使用的8C虚拟机,verticle-count=8,与问题现象能对应起来。
   https://servicecomb.apache.org/references/java-chassis/zh_CN/transports/verticle-count.html
   
   2)调整verticle-count=16,重新测试后问题有所优化,大约25次请求后会重现问题。
   
   3)猜测可能是由于第17次请求时,第一个verticle实例释放了所以服务正常,到第25次之后verticle实现重新占满eventloop线程池。
   
   请帮忙解答下,在http chunk场景下,客户端主动关闭response,verticle实例回收的逻辑是什么?是否跟`servicecomb.rest.server.connection.idleTimeoutInSeconds`配置有关?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929238623






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929238623


   **在第9次请求等待期间打印线程堆栈:**
   ```
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] xxdwpl commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
xxdwpl commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-929251522


   线程堆栈分析发现,服务端已经正常返回数据,并且写满PipedOutputStream的缓冲区
   并且有发现vert.x线程在PipedInputStream的read方法处等待,**猜测cse有相关的配置项为8,导致了短时间内只能处理8个请求**
   
   ```
   "ttsService--9" #121 prio=5 os_prio=0 tid=0x00007f49e0003800 nid=0x299bb1 in Object.wait() [0x00007f482bdfc000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.awaitSpace(PipedInputStream.java:273)
   	at java.io.PipedInputStream.receive(PipedInputStream.java:231)
   	- locked <0x00000007956e1840> (a java.io.PipedInputStream)
   	at java.io.PipedOutputStream.write(PipedOutputStream.java:149)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.textAudioProcessEmotion(TextToVoiceService.java:480)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService.lambda$processAudioEmotion$3(TextToVoiceService.java:412)
   	at com.huawei.texttospeech.api.commands.TextToVoiceService$$Lambda$638/963565835.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x00000007956f4e60> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   ```
   
   ```
   "vert.x-worker-thread-3" #74 prio=5 os_prio=0 tid=0x00007f49b4075800 nid=0x299a0c in Object.wait() [0x00007f4832dd8000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
   	at java.lang.Object.wait(Native Method)
   	at java.io.PipedInputStream.read(PipedInputStream.java:326)
   	- eliminated <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.PipedInputStream.read(PipedInputStream.java:377)
   	- locked <0x000000070e5634e0> (a java.io.PipedInputStream)
   	at java.io.InputStream.read(InputStream.java:101)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$ReadResult.doRead(InputStreamToReadStream.java:106)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream.readInWorker(InputStreamToReadStream.java:127)
   	- locked <0x000000070e663550> (a org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream)
   	at org.apache.servicecomb.foundation.vertx.stream.InputStreamToReadStream$$Lambda$720/9588367.handle(Unknown Source)
   	at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$2(ContextImpl.java:313)
   	at io.vertx.core.impl.ContextImpl$$Lambda$723/2130232781.run(Unknown Source)
   	at io.vertx.core.impl.TaskQueue.run(TaskQueue.java:76)
   	at io.vertx.core.impl.TaskQueue$$Lambda$313/60426688.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
   	at java.lang.Thread.run(Thread.java:748)
   
      Locked ownable synchronizers:
   	- <0x000000070e6635e0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [servicecomb-java-chassis] liubao68 commented on issue #2601: vert.x-worker-thread处理PipedInputStream,连续8次取消response后,服务端无法正常返回响应消息

Posted by GitBox <gi...@apache.org>.
liubao68 commented on issue #2601:
URL: https://github.com/apache/servicecomb-java-chassis/issues/2601#issuecomment-938393723


   <<< “客户端接收音频数据后播放,播放存在取消操作,也就是数据接收一部分之后,客户端会存在response.close()操作。
   服务端在catch到Pipe closed异常后,会取消后续的业务操作,节省资源”
   
   正常情况下, 客户端关闭连接, 服务端会接收到连接关闭事件。如果没有, 那么服务端会等到请求超时或者连接闲置时间后关闭连接。 
   
   可以首先确认下每次取消操作, 服务端的链接资源是否都及时被释放了。如果没有, 那么频繁的取消, 会导致这个现象。 即使通过扩大线程池, 可以多支持几个取消, 但仍然无法保证频繁的取消能够功能正常。 
   
   9次取消, 可能和worker pool size的设置有关系,和event loop size应该没关系, 可以从堆栈里面看出来, event loop 全部都是闲置的状。 最新代码默认值是20个, 1.3.2版本可以查询代码分析下。 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@servicecomb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org